A survey on video diffusion models
The recent wave of AI-generated content (AIGC) has witnessed substantial success in
computer vision, with the diffusion model playing a crucial role in this achievement. Due to …
computer vision, with the diffusion model playing a crucial role in this achievement. Due to …
Vbench: Comprehensive benchmark suite for video generative models
Video generation has witnessed significant advancements yet evaluating these models
remains a challenge. A comprehensive evaluation benchmark for video generation is …
remains a challenge. A comprehensive evaluation benchmark for video generation is …
Videocrafter2: Overcoming data limitations for high-quality video diffusion models
Text-to-video generation aims to produce a video based on a given prompt. Recently
several commercial video models have been able to generate plausible videos with minimal …
several commercial video models have been able to generate plausible videos with minimal …
I2vgen-xl: High-quality image-to-video synthesis via cascaded diffusion models
Video synthesis has recently made remarkable strides benefiting from the rapid
development of diffusion models. However, it still encounters challenges in terms of …
development of diffusion models. However, it still encounters challenges in terms of …
Sparsectrl: Adding sparse controls to text-to-video diffusion models
The development of text-to-video (T2V), ie, generating videos with a given text prompt, has
been significantly advanced in recent years. However, relying solely on text prompts often …
been significantly advanced in recent years. However, relying solely on text prompts often …
Motion-i2v: Consistent and controllable image-to-video generation with explicit motion modeling
We introduce Motion-I2V, a novel framework for consistent and controllable text-guided
image-to-video generation (I2V). In contrast to previous methods that directly learn the …
image-to-video generation (I2V). In contrast to previous methods that directly learn the …
Breathing Life Into Sketches Using Text-to-Video Priors
A sketch is one of the most intuitive and versatile tools humans use to convey their ideas
visually. An animated sketch opens another dimension to the expression of ideas and is …
visually. An animated sketch opens another dimension to the expression of ideas and is …
Streamingt2v: Consistent, dynamic, and extendable long video generation from text
R Henschel, L Khachatryan, D Hayrapetyan… - arXiv preprint arXiv …, 2024 - arxiv.org
Text-to-video diffusion models enable the generation of high-quality videos that follow text
instructions, making it easy to create diverse and individual content. However, existing …
instructions, making it easy to create diverse and individual content. However, existing …
Follow-your-click: Open-domain regional image animation via short prompts
Despite recent advances in image-to-video generation, better controllability and local
animation are less explored. Most existing image-to-video methods are not locally aware …
animation are less explored. Most existing image-to-video methods are not locally aware …
Anyv2v: A plug-and-play framework for any video-to-video editing tasks
Video-to-video editing involves editing a source video along with additional control (such as
text prompts, subjects, or styles) to generate a new video that aligns with the source video …
text prompts, subjects, or styles) to generate a new video that aligns with the source video …