A survey on video diffusion models

Z Xing, Q Feng, H Chen, Q Dai, H Hu, H Xu… - ACM Computing …, 2023 - dl.acm.org
The recent wave of AI-generated content (AIGC) has witnessed substantial success in
computer vision, with the diffusion model playing a crucial role in this achievement. Due to …

Vidiff: Translating videos via multi-modal instructions with diffusion models

Z Xing, Q Dai, Z Zhang, H Zhang, H Hu, Z Wu… - arXiv preprint arXiv …, 2023 - arxiv.org
Diffusion models have achieved significant success in image and video generation. This
motivates a growing interest in video editing tasks, where videos are edited according to …

ToonCrafter: Generative Cartoon Interpolation

J Xing, H Liu, M Xia, Y Zhang, X Wang, Y Shan… - arXiv preprint arXiv …, 2024 - arxiv.org
We introduce ToonCrafter, a novel approach that transcends traditional correspondence-
based cartoon video interpolation, paving the way for generative interpolation. Traditional …

Versatile Vision Foundation Model for Image and Video Colorization

V Bozic, A Djelouah, Y Zhang, R Timofte… - ACM SIGGRAPH 2024 …, 2024 - dl.acm.org
Image and video colorization are among the most common problems in image restoration.
This is an ill-posed problem and a wide variety of methods have been proposed, ranging …

LatentColorization: Latent Diffusion-Based Speaker Video Colorization

R Ward, D Bigioi, S Basak, JG Breslin… - IEEE Access, 2024 - ieeexplore.ieee.org
While current research predominantly focuses on image-based colorization, the domain of
video-based colorization remains relatively unexplored. Many existing video colorization …

Video Diffusion Models: A Survey

A Melnik, M Ljubljanac, C Lu, Q Yan, W Ren… - arXiv preprint arXiv …, 2024 - arxiv.org
Diffusion generative models have recently become a robust technique for producing and
modifying coherent, high-quality video. This survey offers a systematic overview of critical …