Draganything: Motion control for anything using entity representation
We introduce DragAnything, which utilizes a entity representation to achieve motion control
for any object in controllable video generation. Comparison to existing motion control …
for any object in controllable video generation. Comparison to existing motion control …
Direct-a-video: Customized video generation with user-directed camera movement and object motion
Recent text-to-video diffusion models have achieved impressive progress. In practice, users
often desire the ability to control object motion and camera movement independently for …
often desire the ability to control object motion and camera movement independently for …
Image conductor: Precision control for interactive video synthesis
Filmmaking and animation production often require sophisticated techniques for
coordinating camera transitions and object movements, typically involving labor-intensive …
coordinating camera transitions and object movements, typically involving labor-intensive …
Make it move: controllable image-to-video generation with text descriptions
Generating controllable videos conforming to user intentions is an appealing yet challenging
topic in computer vision. To enable maneuverable control in line with user intentions, a …
topic in computer vision. To enable maneuverable control in line with user intentions, a …
Motionctrl: A unified and flexible motion controller for video generation
Motions in a video primarily consist of camera motion, induced by camera movement, and
object motion, resulting from object movement. Accurate control of both camera and object …
object motion, resulting from object movement. Accurate control of both camera and object …
Mofa-video: Controllable image animation via generative motion field adaptions in frozen image-to-video diffusion model
We present MOFA-Video, an advanced controllable image animation method that generates
video from the given image using various additional controllable signals (such as human …
video from the given image using various additional controllable signals (such as human …
Dreamvideo: Composing your dream videos with customized subject and motion
Customized generation using diffusion models has made impressive progress in image
generation but remains unsatisfactory in the challenging video generation task as it requires …
generation but remains unsatisfactory in the challenging video generation task as it requires …
Physics-based character controllers using conditional vaes
High-quality motion capture datasets are now publicly available, and researchers have used
them to create kinematics-based controllers that can generate plausible and diverse human …
them to create kinematics-based controllers that can generate plausible and diverse human …
Understanding object dynamics for interactive image-to-video synthesis
A Blattmann, T Milbich… - Proceedings of the …, 2021 - openaccess.thecvf.com
What would be the effect of locally poking a static scene? We present an approach that
learns naturally-looking global articulations caused by a local manipulation at a pixel level …
learns naturally-looking global articulations caused by a local manipulation at a pixel level …
Carl: Controllable agent with reinforcement learning for quadruped locomotion
YS Luo, JH Soeseno, TPC Chen… - ACM Transactions on …, 2020 - dl.acm.org
Motion synthesis in a dynamic environment has been a long-standing problem for character
animation. Methods using motion capture data tend to scale poorly in complex environments …
animation. Methods using motion capture data tend to scale poorly in complex environments …