Generative image dynamics
We present an approach to modeling an image-space prior on scene motion. Our prior is
learned from a collection of motion trajectories extracted from real video sequences …
learned from a collection of motion trajectories extracted from real video sequences …
Physdreamer: Physics-based interaction with 3d objects via video generation
Realistic object interactions are crucial for creating immersive virtual experiences, yet
synthesizing realistic 3D object dynamics in response to novel interactions remains a …
synthesizing realistic 3D object dynamics in response to novel interactions remains a …
Physgen: Rigid-body physics-grounded image-to-video generation
We present PhysGen, a novel image-to-video generation method that converts a single
image and an input condition (eg., force and torque applied to an object in the image) to …
image and an input condition (eg., force and torque applied to an object in the image) to …
Tactile-augmented radiance fields
Y Dou, F Yang, Y Liu, A Loquercio… - Proceedings of the …, 2024 - openaccess.thecvf.com
We present a scene representation that brings vision and touch into a shared 3D space
which we call a tactile-augmented radiance field. This representation capitalizes on two key …
which we call a tactile-augmented radiance field. This representation capitalizes on two key …
Visual vibrometry: Estimating material properties from small motion in video
The estimation of material properties is important for scene understanding, with many
applications in vision, robotics, and structural engineering. This paper connects …
applications in vision, robotics, and structural engineering. This paper connects …
Eulerian video magnification and analysis
The world is filled with important, but visually subtle signals. A person's pulse, the breathing
of an infant, the sag and sway of a bridge---these all create visual patterns, which are too …
of an infant, the sag and sway of a bridge---these all create visual patterns, which are too …
High frequency modal identification on noisy high-speed camera data
J Javh, J Slavič, M Boltežar - Mechanical Systems and Signal Processing, 2018 - Elsevier
Vibration measurements using optical full-field systems based on high-speed footage are
typically heavily burdened by noise, as the displacement amplitudes of the vibrating …
typically heavily burdened by noise, as the displacement amplitudes of the vibrating …
ipoke: Poking a still image for controlled stochastic video synthesis
A Blattmann, T Milbich… - Proceedings of the …, 2021 - openaccess.thecvf.com
How would a static scene react to a local poke? What are the effects on other parts of an
object if you could locally push it? There will be distinctive movement, despite evident …
object if you could locally push it? There will be distinctive movement, despite evident …
Understanding object dynamics for interactive image-to-video synthesis
A Blattmann, T Milbich… - Proceedings of the …, 2021 - openaccess.thecvf.com
What would be the effect of locally poking a static scene? We present an approach that
learns naturally-looking global articulations caused by a local manipulation at a pixel level …
learns naturally-looking global articulations caused by a local manipulation at a pixel level …
Visual rhythm and beat
A Davis, M Agrawala - ACM Transactions on Graphics (TOG), 2018 - dl.acm.org
We present a visual analogue for musical rhythm derived from an analysis of motion in
video, and show that alignment of visual rhythm with its musical counterpart results in the …
video, and show that alignment of visual rhythm with its musical counterpart results in the …