A Comprehensive Review of Data‐Driven Co‐Speech Gesture Generation

S Nyatsanga, T Kucherenko, C Ahuja… - Computer Graphics …, 2023 - Wiley Online Library
Gestures that accompany speech are an essential part of natural and efficient embodied
human communication. The automatic generation of such co‐speech gestures is a long …

A survey of advances in vision-based human motion capture and analysis

TB Moeslund, A Hilton, V Krüger - Computer vision and image …, 2006 - Elsevier
This survey reviews advances in human motion capture and analysis from 2000 to 2006,
following a previous survey of papers up to 2000 [TB Moeslund, E. Granum, A survey of …

Sequential modeling enables scalable learning for large vision models

Y Bai, X Geng, K Mangalam, A Bar… - Proceedings of the …, 2024 - openaccess.thecvf.com
We introduce a novel sequential modeling approach which enables learning a Large Vision
Model (LVM) without making use of any linguistic data. To do this we define a common …

Bailando: 3d dance generation by actor-critic gpt with choreographic memory

L Siyao, W Yu, T Gu, C Lin, Q Wang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Driving 3D characters to dance following a piece of music is highly challenging due to the
spatial constraints applied to poses by choreography norms. In addition, the generated …

Amp: Adversarial motion priors for stylized physics-based character control

XB Peng, Z Ma, P Abbeel, S Levine… - ACM Transactions on …, 2021 - dl.acm.org
Synthesizing graceful and life-like behaviors for physically simulated characters has been a
fundamental challenge in computer animation. Data-driven methods that leverage motion …

Deepphase: Periodic autoencoders for learning motion phase manifolds

S Starke, I Mason, T Komura - ACM Transactions on Graphics (TOG), 2022 - dl.acm.org
Learning the spatial-temporal structure of body movements is a fundamental problem for
character motion synthesis. In this work, we propose a novel neural network architecture …

Robust motion in-betweening

FG Harvey, M Yurick, D Nowrouzezahrai… - ACM Transactions on …, 2020 - dl.acm.org
In this work we present a novel, robust transition generation technique that can serve as a
new tool for 3D animators, based on adversarial recurrent neural networks. The system …

Putting people in their place: Affordance-aware human insertion into scenes

S Kulal, T Brooks, A Aiken, J Wu… - Proceedings of the …, 2023 - openaccess.thecvf.com
We study the problem of inferring scene affordances by presenting a method for realistically
inserting people into scenes. Given a scene image with a marked region and an image of a …

Stochastic scene-aware motion prediction

M Hassan, D Ceylan, R Villegas… - Proceedings of the …, 2021 - openaccess.thecvf.com
A long-standing goal in computer vision is to capture, model, and realistically synthesize
human behavior. Specifically, by learning from data, our goal is to enable virtual humans to …

GOAL: Generating 4D whole-body motion for hand-object grasping

O Taheri, V Choutas, MJ Black… - Proceedings of the …, 2022 - openaccess.thecvf.com
Generating digital humans that move realistically has many applications and is widely
studied, but existing methods focus on the major limbs of the body, ignoring the hands and …