A Comprehensive Review of Data‐Driven Co‐Speech Gesture Generation

S Nyatsanga, T Kucherenko, C Ahuja… - Computer Graphics …, 2023 - Wiley Online Library
Gestures that accompany speech are an essential part of natural and efficient embodied
human communication. The automatic generation of such co‐speech gestures is a long …

Amp: Adversarial motion priors for stylized physics-based character control

XB Peng, Z Ma, P Abbeel, S Levine… - ACM Transactions on …, 2021 - dl.acm.org
Synthesizing graceful and life-like behaviors for physically simulated characters has been a
fundamental challenge in computer animation. Data-driven methods that leverage motion …

Deepphase: Periodic autoencoders for learning motion phase manifolds

S Starke, I Mason, T Komura - ACM Transactions on Graphics (TOG), 2022 - dl.acm.org
Learning the spatial-temporal structure of body movements is a fundamental problem for
character motion synthesis. In this work, we propose a novel neural network architecture …

History repeats itself: Human motion prediction via motion attention

W Mao, M Liu, M Salzmann - … Conference, Glasgow, UK, August 23–28 …, 2020 - Springer
Human motion prediction aims to forecast future human poses given a past motion. Whether
based on recurrent or feed-forward neural networks, existing methods fail to model the …

Deepmimic: Example-guided deep reinforcement learning of physics-based character skills

XB Peng, P Abbeel, S Levine… - ACM Transactions On …, 2018 - dl.acm.org
A longstanding goal in character animation is to combine data-driven specification of
behavior with a system that can execute a similar behavior in a physical simulation, thus …

Character controllers using motion vaes

HY Ling, F Zinno, G Cheng… - ACM Transactions on …, 2020 - dl.acm.org
A fundamental problem in computer animation is that of realizing purposeful and realistic
human movement given a sufficiently-rich set of motion capture clips. We learn data-driven …

Robust motion in-betweening

FG Harvey, M Yurick, D Nowrouzezahrai… - ACM Transactions on …, 2020 - dl.acm.org
In this work we present a novel, robust transition generation technique that can serve as a
new tool for 3D animators, based on adversarial recurrent neural networks. The system …

A deep learning framework for character motion synthesis and editing

D Holden, J Saito, T Komura - ACM Transactions on Graphics (TOG), 2016 - dl.acm.org
We present a framework to synthesize character movements based on high level
parameters, such that the produced movements respect the manifold of human motion …

Sim-to-real learning of all common bipedal gaits via periodic reward composition

J Siekmann, Y Godse, A Fern… - 2021 IEEE International …, 2021 - ieeexplore.ieee.org
We study the problem of realizing the full spectrum of bipedal locomotion on a real robot with
sim-to-real reinforcement learning (RL). A key challenge of learning legged locomotion is …

Mode-adaptive neural networks for quadruped motion control

H Zhang, S Starke, T Komura, J Saito - ACM Transactions on Graphics …, 2018 - dl.acm.org
Quadruped motion includes a wide variation of gaits such as walk, pace, trot and canter, and
actions such as jumping, sitting, turning and idling. Applying existing data-driven character …