Generating human motion from textual descriptions with discrete representations

J Zhang, Y Zhang, X Cun, Y Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this work, we investigate a simple and must-known conditional generative framework
based on Vector Quantised-Variational AutoEncoder (VQ-VAE) and Generative Pre-trained …

Motiondiffuse: Text-driven human motion generation with diffusion model

M Zhang, Z Cai, L Pan, F Hong, X Guo, L Yang… - arXiv preprint arXiv …, 2022 - arxiv.org
Human motion modeling is important for many modern graphics applications, which typically
require professional skills. In order to remove the skill barriers for laymen, recent motion …

Physdiff: Physics-guided human motion diffusion model

Y Yuan, J Song, U Iqbal, A Vahdat… - Proceedings of the …, 2023 - openaccess.thecvf.com
Denoising diffusion models hold great promise for generating diverse and realistic human
motions. However, existing motion diffusion models largely disregard the laws of physics in …

Generating holistic 3d human motion from speech

H Yi, H Liang, Y Liu, Q Cao, Y Wen… - Proceedings of the …, 2023 - openaccess.thecvf.com
This work addresses the problem of generating 3D holistic body motions from human
speech. Given a speech recording, we synthesize sequences of 3D body poses, hand …

Humor: 3d human motion model for robust pose estimation

D Rempe, T Birdal, A Hertzmann… - Proceedings of the …, 2021 - openaccess.thecvf.com
We introduce HuMoR: a 3D Human Motion Model for Robust Estimation of temporal pose
and shape. Though substantial progress has been made in estimating 3D human motion …

Pose-ndf: Modeling human pose manifolds with neural distance fields

G Tiwari, D Antić, JE Lenssen, N Sarafianos… - … on Computer Vision, 2022 - Springer
We present Pose-NDF, a continuous model for plausible human poses based on neural
distance fields (NDFs). Pose or motion priors are important for generating realistic new …

Hierarchical generation of human-object interactions with diffusion probabilistic models

H Pi, S Peng, M Yang, X Zhou… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
This paper presents a novel approach to generating the 3D motion of a human interacting
with a target object, with a focus on solving the challenge of synthesizing long-range and …

Cg-hoi: Contact-guided 3d human-object interaction generation

C Diller, A Dai - Proceedings of the IEEE/CVF Conference …, 2024 - openaccess.thecvf.com
We propose CG-HOI the first method to address the task of generating dynamic 3D human-
object interactions (HOIs) from text. We model the motion of both human and object in an …

Attt2m: Text-driven human motion generation with multi-perspective attention mechanism

C Zhong, L Hu, Z Zhang, S Xia - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Generating 3D human motion based on textual descriptions has been a research focus in
recent years. It requires the generated motion to be diverse, natural, and conform to the …

Glamr: Global occlusion-aware human mesh recovery with dynamic cameras

Y Yuan, U Iqbal, P Molchanov… - Proceedings of the …, 2022 - openaccess.thecvf.com
We present an approach for 3D global human mesh recovery from monocular videos
recorded with dynamic cameras. Our approach is robust to severe and long-term occlusions …