Avatarclip: Zero-shot text-driven generation and animation of 3d avatars

F Hong, M Zhang, L Pan, Z Cai, L Yang… - arXiv preprint arXiv …, 2022 - arxiv.org
3D avatar creation plays a crucial role in the digital age. However, the whole production
process is prohibitively time-consuming and labor-intensive. To democratize this technology …

Synthesizing diverse human motions in 3d indoor scenes

K Zhao, Y Zhang, S Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
We present a novel method for populating 3D indoor scenes with virtual humans that can
navigate in the environment and interact with objects in a realistic manner. Existing …

Motiongpt: Finetuned llms are general-purpose motion generators

Y Zhang, D Huang, B Liu, S Tang, Y Lu… - Proceedings of the …, 2024 - ojs.aaai.org
Generating realistic human motion from given action descriptions has experienced
significant advancements because of the emerging requirement of digital humans. While …

Flag: Flow-based 3d avatar generation from sparse observations

S Aliakbarian, P Cameron, F Bogo… - Proceedings of the …, 2022 - openaccess.thecvf.com
To represent people in mixed reality applications for collaboration and communication, we
need to generate realistic and faithful avatar poses. However, the signal streams that can be …

The wanderings of odysseus in 3d scenes

Y Zhang, S Tang - … of the IEEE/CVF Conference on …, 2022 - openaccess.thecvf.com
Our goal is to populate digital environments, in which digital humans have diverse body
shapes, move perpetually, and have plausible body-scene contact. The core challenge is to …

Chalearn LAP challenges on self-reported personality recognition and non-verbal behavior forecasting during social dyadic interactions: Dataset, design, and results

C Palmero, G Barquero, JCSJ Junior… - … Social Behavior in …, 2022 - proceedings.mlr.press
This paper summarizes the 2021 ChaLearn Looking at People Challenge on Understanding
Social Behavior in Dyadic and Small Group Interactions (DYAD), which featured two tracks …

MoCapAct: A multi-task dataset for simulated humanoid control

N Wagener, A Kolobov… - Advances in …, 2022 - proceedings.neurips.cc
Simulated humanoids are an appealing research domain due to their physical capabilities.
Nonetheless, they are also challenging to control, as a policy must drive an unstable …

Multi-scale control signal-aware transformer for motion synthesis without phase

L Wang, K Hu, L Bai, Y Ding, W Ouyang… - Proceedings of the AAAI …, 2023 - ojs.aaai.org
Synthesizing controllable motion for a character using deep learning has been a promising
approach due to its potential to learn a compact model without laborious feature …

[PDF][PDF] Comparison of Spatio-Temporal Models for Human Motion and Pose Forecasting in Face-to-Face Interaction Scenarios Supplementary Material

G Barquero, J Núnez, Z Xu, S Escalera, WW Tu… - 2022 - proceedings.mlr.press
In all architectures tested, a first embedding layer transformed the input coordinates and
offsets from all landmarks into an intermediate representation vector of size 512 by means of …

Learning disentangled representations for controllable human motion prediction

C Gu, J Yu, C Zhang - Pattern Recognition, 2024 - Elsevier
Generative model-based motion prediction techniques have recently realized predicting
controlled human motions, such as predicting multiple upper human body motions with …