Robots that use language

S Tellex, N Gopalan, H Kress-Gazit… - Annual Review of …, 2020 - annualreviews.org
This article surveys the use of natural language in robotics from a robotics point of view. To
use human language, robots must map words to aspects of the physical world, mediated by …

Human motion generation: A survey

W Zhu, X Ma, D Ro, H Ci, J Zhang, J Shi… - … on Pattern Analysis …, 2023 - ieeexplore.ieee.org
Human motion generation aims to generate natural human pose sequences and shows
immense potential for real-world applications. Substantial progress has been made recently …

Generating human motion from textual descriptions with discrete representations

J Zhang, Y Zhang, X Cun, Y Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this work, we investigate a simple and must-known conditional generative framework
based on Vector Quantised-Variational AutoEncoder (VQ-VAE) and Generative Pre-trained …

Executing your commands via motion diffusion in latent space

X Chen, B Jiang, W Liu, Z Huang… - Proceedings of the …, 2023 - openaccess.thecvf.com
We study a challenging task, conditional human motion generation, which produces
plausible human motion sequences according to various conditional inputs, such as action …

Avatarclip: Zero-shot text-driven generation and animation of 3d avatars

F Hong, M Zhang, L Pan, Z Cai, L Yang… - arXiv preprint arXiv …, 2022 - arxiv.org
3D avatar creation plays a crucial role in the digital age. However, the whole production
process is prohibitively time-consuming and labor-intensive. To democratize this technology …

TEMOS: Generating Diverse Human Motions from Textual Descriptions

M Petrovich, MJ Black, G Varol - European Conference on Computer …, 2022 - Springer
We address the problem of generating diverse 3D human motions from textual descriptions.
This challenging task requires joint modeling of both modalities: understanding and …

Action-conditioned 3d human motion synthesis with transformer vae

M Petrovich, MJ Black, G Varol - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
We tackle the problem of action-conditioned generation of realistic and diverse human
motion sequences. In contrast to methods that complete, or extend, motion sequences, this …

Flame: Free-form language-based motion synthesis & editing

J Kim, J Kim, S Choi - Proceedings of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
Text-based motion generation models are drawing a surge of interest for their potential for
automating the motion-making process in the game, animation, or robot industries. In this …

Motion-x: A large-scale 3d expressive whole-body human motion dataset

J Lin, A Zeng, S Lu, Y Cai, R Zhang… - Advances in Neural …, 2024 - proceedings.neurips.cc
In this paper, we present Motion-X, a large-scale 3D expressive whole-body motion dataset.
Existing motion datasets predominantly contain body-only poses, lacking facial expressions …

Teach: Temporal action composition for 3d humans

N Athanasiou, M Petrovich, MJ Black… - … Conference on 3D …, 2022 - ieeexplore.ieee.org
Given a series of natural language descriptions, our task is to generate 3D human motions
that correspond semantically to the text, and follow the temporal order of the instructions. In …