Interactive conversational head generation

M Zhou, Y Bai, W Zhang, T Yao, T Zhao - arXiv preprint arXiv:2307.02090, 2023 - arxiv.org
… new conversation head generation benchmark for synthesizing behaviors of a single interlocutor
in a face-to-face conversation… focuses on talking head generation (one-way interaction), …

Human-computer interaction system: A survey of talking-head generation

R Zhen, W Song, Q He, J Cao, L Shi, J Luo - Electronics, 2023 - mdpi.com
… -head generation, body movements, and human movements. Meanwhile, in the talking-head
generation task, … In the research of talking-head generation, audio-driven lip synthesis is a …

Learning and Evaluating Human Preferences for Conversational Head Generation

M Zhou, Y Bai, W Zhang, T Yao, T Zhao… - Proceedings of the 31st …, 2023 - dl.acm.org
… data for conversational head generation, we utilize the … head video generation conditioned
on the identity and audio signals of the speaker, Responsive listening head video generation

Towards Realistic Conversational Head Generation: A Comprehensive Framework for Lifelike Video Synthesis

M Liu, Y Li, S Zhai, W Guan, L Nie - Proceedings of the 31st ACM …, 2023 - dl.acm.org
… expressions and head poses needed for realistic video generation. In … first place in the talking
head generation track of the challenge and … in the field of conversational head generation. …

A Baseline for ViCo Conversational Head Generation Challenge

M Liu, S Zhai, Y Li, W Guan, L Nie - Proceedings of the 30th ACM …, 2022 - dl.acm.org
… talking head videos with natural head poses, which wins 3rd place and People’s Selection
Award. On the listening head generation track, we adopt MakeItTalk to generate vivid head

Emotional Conversation: Empowering Talking Faces with Cohesive Expression, Gaze and Pose Generation

J Liang, F Lu - arXiv preprint arXiv:2406.07895, 2024 - arxiv.org
… Unfortunately, in SPACE, the control and generation of gaze and head pose sequences
are unrelated to emotion. Although the generated faces display high visual quality, the final …

Perceptual conversational head generation with regularized driver and enhanced renderer

A Huang, Z Huang, S Zhou - Proceedings of the 30th ACM international …, 2022 - dl.acm.org
… -computer interaction and animation production. Generating conversational head videos
is challenging because it involves not only the processing of serialized speech signals but …

Responsive listening head generation: a benchmark dataset and baseline

M Zhou, Y Bai, W Zhang, T Yao, T Zhao… - European Conference on …, 2022 - Springer
… listening head generation during a face-to-face conversation. A … or talking-head generation,
listening head generation takes as … To highlight the properties of the interactive digital human …

Dialoguenerf: Towards realistic avatar face-to-face conversation video generation

Y Yan, Z Zhou, Z Wang, J Gao, X Yang - Visual Intelligence, 2024 - Springer
… -to-face human interaction found that conversational partners … similar behaviors throughout
a conversation. Therefore, the … In the taking head generation scenario, we employ multiple …

Animated conversation: rule-based generation of facial expression, gesture & spoken intonation for multiple conversational agents

J Cassell, C Pelachaud, N Badler… - … graphics and interactive …, 1994 - dl.acm.org
conversational participant, via gaze or head movement, for example, affects the behavior of
the other. A conversation … One person punctuates and reinforces her speech by head nods, …