A review of evaluation practices of gesture generation in embodied conversational agents

P Wolfert, N Robinson… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Embodied conversational agents (ECAs) are often designed to produce nonverbal behavior
to complement or enhance their verbal communication. One such form of the nonverbal …

Learning hierarchical cross-modal association for co-speech gesture generation

X Liu, Q Wu, H Zhou, Y Xu, R Qian… - Proceedings of the …, 2022 - openaccess.thecvf.com
Generating speech-consistent body and gesture movements is a long-standing problem in
virtual avatar creation. Previous studies often synthesize pose movement in a holistic …

How robots influence humans: A survey of nonverbal communication in social human–robot interaction

S Saunderson, G Nejat - International Journal of Social Robotics, 2019 - Springer
As robots become more prevalent in society, investigating the interactions between humans
and robots is important to ensure that these robots adhere to the social norms and …

The GENEA Challenge 2022: A large evaluation of data-driven co-speech gesture generation

Y Yoon, P Wolfert, T Kucherenko, C Viegas… - Proceedings of the …, 2022 - dl.acm.org
This paper reports on the second GENEA Challenge to benchmark data-driven automatic co-
speech gesture generation. Participating teams used the same speech and motion dataset …

A large, crowdsourced evaluation of gesture generation systems on common data: The GENEA Challenge 2020

T Kucherenko, P Jonell, Y Yoon, P Wolfert… - Proceedings of the 26th …, 2021 - dl.acm.org
Co-speech gestures, gestures that accompany speech, play an important role in human
communication. Automatic co-speech gesture generation is thus a key enabling technology …

[HTML][HTML] Multimodal integration of emotional signals from voice, body, and context: Effects of (in) congruence on emotion recognition and attitudes towards robots

C Tsiourti, A Weiss, K Wac, M Vincze - International Journal of Social …, 2019 - Springer
Humanoid social robots have an increasingly prominent place in today's world. Their
acceptance in social and emotional human–robot interaction (HRI) scenarios depends on …

Investigating the use of recurrent motion modelling for speech gesture generation

Y Ferstl, R McDonnell - … of the 18th International Conference on …, 2018 - dl.acm.org
The growing use of virtual humans demands generating increasingly realistic behavior for
them while minimizing cost and time. Gestures are a key ingredient for realistic and …

The design and observed effects of robot-performed manual gestures: A systematic review

J De Wit, P Vogt, E Krahmer - ACM Transactions on Human-Robot …, 2023 - dl.acm.org
Communication using manual (hand) gestures is considered a defining property of social
robots, and their physical embodiment and presence, therefore, we see a need for a …

Gesticulator: A framework for semantically-aware speech-driven gesture generation

T Kucherenko, P Jonell, S Van Waveren… - Proceedings of the …, 2020 - dl.acm.org
During speech, people spontaneously gesticulate, which plays a key role in conveying
information. Similarly, realistic co-speech gestures are crucial to enable natural and smooth …

Nonverbal cues in human–robot interaction: A communication studies perspective

J Urakami, K Seaborn - ACM Transactions on Human-Robot Interaction, 2023 - dl.acm.org
Communication between people is characterized by a broad range of nonverbal cues.
Transferring these cues into the design of robots and other artificial agents that interact with …