Speech gesture generation from the trimodal context of text, audio, and speaker identity

Y Yoon, B Cha, JH Lee, M Jang, J Lee, J Kim… - ACM Transactions on …, 2020 - dl.acm.org
For human-like agents, including virtual avatars and social robots, making proper gestures
while speaking is crucial in human-agent interaction. Co-speech gestures enhance …

Speech-based gesture generation for robots and embodied agents: A scoping review

Y Liu, G Mohammadi, Y Song, W Johal - Proceedings of the 9th …, 2021 - dl.acm.org
Humans use gestures as a means of non-verbal communication. Often accompanying
speech, these gestures have several purposes but in general, aim to convey an intended …

The design and observed effects of robot-performed manual gestures: A systematic review

J De Wit, P Vogt, E Krahmer - ACM Transactions on Human-Robot …, 2023 - dl.acm.org
Communication using manual (hand) gestures is considered a defining property of social
robots, and their physical embodiment and presence, therefore, we see a need for a …

[PDF][PDF] Modeling and Evaluating Narrative Gestures for Humanlike Robots.

CM Huang, B Mutlu - Robotics: Science and Systems, 2013 - Citeseer
Gestures support and enrich speech across various forms of communication. Effective use of
gestures by speakers improves not only the listeners' comprehension of the spoken material …

Audio-driven stylized gesture generation with flow-based model

S Ye, YH Wen, Y Sun, Y He, Z Zhang, Y Wang… - … on Computer Vision, 2022 - Springer
Generating stylized audio-driven gestures for robots and virtual avatars has attracted
increasing considerations recently. Existing methods require style labels (eg speaker …

Robot nonverbal behavior improves task performance in difficult collaborations

H Admoni, T Weng, B Hayes… - 2016 11th ACM/IEEE …, 2016 - ieeexplore.ieee.org
Nonverbal behaviors increase task efficiency and improve collaboration between people
and robots. In this paper, we introduce a model for generating nonverbal behavior and …

Varied human-like gestures for social robots: Investigating the effects on children's engagement and language learning

J de Wit, A Brandse, E Krahmer, P Vogt - Proceedings of the 2020 ACM …, 2020 - dl.acm.org
To investigate whether a humanoid robot's use of gestures improves children's learning of
second language vocabulary, and if variation in gestures strengthens this effect, we …

Sgtoolkit: An interactive gesture authoring toolkit for embodied conversational agents

Y Yoon, K Park, M Jang, J Kim, G Lee - The 34th annual ACM …, 2021 - dl.acm.org
Non-verbal behavior is essential for embodied agents like social robots, virtual avatars, and
digital humans. Existing behavior authoring approaches including keyframe animation and …

[HTML][HTML] Iconic gestures for robot avatars, recognition and integration with speech

P Bremner, U Leonards - Frontiers in psychology, 2016 - frontiersin.org
Co-verbal gestures are an important part of human communication, improving its efficiency
and efficacy for information conveyance. One possible means by which such multi-modal …

Generation of virtual digital human for customer service industry

Y Sun, Z Sun, YH Wen, S Ye, T Lv, M Yu, R Yi… - Computers & …, 2023 - Elsevier
With the widespread development of digital technology, individuals' daily activities are
inseparable from interaction with electronic devices. Researchers have become interested …