Multimodal conversational interaction with a humanoid robot

A Csapo, E Gilmartin, J Grizou, JG Han… - 2012 IEEE 3rd …, 2012 - ieeexplore.ieee.org
The paper presents a multimodal conversational interaction system for the Nao humanoid
robot. The system was developed at the 8th International Summer Workshop on Multimodal …

Nonverbal communication with a humanoid robot via head gestures

S Saleh, K Berns - Proceedings of the 8th ACM International Conference …, 2015 - dl.acm.org
Social interactive robots require sophisticated perception and cognition abilities to behave
and interact in a natural human-like way. The proper perception of behavior of interaction …

Mutual assistance between speech and vision for human-robot interaction

B Burger, F Lerasle, I Ferrané… - 2008 IEEE/RSJ …, 2008 - ieeexplore.ieee.org
Among the cognitive abilities a robot companion must be endowed with, human perception
and speech understanding are both fundamental in the context of multimodal human-robot …

Recognizing engagement in human-robot interaction

C Rich, B Ponsler, A Holroyd… - 2010 5th ACM/IEEE …, 2010 - ieeexplore.ieee.org
Based on a study of the engagement process between humans, we have developed and
implemented an initial computational model for recognizing engagement between a human …

Generating co-speech gestures for the humanoid robot NAO through BML

QA Le, C Pelachaud - Gesture and Sign Language in Human-Computer …, 2012 - Springer
We extend and develop an existing virtual agent system to generate communicative
gestures for different embodiments (ie virtual or physical agents). This paper presents our …

Improving user interfaces of interactive robots with multimodality

M Vallee, B Burger, D Ertl, F Lerasle… - … on Advanced Robotics, 2009 - ieeexplore.ieee.org
Interacting with robots like service robots should be as natural as possible for humans. As a
consequence, such robots should be equipped with a multimodal user interface, so that …

Multimodal adapted robot behavior synthesis within a narrative human-robot interaction

A Aly, A Tapus - 2015 IEEE/RSJ International Conference on …, 2015 - ieeexplore.ieee.org
In human-human interaction, three modalities of communication (ie, verbal, nonverbal, and
paraverbal) are naturally coordinated so as to enhance the meaning of the conveyed …

Part-of-speech and prosody-based approaches for robot speech and gesture synchronization

L Pérez-Mayos, M Farrús, J Adell - Journal of Intelligent & Robotic Systems, 2020 - Springer
Humanoid robots are already among us and they are beginning to assume more social and
personal roles, like guiding and assisting people. Thus, they should interact in a human …

Nonverbal signaling for non-humanoid robots during human-robot collaboration

E Cha, M Matarić, T Fong - 2016 11th ACM/IEEE International …, 2016 - ieeexplore.ieee.org
Non-humanoid robots are becoming increasingly utilized for collaborative tasks across
many domains, including industrial and service settings. Collaborative tasks between the …

[PDF][PDF] A multimodal scheduler for synchronized humanoid robot gesture and speech

M Salem, S Kopp, I Wachsmuth… - Book of Extended …, 2011 - academia.edu
In order to engage in natural and fluent human-robot interaction, humanoid robot
companions must be able to produce speech-accompanying non-verbal behavior including …