Gesture and speech in interaction: An overview
Gestures and speech interact. They are linked in language production and perception, with
their interaction contributing to felicitous communication. The multifaceted nature of these …
their interaction contributing to felicitous communication. The multifaceted nature of these …
Generation of nodding, head tilting and eye gazing for human-robot dialogue interaction
C Liu, CT Ishi, H Ishiguro, N Hagita - … of the seventh annual ACM/IEEE …, 2012 - dl.acm.org
Head motion occurs naturally and in synchrony with speech during human dialogue
communication, and may carry paralinguistic information, such as intentions, attitudes and …
communication, and may carry paralinguistic information, such as intentions, attitudes and …
A speech-driven hand gesture generation method and evaluation in android robots
CT Ishi, D Machiyashiki, R Mikata… - IEEE Robotics and …, 2018 - ieeexplore.ieee.org
Hand gestures commonly occur in daily dialogue interactions, and have important functions
in communication. We first analyzed a multimodal human-human dialogue data and found …
in communication. We first analyzed a multimodal human-human dialogue data and found …
Modeling the conditional distribution of co-speech upper body gesture jointly using conditional-GAN and unrolled-GAN
Co-speech gestures are a crucial, non-verbal modality for humans to communicate. Social
agents also need this capability to be more human-like and comprehensive. This study aims …
agents also need this capability to be more human-like and comprehensive. This study aims …
Analysis of relationship between head motion events and speech in dialogue conversations
CT Ishi, H Ishiguro, N Hagita - Speech Communication, 2014 - Elsevier
Head motion naturally occurs in synchrony with speech and may convey paralinguistic
information (such as intentions, attitudes and emotions) in dialogue communication. With the …
information (such as intentions, attitudes and emotions) in dialogue communication. With the …
Analysis of head gesture and prosody patterns for prosody-driven head-gesture animation
We propose a new two-stage framework for joint analysis of head gesture and speech
prosody patterns of a speaker towards automatic realistic synthesis of head gestures from …
prosody patterns of a speaker towards automatic realistic synthesis of head gestures from …
Head motion during dialogue speech and nod timing control in humanoid robots
CT Ishi, CR Liu, H Ishiguro… - 2010 5th ACM/IEEE …, 2010 - ieeexplore.ieee.org
Head motion naturally occurs in synchrony with speech and may carry paralinguistic
information, such as intention, attitude and emotion, in dialogue communication. With the …
information, such as intention, attitude and emotion, in dialogue communication. With the …
Bidirectional LSTM networks employing stacked bottleneck features for expressive speech-driven head motion synthesis
K Haag, H Shimodaira - … Virtual Agents: 16th International Conference, IVA …, 2016 - Springer
Previous work in speech-driven head motion synthesis is centred around Hidden Markov
Model (HMM) based methods and data that does not show a large variability of …
Model (HMM) based methods and data that does not show a large variability of …
Generation of nodding, head tilting and gazing for human–robot speech interaction
C Liu, CT Ishi, H Ishiguro, N Hagita - International Journal of …, 2013 - World Scientific
Head motion occurs naturally and in synchrony with speech during human dialogue
communication, and may carry paralinguistic information, such as intentions, attitudes and …
communication, and may carry paralinguistic information, such as intentions, attitudes and …
Towards automatic recognition of sign language gestures using kinect 2.0
We present a prototype of a new computer system aimed at recognition of manual gestures
using Kinect 2.0 for Windows. This sensor allows getting a stream of optical images having …
using Kinect 2.0 for Windows. This sensor allows getting a stream of optical images having …