The Cyborg Philharmonic: Synchronizing interactive musical performances between humans and machines

S Chakraborty, S Dutta, J Timoney - Humanities and Social Sciences …, 2021 - nature.com
Music offers a uniquely abstract way for the expression of human emotions and moods,
wherein melodic harmony is achieved through a succinct blend of pitch, rhythm, tempo …

[PDF][PDF] Real-time audio-to-score alignment using particle filter for coplayer music robots

T Otsuka, K Nakadai, T Takahashi, T Ogata… - EURASIP Journal on …, 2011 - Springer
Our goal is to develop a coplayer music robot capable of presenting a musical expression
together with humans. Although many instrument-performing robots exist, they may have …

Incremental polyphonic audio to score alignment using beat tracking for singer robots

T Otsuka, T Takahashi, HG Okuno… - 2009 IEEE/RSJ …, 2009 - ieeexplore.ieee.org
We aim at developing a singer robot capable of listening to music with its own¿ ears¿ and
interacting with a human's musical performance. Such a singer robot requires at least three …

Semi-blind suppression of internal noise for hands-free robot spoken dialog system

J Even, H Sawada, H Saruwatari… - 2009 IEEE/RSJ …, 2009 - ieeexplore.ieee.org
The speech enhancement architecture presented in this paper is specifically developed for
hands-free robot spoken dialog systems. It is designed to take advantage of additional …

[PDF][PDF] Enabling a user to specify an item at any time during system enumeration-item identification for barge-in-able conversational dialogue systems

K Matsuyama, K Komatani, T Ogata… - … Annual Conference of …, 2009 - researchgate.net
In conversational dialogue systems, users prefer to speak at any time and to use natural
expressions. We have developed an Independent Component Analysis (ICA) based semi …

Music-ensemble robot that is capable of playing the theremin while listening to the accompanied music

T Otsuka, T Mizumoto, K Nakadai, T Takahashi… - Trends in Applied …, 2010 - Springer
Our goal is to achieve a musical ensemble among a robot and human musicians where the
robot listens to the music with its own microphones. The main issues are (1) robust beat …

Design and implementation of two-level synchronization for interactive music robot

T Otsuka, K Nakadai, T Takahashi… - Proceedings of the …, 2010 - ojs.aaai.org
Our goal is to develop an interactive music robot, ie, a robot that presents a musical
expression together with humans. A music interaction requires two important functions …

Teaching a humanoid robot: Headset-free speech interaction for audio-visual association learning

M Heckmann, H Brandl… - RO-MAN 2009-The …, 2009 - ieeexplore.ieee.org
Based on inspirations from infant development we present a system which learns
associations between acoustic labels and visual representations in interaction with its tutor …

Semi-Blind speech enhancement basedon recurrent neural network for source separation and dereverberation

M Wake, Y Bando, M Mimura, K Itoyama… - 2017 IEEE 27th …, 2017 - ieeexplore.ieee.org
This paper describes a semi-blind speech enhancement method using a semi-blind
recurrent neural network (SB-RNN) for human-robot speech interaction. When a robot …

[PDF][PDF] Analyzing user utterances in barge-in-able spoken dialogue system for improving identification accuracy

K Matsuyama, K Komatani, R Takeda… - … Conference of the …, 2010 - winnie.kuis.kyoto-u.ac.jp
In our barge-in-able spoken dialogue system, the user's behaviors such as barge-in timing
and utterance expressions vary according to his/her characteristics and situations. The …