Interactive machine learning of musical gesture

FG Visi, A Tanaka - Handbook of artificial intelligence for music …, 2021 - Springer
This chapter presents an overview of Interactive Machine Learning (IML) techniques applied
to the analysis and design of musical gestures. We go through the main challenges and …

Form follows sound: designing interactions from sonic memories

B Caramiaux, A Altavilla, SG Pobiner… - Proceedings of the 33rd …, 2015 - dl.acm.org
Sonic interaction is the continuous relationship between user actions and sound, mediated
by some technology. Because interaction with sound may be task oriented or experience …

Principles for Designing Body‐Centered Auditory Feedback

A Tajadura‐Jiménez, A Väljamäe… - The Wiley handbook …, 2018 - Wiley Online Library
Our body can be seen as an anchor that tightly connects us with the surrounding physical
world. Concepts of body‐centred interaction have been successfully applied in virtual and …

[PDF][PDF] Tangible Scores: Shaping the Inherent Instrument Score.

E Tomás, M Kaltenbrunner - NIME, 2014 - academia.edu
Tangible Scores are a new paradigm for musical instrument design with a physical
configuration inspired by graphic scores. In this paper we will focus on the design aspects of …

[HTML][HTML] From the body image to the body schema, from the proximal to the distal: Embodied musical activity toward learning instrumental musical skills

JH Kim - Frontiers in Psychology, 2020 - frontiersin.org
A recent paradigm shift in music research has allowed scholars to examine the macro-and
micro-processes taking place within musical performance and underlying cognitive …

Designing gestures for continuous sonic interaction

A Tanaka, B Di Donato, M Zbyszynski, G Roks - 2019 - figshare.le.ac.uk
We present a system that allows users to try different ways to train neural networks and
temporal modelling to asso-ciate gestures with time-varying sound. We created a soft-ware …

An end-to-end musical instrument system that translates electromyogram biosignals to synthesized sound

A Tanaka, F Visi, BD Donato, M Klang… - Computer Music …, 2023 - direct.mit.edu
This article presents a custom system combining hardware and software that senses
physiological signals of the performer's body resulting from muscle contraction and …

The voice delivers the threats, Foley delivers the punch: Embodied knowledge in Foley artistry

S Pauletto - The Routledge Companion to Screen Music and …, 2017 - taylorfrancis.com
This chapter highlights the special nature of Foley sounds, both in terms of their aesthetic
possibilities and their creation by expert performers in the production process. It argues that …

'listening back': Exploring the sonic interactions at the heart of historical sound effects performance

F Keenan, S Pauletto - The New Soundtrack, 2017 - euppublishing.com
The cinematic sound design practice of Foley developed from a rich history of performative
sound design through materials, objects and mechanical devices created for theatrical …

[PDF][PDF] Towards assisted interactive machine learning: exploring gesture-sound mappings using reinforcement learning

FG Visi, A Tanaka - ICLI 2020—the fifth international conference …, 2020 - federicovisi.com
We present a sonic interaction design approach that makes use of deep reinforcement
learning to explore many mapping possibilities between input sensor data streams and …