Embracing first-person perspectives in soma-based design
A set of prominent designers embarked on a research journey to explore aesthetics in
movement-based design. Here we unpack one of the design sensitivities unique to our …
movement-based design. Here we unpack one of the design sensitivities unique to our …
The machine learning algorithm as creative musical tool
R Fiebrink, B Caramiaux - arXiv preprint arXiv:1611.00379, 2016 - arxiv.org
Machine learning is the capacity of a computational system to learn structures from datasets
in order to make predictions on newly seen data. Such an approach offers a significant …
in order to make predictions on newly seen data. Such an approach offers a significant …
Sensori-motor learning with movement sonification: perspectives from recent interdisciplinary studies
This article reports on an interdisciplinary research project on movement sonification for
sensori-motor learning. First, we describe different research fields which have contributed to …
sensori-motor learning. First, we describe different research fields which have contributed to …
Artificial intelligence in music and performance: a subjective art-research inquiry
B Caramiaux, M Donnarumma - Handbook of Artificial Intelligence for …, 2021 - Springer
In many contemporary societies, the pervasiveness of technology is constantly expanding.
From communication to social networks, digital health and welfare services, every aspect of …
From communication to social networks, digital health and welfare services, every aspect of …
Motion-sound mapping through interaction: An approach to user-centered design of auditory feedback using machine learning
J Françoise, F Bevilacqua - ACM Transactions on Interactive Intelligent …, 2018 - dl.acm.org
Technologies for sensing movement are expanding toward everyday use in virtual reality,
gaming, and artistic practices. In this context, there is a need for methodologies to help …
gaming, and artistic practices. In this context, there is a need for methodologies to help …
Embodied sound design
Embodied sound design is a process of sound creation that involves the designer's vocal
apparatus and gestures. The possibilities of vocal sketching were investigated by means of …
apparatus and gestures. The possibilities of vocal sketching were investigated by means of …
Enhancing multimodal learning through personalized gesture recognition
Gestural recognition systems are important tools for leveraging movement‐based
interactions in multimodal learning environments but personalizing these interactions has …
interactions in multimodal learning environments but personalizing these interactions has …
Effort inference and prediction by acoustic and movement descriptors in interactions with imaginary objects during Dhrupad vocal improvisation
S Paschalidou - Wearable Technologies, 2022 - cambridge.org
In electronic musical instruments (EMIs), the concept of “sound sculpting” was proposed by
Mulder, in which imaginary objects are manually sculpted to produce sounds, although …
Mulder, in which imaginary objects are manually sculpted to produce sounds, although …
Exploring relationships between effort, motion, and sound in new musical instruments
C Erdem, Q Lan, AR Jensenius - Human Technology, 2020 - duo.uio.no
We investigated how the action–sound relationships found in electric guitar performance
can be used in the design of new instruments. Thirty-one trained guitarists performed a set of …
can be used in the design of new instruments. Thirty-one trained guitarists performed a set of …
Gesture-timbre space: Multidimensional feature mapping using machine learning and concatenative synthesis
This chapter explores three systems for mapping embodied gesture, acquired with
electromyography and motion sensing, to sound synthesis. A pilot study using granular …
electromyography and motion sensing, to sound synthesis. A pilot study using granular …