Recent advances in artificial general intelligence (AGI), particularly large language models
and creative image generation systems have demonstrated impressive capabilities on …

We study cross-modal recommendation of musictracks to be used as soundtracks for videos.
This problem is known as the music supervision task. We build on a self-supervised system …

In this paper, we present a new dataset of music performance videos which can be used for
training machine learning methods for multiple tasks such as audio-visual blind source …

Separating a song into vocal and accompaniment components is an active research topic,
and recent years witnessed an increased performance from supervised training using deep …

Music enhances moving images and allows to efficiently communicate emotion or narrative
tension, thanks to cultural codes common to the filmmakers and viewers. A successful …

This paper presents a method for enhancing music audio onset detection in the context of
live music performance recordings. As a structural element of our method we utilize a …

When we talk about music, we tend to view it as an art of sound. However, it is much broader
than that. We watch music performances, read musical scores, and memorize lyrics of …

Interactive Music Systems Page 1 Interactive Music Systems Zhiyao Duan Associate
Professor of ECE and CS University of Rochester Presentation at WiSSAP 2023, IIT Kanpur …

In this work, we employ deep learning methods for visual onset detection. We focus on live
music performances involving bowed string instruments. In this context, we take as a source …