Multimodal classification: Current landscape, taxonomy and future directions
Multimodal classification research has been gaining popularity with new datasets in
domains such as satellite imagery, biometrics, and medicine. Prior research has shown the …
domains such as satellite imagery, biometrics, and medicine. Prior research has shown the …
What all do audio transformer models hear? probing acoustic representations for language delivery and its structure
In recent times, BERT based transformer models have become an inseparable part of
the'tech stack'of text processing models. Similar progress is being observed in the speech …
the'tech stack'of text processing models. Similar progress is being observed in the speech …
What do audio transformers hear? probing their representations for language delivery & structure
Transformer models across multiple domains such as natural language processing and
speech form an unavoidable part of the tech stack of practitioners and researchers alike. Au …
speech form an unavoidable part of the tech stack of practitioners and researchers alike. Au …
Discover: Disentangled music representation learning for cover song identification
In the field of music information retrieval (MIR), cover song identification (CSI) is a
challenging task that aims to identify cover versions of a query song from a massive …
challenging task that aims to identify cover versions of a query song from a massive …
Virtual Instrument Performances (VIP): A Comprehensive Review
T Kyriakou, MÁ de la Campa Crespo… - Computer Graphics …, 2024 - Wiley Online Library
Driven by recent advancements in Extended Reality (XR), the hype around the Metaverse,
and real‐time computer graphics, the transformation of the performing arts, particularly in …
and real‐time computer graphics, the transformation of the performing arts, particularly in …
[HTML][HTML] Late multimodal fusion for image and audio music transcription
Music transcription, which deals with the conversion of music sources into a structured
digital format, is a key problem for Music Information Retrieval (MIR). When addressing this …
digital format, is a key problem for Music Information Retrieval (MIR). When addressing this …
Multimodal music datasets? Challenges and future goals in music processing
The term “multimodal music dataset” is often used to describe music-related datasets that
represent music as a multimedia art form and multimodal experience. However, the term …
represent music as a multimedia art form and multimodal experience. However, the term …
Multimodal representation learning over heterogeneous networks for tag-based music retrieval
Learning how to represent data represented by features obtained from multiple modalities
through representation learning strategies has received much attention in Music Information …
through representation learning strategies has received much attention in Music Information …
A computational lens into how music characterizes genre in film
Film music varies tremendously across genre in order to bring about different responses in
an audience. For instance, composers may evoke passion in a romantic scene with lush …
an audience. For instance, composers may evoke passion in a romantic scene with lush …
Ccom-huqin: An annotated multimodal chinese fiddle performance dataset
HuQin is a family of traditional Chinese bowed string instruments. Playing techniques (PTs)
embodied in various playing styles add abundant emotional coloring and aesthetic feelings …
embodied in various playing styles add abundant emotional coloring and aesthetic feelings …