Semi-supervised multi-modal emotion recognition with cross-modal distribution matching

J Liang, R Li, Q Jin - Proceedings of the 28th ACM international …, 2020 - dl.acm.org
Automatic emotion recognition is an active research topic with wide range of applications.
Due to the high manual annotation cost and inevitable label ambiguity, the development of …

Multimodal emotion recognition with modality-pairwise unsupervised contrastive loss

R Franceschini, E Fini, C Beyan, A Conti… - 2022 26th …, 2022 - ieeexplore.ieee.org
Emotion recognition is involved in several real-world applications. With an increase in
available modalities, automatic understanding of emotions is being performed more …

Memobert: Pre-training model with prompt-based learning for multimodal emotion recognition

J Zhao, R Li, Q Jin, X Wang, H Li - ICASSP 2022-2022 IEEE …, 2022 - ieeexplore.ieee.org
Multimodal emotion recognition study is hindered by the lack of labelled corpora in terms of
scale and diversity, due to the high annotation cost and label ambiguity. In this paper, we …

Modality-transferable emotion embeddings for low-resource multimodal emotion recognition

W Dai, Z Liu, T Yu, P Fung - arXiv preprint arXiv:2009.09629, 2020 - arxiv.org
Despite the recent achievements made in the multi-modal emotion recognition task, two
problems still exist and have not been well investigated: 1) the relationship between different …

Multimodal emotion recognition with transformer-based self supervised feature fusion

S Siriwardhana, T Kaluarachchi, M Billinghurst… - Ieee …, 2020 - ieeexplore.ieee.org
Emotion Recognition is a challenging research area given its complex nature, and humans
express emotional cues across various modalities such as language, facial expressions …

Multi-modal emotion recognition with self-guided modality calibration

M Hou, Z Zhang, G Lu - ICASSP 2022-2022 IEEE International …, 2022 - ieeexplore.ieee.org
Multi-modal emotion recognition aims to extract sentiment-related information from multiple
sources and integrate different modal representations for sentiment analysis. Alignment is …

Disentangled representation learning for multimodal emotion recognition

D Yang, S Huang, H Kuang, Y Du… - Proceedings of the 30th …, 2022 - dl.acm.org
Multimodal emotion recognition aims to identify human emotions from text, audio, and visual
modalities. Previous methods either explore correlations between different modalities or …

Layer-wise fusion with modality independence modeling for multi-modal emotion recognition

J Sun, S Han, YP Ruan, X Zhang… - Proceedings of the …, 2023 - aclanthology.org
Multi-modal emotion recognition has gained increasing attention in recent years due to its
widespread applications and the advances in multi-modal learning approaches. However …

EmoBed: Strengthening monomodal emotion recognition via training with crossmodal emotion embeddings

J Han, Z Zhang, Z Ren… - IEEE Transactions on …, 2019 - ieeexplore.ieee.org
Despite remarkable advances in emotion recognition, they are severely restrained from
either the essentially limited property of the employed single modality, or the synchronous …

Learning supervised scoring ensemble for emotion recognition in the wild

P Hu, D Cai, S Wang, A Yao, Y Chen - Proceedings of the 19th ACM …, 2017 - dl.acm.org
State-of-the-art approaches for the previous emotion recognition in the wild challenges are
usually built on prevailing Convolutional Neural Networks (CNNs). Although there is clear …