A systematic review on multimodal emotion recognition: building blocks, current state, applications, and challenges

S Kalateh, LA Estrada-Jimenez, SN Hojjati… - IEEE Access, 2024 - ieeexplore.ieee.org
Emotion recognition involves accurately interpreting human emotions from various sources
and modalities, including questionnaires, verbal, and physiological signals. With its broad …

[HTML][HTML] Emotion fusion for mental illness detection from social media: A survey

T Zhang, K Yang, S Ji, S Ananiadou - Information Fusion, 2023 - Elsevier
Mental illnesses are one of the most prevalent public health problems worldwide, which
negatively influence people's lives and society's health. With the increasing popularity of …

Towards multimodal sentiment analysis debiasing via bias purification

D Yang, M Li, D Xiao, Y Liu, K Yang, Z Chen… - … on Computer Vision, 2025 - Springer
Abstract Multimodal Sentiment Analysis (MSA) aims to understand human intentions by
integrating emotion-related clues from diverse modalities, such as visual, language, and …

Towards robust multimodal sentiment analysis under uncertain signal missing

M Li, D Yang, L Zhang - IEEE Signal Processing Letters, 2023 - ieeexplore.ieee.org
Multimodal Sentiment Analysis (MSA) has attracted widespread research attention recently.
Most MSA studies are based on the assumption of signal completeness. However, many …

Multimodal sensing for depression risk detection: integrating audio, video, and text data

Z Zhang, S Zhang, D Ni, Z Wei, K Yang, S Jin, G Huang… - Sensors, 2024 - mdpi.com
Depression is a major psychological disorder with a growing impact worldwide. Traditional
methods for detecting the risk of depression, predominantly reliant on psychiatric …

General debiasing for multimodal sentiment analysis

T Sun, J Ni, W Wang, L Jing, Y Wei, L Nie - Proceedings of the 31st ACM …, 2023 - dl.acm.org
Existing work on Multimodal Sentiment Analysis (MSA) utilizes multimodal information for
prediction yet unavoidably suffers from fitting the spurious correlations between multimodal …

IIFDD: Intra and inter-modal fusion for depression detection with multi-modal information from Internet of Medical Things

J Chen, Y Hu, Q Lai, W Wang, J Chen, H Liu… - Information …, 2024 - Elsevier
Depression is now a prevalent mental illness and multimodal data-based depression
detection is an essential topic of research. Internet of Medical Things devices can provide …

Coordinated-joint translation fusion framework with sentiment-interactive graph convolutional networks for multimodal sentiment analysis

Q Lu, X Sun, Z Gao, Y Long, J Feng, H Zhang - Information Processing & …, 2024 - Elsevier
Interactive fusion methods have been successfully applied to multimodal sentiment analysis,
due to their ability to achieve data complementarity via interaction of different modalities …

A feature-based restoration dynamic interaction network for multimodal sentiment analysis

Y Zeng, Z Li, Z Chen, H Ma - Engineering Applications of Artificial …, 2024 - Elsevier
Multimodal sentiment analysis aims to infer the sentiment of video bloggers from the features
of multiple input modalities. However, there are problems such as signal noise and signal …

Multimodal mutual attention-based sentiment analysis framework adapted to complicated contexts

L He, Z Wang, L Wang, F Li - … on Circuits and Systems for Video …, 2023 - ieeexplore.ieee.org
Sentiment analysis has broad application prospects in the field of social opinion mining. The
openness and invisibility of the internet makes users' expression styles more diverse and …