Multimodal Emotion Recognition with deep learning: advancements, challenges, and future directions

AV Geetha, T Mala, D Priyanka, E Uma - Information Fusion, 2024 - Elsevier
In recent years, affective computing has become a topic of considerable interest, driven by
its ability to enhance several domains, such as mental health monitoring, human–computer …

Capsule network-based deep ensemble transfer learning for multimodal sentiment analysis

A Ghorbanali, MK Sohrabi - Expert Systems with Applications, 2024 - Elsevier
Understanding the attitudes of users about different topics through their huge amount of
comments and opinions on social networks is an emerging hot issue. Analyzing the …

MMFN: Emotion recognition by fusing touch gesture and facial expression information

YK Li, QH Meng, YX Wang, HR Hou - Expert Systems with Applications, 2023 - Elsevier
Human social interaction is a multimodal process that integrates several communication
channels, such as speech, facial expressions, body gestures, and touch. For intelligent …

Enhancing Multimodal Emotion Recognition through Attention Mechanisms in BERT and CNN Architectures

F Makhmudov, A Kultimuratov, YI Cho - Applied Sciences, 2024 - mdpi.com
Emotion detection holds significant importance in facilitating human–computer interaction,
enhancing the depth of engagement. By integrating this capability, we pave the way for …

FMFN: A Fuzzy Multimodal Fusion Network for Emotion Recognition in Ensemble Conducting

X Han, F Chen, J Ban - IEEE Transactions on Fuzzy Systems, 2024 - ieeexplore.ieee.org
Conducting and interacting with an orchestra is a multimodal process that integrates
channels such as music, visual cues, posture, and gestures to convey artistic intent …

双模态双向感知下语义信息增强的多模态情感分析.

曲海成, 徐波 - Journal of Computer Engineering & …, 2024 - search.ebscohost.com
针对不同模态间存在情感信息分布不均匀, 难以获得更深层次的多模态情感语义信息问题,
提出了一种双模态双向感知下语义信息增强的多模态情感分析方法. 对文本-视觉模态, 文本 …

An intelligent support system and emotional state tests for people who are sick or recovering

M Maj, M Kowalski, M Gnat, J Łukasiewicz… - Journal of Modern …, 2024 - jomswsge.com
The project aims to develop an intelligent system that has the potential to significantly
improve patient care by examining and supporting the emotional state of people with chronic …

Multimodal Emotion Recognition with Deep Learning:: Advancements, challenges, and future directions

G AV, UE - 2024 - dl.acm.org
In recent years, affective computing has become a topic of considerable interest, driven by
its ability to enhance several domains, such as mental health monitoring, human–computer …

Utilizing Quantum Particle Swarm Optimization for Multimodal Fusion of Gestures and Facial Expressions in Ensemble Conducting for Emotional Recognition

X Han, F Chen, J Ban - Summit on Music Intelligence, 2023 - Springer
The conductor-orchestra interaction is a multimodal process, integrating channels like
music, visual cues, postures, and gestures to convey artistic intent accurately. For robots …

Multimodal sentiment analysis based on feature interaction and gate mechanism integration

Y Zhao, G Zhang, H Odbal - Fourth International Conference …, 2024 - spiedigitallibrary.org
Solely relying on textual data for sentiment analysis often fails to fully capture users'
emotional information, limiting the accurate understanding of audience true feelings and …