Large Language Models Meet Text-Centric Multimodal Sentiment Analysis: A Survey

H Yang, Y Zhao, Y Wu, S Wang, T Zheng… - arXiv preprint arXiv …, 2024 - arxiv.org
Compared to traditional sentiment analysis, which only considers text, multimodal sentiment
analysis needs to consider emotional signals from multimodal sources simultaneously and …

A multitask learning model for multimodal sarcasm, sentiment and emotion recognition in conversations

Y Zhang, J Wang, Y Liu, L Rong, Q Zheng, D Song… - Information …, 2023 - Elsevier
Sarcasm, sentiment and emotion are tightly coupled with each other in that one helps the
understanding of another, which makes the joint recognition of sarcasm, sentiment and …

Multimodal Emotion Recognition with deep learning: advancements, challenges, and future directions

AV Geetha, T Mala, D Priyanka, E Uma - Information Fusion, 2024 - Elsevier
In recent years, affective computing has become a topic of considerable interest, driven by
its ability to enhance several domains, such as mental health monitoring, human–computer …

M3GAT: A multi-modal, multi-task interactive graph attention network for conversational sentiment analysis and emotion recognition

Y Zhang, A Jia, B Wang, P Zhang, D Zhao, P Li… - ACM Transactions on …, 2023 - dl.acm.org
Sentiment and emotion, which correspond to long-term and short-lived human feelings, are
closely linked to each other, leading to the fact that sentiment analysis and emotion …

Towards a holistic landscape of situated theory of mind in large language models

Z Ma, J Sansom, R Peng, J Chai - arXiv preprint arXiv:2310.19619, 2023 - arxiv.org
Large Language Models (LLMs) have generated considerable interest and debate
regarding their potential emergence of Theory of Mind (ToM). Several recent inquiries reveal …

Emollm: Multimodal emotional understanding meets large language models

Q Yang, M Ye, B Du - arXiv preprint arXiv:2406.16442, 2024 - arxiv.org
Multi-modal large language models (MLLMs) have achieved remarkable performance on
objective multimodal perception tasks, but their ability to interpret subjective, emotionally …

Wisdom: Improving multimodal sentiment analysis by fusing contextual world knowledge

W Wang, L Ding, L Shen, Y Luo, H Hu… - Proceedings of the 32nd …, 2024 - dl.acm.org
Multimodal Sentiment Analysis (MSA) focuses on leveraging multimodal signals for
understanding human sentiment. Most of the existing works rely on superficial information …

A review on machine theory of mind

Y Mao, S Liu, Q Ni, X Lin, L He - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Theory of Mind (ToM) is the ability to attribute mental states to others, an important
component of human cognition. At present, there has been growing interest in the artificial …

Moving from narrative to interactive multi-modal sentiment analysis: A survey

J Ma, L Rong, Y Zhang, P Tiwari - ACM Transactions on Asian and Low …, 2023 - dl.acm.org
A growing number of individuals are expressing their opinions and engaging in interactive
communication with others through various modalities, including natural language (text) …

Recent Trends of Multimodal Affective Computing: A Survey from NLP Perspective

G Hu, Y Xin, W Lyu, H Huang, C Sun, Z Zhu… - arXiv preprint arXiv …, 2024 - arxiv.org
Multimodal affective computing (MAC) has garnered increasing attention due to its broad
applications in analyzing human behaviors and intentions, especially in text-dominated …