Multimodal sentiment analysis: A systematic review of history, datasets, multimodal fusion methods, applications, challenges and future directions

A Gandhi, K Adhvaryu, S Poria, E Cambria, A Hussain - Information Fusion, 2023 - Elsevier
Sentiment analysis (SA) has gained much traction In the field of artificial intelligence (AI) and
natural language processing (NLP). There is growing demand to automate analysis of user …

Harnessing multimodal data integration to advance precision oncology

KM Boehm, P Khosravi, R Vanguri, J Gao… - Nature Reviews …, 2022 - nature.com
Advances in quantitative biomarker development have accelerated new forms of data-driven
insights for patients with cancer. However, most approaches are limited to a single mode of …

Multimodal sentiment analysis based on fusion methods: A survey

L Zhu, Z Zhu, C Zhang, Y Xu, X Kong - Information Fusion, 2023 - Elsevier
Sentiment analysis is an emerging technology that aims to explore people's attitudes toward
an entity. It can be applied in a variety of different fields and scenarios, such as product …

Foundations & trends in multimodal machine learning: Principles, challenges, and open questions

PP Liang, A Zadeh, LP Morency - ACM Computing Surveys, 2024 - dl.acm.org
Multimodal machine learning is a vibrant multi-disciplinary research field that aims to design
computer agents with intelligent capabilities such as understanding, reasoning, and learning …

Learning modality-specific representations with self-supervised multi-task learning for multimodal sentiment analysis

W Yu, H Xu, Z Yuan, J Wu - Proceedings of the AAAI conference on …, 2021 - ojs.aaai.org
Abstract Representation Learning is a significant and challenging task in multimodal
learning. Effective modality representations should contain two parts of characteristics: the …

Decoupled multimodal distilling for emotion recognition

Y Li, Y Wang, Z Cui - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Human multimodal emotion recognition (MER) aims to perceive human emotions via
language, visual and acoustic modalities. Despite the impressive performance of previous …

Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions

PP Liang, A Zadeh, LP Morency - arXiv preprint arXiv:2209.03430, 2022 - arxiv.org
Multimodal machine learning is a vibrant multi-disciplinary research field that aims to design
computer agents with intelligent capabilities such as understanding, reasoning, and learning …

Misa: Modality-invariant and-specific representations for multimodal sentiment analysis

D Hazarika, R Zimmermann, S Poria - Proceedings of the 28th ACM …, 2020 - dl.acm.org
Multimodal Sentiment Analysis is an active area of research that leverages multimodal
signals for affective understanding of user-generated videos. The predominant approach …

State of the art: a review of sentiment analysis based on sequential transfer learning

JYL Chan, KT Bea, SMH Leow, SW Phoong… - Artificial Intelligence …, 2023 - Springer
Recently, sequential transfer learning emerged as a modern technique for applying the
“pretrain then fine-tune” paradigm to leverage existing knowledge to improve the …

Cosmic: Commonsense knowledge for emotion identification in conversations

D Ghosal, N Majumder, A Gelbukh, R Mihalcea… - arXiv preprint arXiv …, 2020 - arxiv.org
In this paper, we address the task of utterance level emotion recognition in conversations
using commonsense knowledge. We propose COSMIC, a new framework that incorporates …