Multimodal sentiment analysis: A systematic review of history, datasets, multimodal fusion methods, applications, challenges and future directions

A Gandhi, K Adhvaryu, S Poria, E Cambria, A Hussain - Information Fusion, 2023 - Elsevier
Sentiment analysis (SA) has gained much traction In the field of artificial intelligence (AI) and
natural language processing (NLP). There is growing demand to automate analysis of user …

[HTML][HTML] Harnessing multimodal data integration to advance precision oncology

KM Boehm, P Khosravi, R Vanguri, J Gao… - Nature Reviews …, 2022 - nature.com
Advances in quantitative biomarker development have accelerated new forms of data-driven
insights for patients with cancer. However, most approaches are limited to a single mode of …

Multimodal sentiment analysis based on fusion methods: A survey

L Zhu, Z Zhu, C Zhang, Y Xu, X Kong - Information Fusion, 2023 - Elsevier
Sentiment analysis is an emerging technology that aims to explore people's attitudes toward
an entity. It can be applied in a variety of different fields and scenarios, such as product …

Multimodal deep learning for biomedical data fusion: a review

SR Stahlschmidt, B Ulfenborg… - Briefings in …, 2022 - academic.oup.com
Biomedical data are becoming increasingly multimodal and thereby capture the underlying
complex relationships among biological processes. Deep learning (DL)-based data fusion …

Misa: Modality-invariant and-specific representations for multimodal sentiment analysis

D Hazarika, R Zimmermann, S Poria - Proceedings of the 28th ACM …, 2020 - dl.acm.org
Multimodal Sentiment Analysis is an active area of research that leverages multimodal
signals for affective understanding of user-generated videos. The predominant approach …

Multi-modal fusion network with complementarity and importance for emotion recognition

S Liu, P Gao, Y Li, W Fu, W Ding - Information Sciences, 2023 - Elsevier
Multimodal emotion recognition, that is, emotion recognition uses machine learning to
generate multi-modal features on the basis of videos which has become a research hotspot …

Cosmic: Commonsense knowledge for emotion identification in conversations

D Ghosal, N Majumder, A Gelbukh, R Mihalcea… - arXiv preprint arXiv …, 2020 - arxiv.org
In this paper, we address the task of utterance level emotion recognition in conversations
using commonsense knowledge. We propose COSMIC, a new framework that incorporates …

Dialoguegcn: A graph convolutional neural network for emotion recognition in conversation

D Ghosal, N Majumder, S Poria, N Chhaya… - arXiv preprint arXiv …, 2019 - arxiv.org
Emotion recognition in conversation (ERC) has received much attention, lately, from
researchers due to its potential widespread applications in diverse areas, such as health …

An attentive survey of attention models

S Chaudhari, V Mithal, G Polatkan… - ACM Transactions on …, 2021 - dl.acm.org
Attention Model has now become an important concept in neural networks that has been
researched within diverse application domains. This survey provides a structured and …

Univl: A unified video and language pre-training model for multimodal understanding and generation

H Luo, L Ji, B Shi, H Huang, N Duan, T Li, J Li… - arXiv preprint arXiv …, 2020 - arxiv.org
With the recent success of the pre-training technique for NLP and image-linguistic tasks,
some video-linguistic pre-training works are gradually developed to improve video-text …