Multimodal sentiment analysis: A systematic review of history, datasets, multimodal fusion methods, applications, challenges and future directions

A Gandhi, K Adhvaryu, S Poria, E Cambria, A Hussain - Information Fusion, 2023 - Elsevier
Sentiment analysis (SA) has gained much traction In the field of artificial intelligence (AI) and
natural language processing (NLP). There is growing demand to automate analysis of user …

Multi-modal bioelectrical signal fusion analysis based on different acquisition devices and scene settings: Overview, challenges, and novel orientation

J Li, Q Wang - Information Fusion, 2022 - Elsevier
Multi-modal fusion combines multiple modal information to overcome the limitation of
incomplete information expressed by a single modality, so as to realize the complementarity …

Audio based depression detection using Convolutional Autoencoder

S Sardari, B Nakisa, MN Rastgoo, P Eklund - Expert Systems with …, 2022 - Elsevier
Depression is a serious and common psychological disorder that requires early diagnosis
and treatment. In severe episodes the condition may result in suicidal thoughts. Recently …

Real-time driver cognitive workload recognition: Attention-enabled learning with multimodal information fusion

H Yang, J Wu, Z Hu, C Lv - IEEE Transactions on Industrial …, 2023 - ieeexplore.ieee.org
Driver workload inference is significant for the design of intelligent human–machine
cooperative driving schemes since it allows the systems to alert drivers before potentially …

Application of hyperspectral imaging assisted with integrated deep learning approaches in identifying geographical origins and predicting nutrient contents of Coix …

Y Wang, F Xiong, Y Zhang, S Wang, Y Yuan, C Lu… - Food chemistry, 2023 - Elsevier
Coix seed (CS, Coix lachryma-jobi L. var. ma-yuen (Roman.) Stapf) has rich nutrients,
including starch, protein and oil. The geographical origin with a protected geographical …

DSDCLA: Driving style detection via hybrid CNN-LSTM with multi-level attention fusion

J Liu, Y Liu, D Li, H Wang, X Huang, L Song - Applied Intelligence, 2023 - Springer
Driving style detection is an essential real-world requirement in diverse contexts, such as
traffic safety, car insurance and fuel consumption optimization. However, the existing …

A systematic literature review on multimodal machine learning: Applications, challenges, gaps and future directions

A Barua, MU Ahmed, S Begum - IEEE Access, 2023 - ieeexplore.ieee.org
Multimodal machine learning (MML) is a tempting multidisciplinary research area where
heterogeneous data from multiple modalities and machine learning (ML) are combined to …

[HTML][HTML] Artificial Intelligence for skeleton-based physical rehabilitation action evaluation: A systematic review

S Sardari, S Sharifzadeh, A Daneshkhah… - Computers in Biology …, 2023 - Elsevier
Performing prescribed physical exercises during home-based rehabilitation programs plays
an important role in regaining muscle strength and improving balance for people with …

Deep learning based multimodal biomedical data fusion: An overview and comparative review

J Duan, J Xiong, Y Li, W Ding - Information Fusion, 2024 - Elsevier
Multimodal biomedical data fusion plays a pivotal role in distilling comprehensible and
actionable insights by seamlessly integrating disparate biomedical data from multiple …

[HTML][HTML] FN-OCT: Disease detection algorithm for retinal optical coherence tomography based on a fusion network

Z Ai, X Huang, J Feng, H Wang, Y Tao… - Frontiers in …, 2022 - frontiersin.org
Optical coherence tomography (OCT) is a new type of tomography that has experienced
rapid development and potential in recent years. It is playing an increasingly important role …