A systematic literature review on multimodal machine learning: Applications, challenges, gaps and future directions

A Barua, MU Ahmed, S Begum - IEEE Access, 2023 - ieeexplore.ieee.org
Multimodal machine learning (MML) is a tempting multidisciplinary research area where
heterogeneous data from multiple modalities and machine learning (ML) are combined to …

Image-text multimodal emotion classification via multi-view attentional network

X Yang, S Feng, D Wang… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
Compared with single-modal content, multimodal data can express users' feelings and
sentiments more vividly and interestingly. Therefore, multimodal sentiment analysis has …

A review on machine-learning based code smell detection techniques in object-oriented software system (s)

A Kaur, S Jain, S Goel, G Dhiman - Recent Advances in …, 2021 - ingentaconnect.com
Background: Code smells are symptoms that something may be wrong in software systems
that can cause complications in maintaining software quality. In literature, there exist many …

Deep quadruple-based hashing for remote sensing image-sound retrieval

Y Chen, S Xiong, L Mou, XX Zhu - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
With the rapid progress of earth observation technology, cross-modal remote sensing (RS)
image-sound retrieval has attracted much attention from the field of RS data processing …

Multi-task travel route planning with a flexible deep learning framework

F Huang, J Xu, J Weng - IEEE Transactions on Intelligent …, 2020 - ieeexplore.ieee.org
Travel route planning aims to map out a feasible sightseeing itinerary for a traveler covering
famous attractions and meeting the tourist's desire. It is very useful for tourists to plan their …

Online social network individual depression detection using a multitask heterogenous modality fusion approach

Y Wang, Z Wang, C Li, Y Zhang, H Wang - Information Sciences, 2022 - Elsevier
In recent years, the number of people who endanger their lives has been increasing rapidly
due to the mental burden of depression. The online social network (OSN) provides …

Category-aware multimodal attention network for fashion compatibility modeling

P Jing, K Cui, W Guan, L Nie… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Fashion compatibility modeling, which is used to estimate the matching degree of a given
set of fashion items, has received increasing attention in recent years. However, existing …

Object detection in remote sensing images based on deep transfer learning

J Chen, J Sun, Y Li, C Hou - Multimedia Tools and Applications, 2022 - Springer
Object detection is a basic part in remote sensing image processing. At present, it is more
common to conduct the topic based on deep learning, however the volume of remote …

AIA-net: Adaptive interactive attention network for text–audio emotion recognition

T Zhang, S Li, B Chen, H Yuan… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Emotion recognition based on text–audio modalities is the core technology for transforming
a graphical user interface into a voice user interface, and it plays a vital role in natural …

A multimodal feature fusion-based method for individual depression detection on sina weibo

Y Wang, Z Wang, C Li, Y Zhang… - 2020 IEEE 39th …, 2020 - ieeexplore.ieee.org
Existing studies have shown that various types of information on the online social network
(OSN) can help predict the early stage of depression. However, studies using machine …