A review on methods and applications in multimodal deep learning

S Jabeen, X Li, MS Amin, O Bourahla, S Li… - ACM Transactions on …, 2023 - dl.acm.org
Deep Learning has implemented a wide range of applications and has become increasingly
popular in recent years. The goal of multimodal deep learning (MMDL) is to create models …

Self-supervised correlation learning for cross-modal retrieval

Y Liu, J Wu, L Qu, T Gan, J Yin… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Cross-modal retrieval aims to retrieve relevant data from another modality when given a
query of one modality. Although most existing methods that rely on the label information of …

Cross-modal hash retrieval based on semantic multiple similarity learning and interactive projection matrix learning

J Tan, Z Yang, J Ye, R Chen, Y Cheng, J Qin… - Information Sciences, 2023 - Elsevier
Cross-modal hash has become a key technology for large datasets retrieval. However, some
challenges still need to be tackled: 1) How to effectively embed semantic information into …

Multiple instance relation graph reasoning for cross-modal hash retrieval

C Hou, Z Li, Z Tang, X Xie, H Ma - Knowledge-Based Systems, 2022 - Elsevier
The similarity calculation is too simple in most cross-modal hash retrieval methods, which do
not consider the impact of the relations between instances. To solve this problem, this paper …

Similarity Graph-correlation Reconstruction Network for unsupervised cross-modal hashing

D Yao, Z Li, B Li, C Zhang, H Ma - Expert Systems with Applications, 2024 - Elsevier
Existing cross-modal hash retrieval methods can simultaneously enhance retrieval speed
and reduce storage space. However, these methods face a major challenge in determining …

Semantic pre-alignment and ranking learning with unified framework for cross-modal retrieval

Q Cheng, Z Tan, K Wen, C Chen… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Cross-modal retrieval aims at retrieving highly semantic relevant information among multi-
modalities. Existing cross-modal retrieval methods mainly explore the semantic consistency …

Deep supervised dual cycle adversarial network for cross-modal retrieval

L Liao, M Yang, B Zhang - … on Circuits and Systems for Video …, 2022 - ieeexplore.ieee.org
Cross-modal retrieval tasks, which are more natural and challenging than traditional
retrieval tasks, have attracted increasing interest from researchers in recent years. Although …

RICH: A rapid method for image-text cross-modal hash retrieval

B Li, D Yao, Z Li - Displays, 2023 - Elsevier
Deep cross-modal hash retrieval (DCMHR) methods can effectively analyze the correlation
of multimodal data while maintaining efficiency. However, to pursue better accuracy, most …

Semi-supervised cross-modal hashing with multi-view graph representation

X Shen, H Zhang, L Li, W Yang, L Liu - Information Sciences, 2022 - Elsevier
Recently, significant progress has been made in graph-based hashing methods for the
purpose of learning hash codes that can preserve semantic similarity. Many approaches …

[HTML][HTML] Multimodal representative answer extraction in community question answering

M Li, Y Ma, Y Li, Y Bai - Journal of King Saud University-Computer and …, 2023 - Elsevier
To solve the information overload problem of multimodal answers in community question
answering (CQA), this paper proposes a multimodal representative answer extraction …