Foundations and Trends in Multimodal Machine Learning: Principles, Challenges, and Open Questions

PP Liang, A Zadeh, LP Morency - arXiv preprint arXiv:2209.03430, 2022 - arxiv.org
Multimodal machine learning is a vibrant multi-disciplinary research field that aims to design
computer agents with intelligent capabilities such as understanding, reasoning, and learning …

Multimodal medical image fusion review: Theoretical background and recent advances

H Hermessi, O Mourali, E Zagrouba - Signal Processing, 2021 - Elsevier
Multimodal medical image fusion consists in combining two or more images of the same or
different modalities aiming to improve the image content, and preserve information. The …

Learning a deep multi-scale feature ensemble and an edge-attention guidance for image fusion

J Liu, X Fan, J Jiang, R Liu, Z Luo - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Image fusion integrates a series of images acquired from different sensors, eg, infrared and
visible, outputting an image with richer information than either one. Traditional and recent …

Classification saliency-based rule for visible and infrared image fusion

H Xu, H Zhang, J Ma - IEEE Transactions on Computational …, 2021 - ieeexplore.ieee.org
Existing image fusion methods always use hand-crafted fusion rules due to the
uninterpretability of deep feature maps, which restrict the performance of networks and result …

Infrared and visible image fusion methods and applications: A survey

J Ma, Y Ma, C Li - Information fusion, 2019 - Elsevier
Infrared images can distinguish targets from their backgrounds based on the radiation
difference, which works well in all-weather and all-day/night conditions. By contrast, visible …

Deep learning for pixel-level image fusion: Recent advances and future prospects

Y Liu, X Chen, Z Wang, ZJ Wang, RK Ward, X Wang - Information fusion, 2018 - Elsevier
By integrating the information contained in multiple images of the same scene into one
composite image, pixel-level image fusion is recognized as having high significance in a …

Pixel-level image fusion: A survey of the state of the art

S Li, X Kang, L Fang, J Hu, H Yin - information Fusion, 2017 - Elsevier
Pixel-level image fusion is designed to combine multiple input images into a fused image,
which is expected to be more informative for human or machine perception as compared to …

A phase congruency and local Laplacian energy based multi-modality medical image fusion method in NSCT domain

Z Zhu, M Zheng, G Qi, D Wang, Y Xiang - Ieee Access, 2019 - ieeexplore.ieee.org
Multi-modality image fusion provides more comprehensive and sophisticated information in
modern medical diagnosis, remote sensing, video surveillance, and so on. This paper …

Sparse representation based multi-sensor image fusion for multi-focus and multi-modality images: A review

Q Zhang, Y Liu, RS Blum, J Han, D Tao - Information Fusion, 2018 - Elsevier
As a result of several successful applications in computer vision and image processing,
sparse representation (SR) has attracted significant attention in multi-sensor image fusion …

A novel multi-modality image fusion method based on image decomposition and sparse representation

Z Zhu, H Yin, Y Chai, Y Li, G Qi - Information Sciences, 2018 - Elsevier
Multi-modality image fusion is an effective technique to fuse the complementary information
from multi-modality images into an integrated image. The additional information can not only …