Deep multimodal fusion of image and non-image data in disease diagnosis and prognosis: a review

C Cui, H Yang, Y Wang, S Zhao, Z Asad… - Progress in …, 2023 - iopscience.iop.org
The rapid development of diagnostic technologies in healthcare is leading to higher
requirements for physicians to handle and integrate the heterogeneous, yet complementary …

A review of the application of multi-modal deep learning in medicine: bibliometrics and future directions

X Pei, K Zuo, Y Li, Z Pang - International Journal of Computational …, 2023 - Springer
In recent years, deep learning has been applied in the field of clinical medicine to process
large-scale medical images, for large-scale data screening, and in the diagnosis and …

Multimodal dynamics: Dynamical fusion for trustworthy multimodal classification

Z Han, F Yang, J Huang, C Zhang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Integration of heterogeneous and high-dimensional data (eg, multiomics) is becoming
increasingly important. Existing multimodal classification algorithms mainly focus on …

Cross-modal translation and alignment for survival analysis

F Zhou, H Chen - Proceedings of the IEEE/CVF International …, 2023 - openaccess.thecvf.com
With the rapid advances in high-throughput sequencing technologies, the focus of survival
analysis has shifted from examining clinical indicators to incorporating genomic profiles with …

Shared-specific feature learning with bottleneck fusion transformer for multi-modal whole slide image analysis

Z Wang, L Yu, X Ding, X Liao… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
The fusion of multi-modal medical data is essential to assist medical experts to make
treatment decisions for precision medicine. For example, combining the whole slide …

Integrative histology-genomic analysis predicts hepatocellular carcinoma prognosis using deep learning

J Hou, X Jia, Y Xie, W Qin - Genes, 2022 - mdpi.com
Cancer prognosis analysis is of essential interest in clinical practice. In order to explore the
prognostic power of computational histopathology and genomics, this paper constructs a …

Smooth attention for deep multiple instance learning: Application to ct intracranial hemorrhage detection

Y Wu, FM Castro-Macías, P Morales-Álvarez… - … Conference on Medical …, 2023 - Springer
Abstract Multiple Instance Learning (MIL) has been widely applied to medical imaging
diagnosis, where bag labels are known and instance labels inside bags are unknown …

Transformer-based personalized attention mechanism for medical images with clinical records

Y Takagi, N Hashimoto, H Masuda, H Miyoshi… - Journal of Pathology …, 2023 - Elsevier
In medical image diagnosis, identifying the attention region, ie, the region of interest for
which the diagnosis is made, is an important task. Various methods have been developed to …

[PDF][PDF] Dual Space Multiple Instance Representative Learning for Medical Image Classification.

X Zhang, S Huang, Y Zhang, X Zhang, M Gao… - BMVC, 2022 - bmvc2022.mpi-inf.mpg.de
Medical image classification plays a vital role in AI-aided medical diagnosis and is often
addressed as a Multiple Instance Learning (MIL) issue (ie, each sample is a bag of …

Multimodal Machine Learning in Image-Based and Clinical Biomedicine: Survey and Prospects

E Warner, J Lee, W Hsu, T Syeda-Mahmood… - International Journal of …, 2024 - Springer
Abstract Machine learning (ML) applications in medical artificial intelligence (AI) systems
have shifted from traditional and statistical methods to increasing application of deep …