Clip in medical imaging: A comprehensive survey

Z Zhao, Y Liu, H Wu, Y Li, S Wang, L Teng… - arXiv preprint arXiv …, 2023 - arxiv.org
Contrastive Language-Image Pre-training (CLIP), a straightforward yet effective pre-training
paradigm, successfully introduces semantic-rich text supervision to vision models and has …

Chexagent: Towards a foundation model for chest x-ray interpretation

Z Chen, M Varma, JB Delbrouck, M Paschali… - arXiv preprint arXiv …, 2024 - arxiv.org
Chest X-rays (CXRs) are the most frequently performed imaging test in clinical practice.
Recent advances in the development of vision-language foundation models (FMs) give rise …

Large Language Models for Disease Diagnosis: A Scoping Review

S Zhou, Z Xu, M Zhang, C Xu, Y Guo, Z Zhan… - arXiv preprint arXiv …, 2024 - arxiv.org
Automatic disease diagnosis has become increasingly valuable in clinical practice. The
advent of large language models (LLMs) has catalyzed a paradigm shift in artificial …

Enhancing Human-Computer Interaction in Chest X-ray Analysis using Vision and Language Model with Eye Gaze Patterns

Y Kim, J Wu, Y Abdulle, Y Gao, H Wu - International Conference on …, 2024 - Springer
Abstract Recent advancements in Computer Assisted Diagnosis have shown promising
performance in medical imaging tasks, particularly in chest X-ray analysis. However, the …

Mitigating Heterogeneity in Federated Multimodal Learning with Biomedical Vision-Language Pre-training

Z Shuai, L Shen - arXiv preprint arXiv:2404.03854, 2024 - arxiv.org
Vision-language pre-training (VLP) has arised as an efficient scheme for multimodal
representation learning, but it requires large-scale multimodal data for pre-training, making it …

A scoping review of using Large Language Models (LLMs) to investigate Electronic Health Records (EHRs)

L Li, J Zhou, Z Gao, W Hua, L Fan, H Yu… - arXiv preprint arXiv …, 2024 - arxiv.org
Electronic Health Records (EHRs) play an important role in the healthcare system. However,
their complexity and vast volume pose significant challenges to data interpretation and …

Towards Predicting Temporal Changes in a Patient's Chest X-ray Images based on Electronic Health Records

D Kyung, J Kim, T Kim, E Choi - arXiv preprint arXiv:2409.07012, 2024 - arxiv.org
Chest X-ray imaging (CXR) is an important diagnostic tool used in hospitals to assess
patient conditions and monitor changes over time. Generative models, specifically diffusion …

M4CXR: Exploring Multi-task Potentials of Multi-modal Large Language Models for Chest X-ray Interpretation

J Park, S Kim, B Yoon, J Hyun, K Choi - arXiv preprint arXiv:2408.16213, 2024 - arxiv.org
The rapid evolution of artificial intelligence, especially in large language models (LLMs), has
significantly impacted various domains, including healthcare. In chest X-ray (CXR) analysis …

Self-eXplainable AI for Medical Image Analysis: A Survey and New Outlooks

J Hou, S Liu, Y Bie, H Wang, A Tan, L Luo… - arXiv preprint arXiv …, 2024 - arxiv.org
The increasing demand for transparent and reliable models, particularly in high-stakes
decision-making areas such as medical image analysis, has led to the emergence of …

Expert-level vision-language foundation model for real-world radiology and comprehensive evaluation

X Liu, G Yang, Y Luo, J Mao, X Zhang, M Gao… - arXiv preprint arXiv …, 2024 - arxiv.org
Radiology is a vital and complex component of modern clinical workflow and covers many
tasks. Recently, vision-language (VL) foundation models in medicine have shown potential …