Vision-language models for medical report generation and visual question answering: A review

I Hartsock, G Rasool - Frontiers in Artificial Intelligence, 2024 - frontiersin.org
Medical vision-language models (VLMs) combine computer vision (CV) and natural
language processing (NLP) to analyze visual and textual medical data. Our paper reviews …

Towards next-generation diagnostic pathology: AI-empowered label-free multiphoton microscopy

S Wang, J Pan, X Zhang, Y Li, W Liu, R Lin… - Light: Science & …, 2024 - nature.com
Diagnostic pathology, historically dependent on visual scrutiny by experts, is essential for
disease detection. Advances in digital pathology and developments in computer vision …

Hest-1k: A dataset for spatial transcriptomics and histology image analysis

G Jaume, P Doucet, AH Song, MY Lu… - arXiv preprint arXiv …, 2024 - arxiv.org
Spatial transcriptomics enables interrogating the molecular composition of tissue with ever-
increasing resolution and sensitivity. However, costs, rapidly evolving technology, and lack …

A foundation model utilizing chest ct volumes and radiology reports for supervised-level zero-shot detection of abnormalities

IE Hamamci, S Er, F Almas, AG Simsek, SN Esirgun… - CoRR, 2024 - openreview.net
While computer vision has achieved tremendous success with multimodal encoding and
direct textual interaction with images via chat-based large language models, similar …

[HTML][HTML] Generative Artificial Intellegence (AI) in Pathology and Medicine: A Deeper Dive

HH Rashidi, J Pantanowitz, A Chamanzar, B Fennell… - Modern Pathology, 2024 - Elsevier
This review article builds upon the introductory piece in our seven-part series, delving
deeper into the transformative potential of generative artificial intelligence (Gen AI) in …

Pa-llava: A large language-vision assistant for human pathology image understanding

D Dai, Y Zhang, L Xu, Q Yang, X Shen, S Xia… - arXiv preprint arXiv …, 2024 - arxiv.org
The previous advancements in pathology image understanding primarily involved
developing models tailored to specific tasks. Recent studies has demonstrated that the large …

From Images to Genes: Radiogenomics Based on Artificial Intelligence to Achieve Non‐Invasive Precision Medicine in Cancer Patients

Y Guo, T Li, B Gong, Y Hu, S Wang, L Yang… - Advanced …, 2024 - Wiley Online Library
With the increasing demand for precision medicine in cancer patients, radiogenomics
emerges as a promising frontier. Radiogenomics is originally defined as a methodology for …

Academic collaboration on large language model studies increases overall but varies across disciplines

L Li, L Dinh, S Hu, L Hemphill - arXiv preprint arXiv:2408.04163, 2024 - arxiv.org
Interdisciplinary collaboration is crucial for addressing complex scientific challenges. Recent
advancements in large language models (LLMs) have shown significant potential in …

How AI agents will change cancer research and oncology

Y Lee, D Ferber, JE Rood, A Regev, JN Kather - Nature Cancer, 2024 - nature.com
Deep learning models are advancing cancer research and oncology but require human
engagement to perform complex multi-step workflows. Autonomous artificial intelligence …

Cost-effective instruction learning for pathology vision and language analysis

K Chen, M Liu, F Yan, L Ma, X Shi, L Wang… - arXiv preprint arXiv …, 2024 - arxiv.org
The advent of vision-language models fosters the interactive conversations between AI-
enabled models and humans. Yet applying these models into clinics must deal with …