Making the most of text semantics to improve biomedical vision–language processing

B Boecking, N Usuyama, S Bannur, DC Castro… - European conference on …, 2022 - Springer
Multi-modal data abounds in biomedicine, such as radiology images and reports.
Interpreting this data at scale is essential for improving clinical care and accelerating clinical …

Interactive and explainable region-guided radiology report generation

T Tanida, P Müller, G Kaissis… - Proceedings of the …, 2023 - openaccess.thecvf.com
The automatic generation of radiology reports has the potential to assist radiologists in the
time-consuming task of report writing. Existing methods generate the full report from image …

[HTML][HTML] Learning from positive and unlabeled data: A survey

J Bekker, J Davis - Machine Learning, 2020 - Springer
Learning from positive and unlabeled data or PU learning is the setting where a learner only
has access to positive examples and unlabeled data. The assumption is that the unlabeled …

A systematic review of deep learning-based research on radiology report generation

C Liu, Y Tian, Y Song - arXiv preprint arXiv:2311.14199, 2023 - arxiv.org
Radiology report generation (RRG) aims to automatically generate free-text descriptions
from clinical radiographs, eg, chest X-Ray images. RRG plays an essential role in promoting …

Medklip: Medical knowledge enhanced language-image pre-training for x-ray diagnosis

C Wu, X Zhang, Y Zhang, Y Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this paper, we consider enhancing medical visual-language pre-training (VLP) with
domain-specific knowledge, by exploiting the paired image-text reports from the radiological …

Ehrxqa: A multi-modal question answering dataset for electronic health records with chest x-ray images

S Bae, D Kyung, J Ryu, E Cho, G Lee… - Advances in …, 2024 - proceedings.neurips.cc
Abstract Electronic Health Records (EHRs), which contain patients' medical histories in
various multi-modal formats, often overlook the potential for joint reasoning across imaging …

Maira-1: A specialised large multimodal model for radiology report generation

SL Hyland, S Bannur, K Bouzid, DC Castro… - arXiv preprint arXiv …, 2023 - arxiv.org
We present a radiology-specific multimodal model for the task for generating radiological
reports from chest X-rays (CXRs). Our work builds on the idea that large language model (s) …

Expert knowledge-aware image difference graph representation learning for difference-aware medical visual question answering

X Hu, L Gu, Q An, M Zhang, L Liu, K Kobayashi… - Proceedings of the 29th …, 2023 - dl.acm.org
To contribute to automating the medical vision-language model, we propose a novel Chest-
Xray Different Visual Question Answering (VQA) task. Given a pair of main and reference …

Radgraph2: Modeling disease progression in radiology reports via hierarchical information extraction

S Khanna, A Dejl, K Yoon… - Machine Learning …, 2023 - proceedings.mlr.press
We present RadGraph2, a novel dataset for extracting information from radiology reports that
focuses on capturing changes in disease state and device placement over time. We …

Complex organ mask guided radiology report generation

T Gu, D Liu, Z Li, W Cai - Proceedings of the IEEE/CVF …, 2024 - openaccess.thecvf.com
The goal of automatic report generation is to generate a clinically accurate and coherent
phrase from a single given X-ray image, which could alleviate the workload of traditional …