Making the most of text semantics to improve biomedical vision–language processing
Multi-modal data abounds in biomedicine, such as radiology images and reports.
Interpreting this data at scale is essential for improving clinical care and accelerating clinical …
Interpreting this data at scale is essential for improving clinical care and accelerating clinical …
Interactive and explainable region-guided radiology report generation
The automatic generation of radiology reports has the potential to assist radiologists in the
time-consuming task of report writing. Existing methods generate the full report from image …
time-consuming task of report writing. Existing methods generate the full report from image …
[HTML][HTML] Learning from positive and unlabeled data: A survey
Learning from positive and unlabeled data or PU learning is the setting where a learner only
has access to positive examples and unlabeled data. The assumption is that the unlabeled …
has access to positive examples and unlabeled data. The assumption is that the unlabeled …
A systematic review of deep learning-based research on radiology report generation
Radiology report generation (RRG) aims to automatically generate free-text descriptions
from clinical radiographs, eg, chest X-Ray images. RRG plays an essential role in promoting …
from clinical radiographs, eg, chest X-Ray images. RRG plays an essential role in promoting …
Medklip: Medical knowledge enhanced language-image pre-training for x-ray diagnosis
In this paper, we consider enhancing medical visual-language pre-training (VLP) with
domain-specific knowledge, by exploiting the paired image-text reports from the radiological …
domain-specific knowledge, by exploiting the paired image-text reports from the radiological …
Ehrxqa: A multi-modal question answering dataset for electronic health records with chest x-ray images
Abstract Electronic Health Records (EHRs), which contain patients' medical histories in
various multi-modal formats, often overlook the potential for joint reasoning across imaging …
various multi-modal formats, often overlook the potential for joint reasoning across imaging …
Maira-1: A specialised large multimodal model for radiology report generation
We present a radiology-specific multimodal model for the task for generating radiological
reports from chest X-rays (CXRs). Our work builds on the idea that large language model (s) …
reports from chest X-rays (CXRs). Our work builds on the idea that large language model (s) …
Expert knowledge-aware image difference graph representation learning for difference-aware medical visual question answering
To contribute to automating the medical vision-language model, we propose a novel Chest-
Xray Different Visual Question Answering (VQA) task. Given a pair of main and reference …
Xray Different Visual Question Answering (VQA) task. Given a pair of main and reference …
Radgraph2: Modeling disease progression in radiology reports via hierarchical information extraction
S Khanna, A Dejl, K Yoon… - Machine Learning …, 2023 - proceedings.mlr.press
We present RadGraph2, a novel dataset for extracting information from radiology reports that
focuses on capturing changes in disease state and device placement over time. We …
focuses on capturing changes in disease state and device placement over time. We …
Complex organ mask guided radiology report generation
The goal of automatic report generation is to generate a clinically accurate and coherent
phrase from a single given X-ray image, which could alleviate the workload of traditional …
phrase from a single given X-ray image, which could alleviate the workload of traditional …