The Use of Machine Learning in Eye Tracking Studies in Medical Imaging: A Review

B Ibragimov, C Mello-Thoms - IEEE Journal of Biomedical and …, 2024 - ieeexplore.ieee.org
Machine learning (ML) has revolutionized medical image-based diagnostics. In this review,
we cover a rapidly emerging field that can be potentially significantly impacted by ML–eye …

Improving Medical Multi-modal Contrastive Learning with Expert Annotations

Y Kumar, P Marttinen - arXiv preprint arXiv:2403.10153, 2024 - arxiv.org
We introduce eCLIP, an enhanced version of the CLIP model that integrates expert
annotations in the form of radiologist eye-gaze heatmaps. It tackles key challenges in …

Vision-language models for decoding provider attention during neonatal resuscitation

F Parodi, JK Matelsky… - Proceedings of the …, 2024 - openaccess.thecvf.com
Neonatal resuscitations demand an exceptional level of attentiveness from providers who
must process multiple streams of information simultaneously. Gaze strongly influences …

[HTML][HTML] Three-stage framework for accurate pediatric chest X-ray diagnosis using self-supervision and transfer learning on small datasets

Y Zhang, J Kohne, E Wittrup, K Najarian - Diagnostics, 2024 - mdpi.com
Pediatric respiratory disease diagnosis and subsequent treatment require accurate and
interpretable analysis. A chest X-ray is the most cost-effective and rapid method for …

Trends, Applications, and Challenges in Human Attention Modelling

G Cartella, M Cornia, V Cuculo, A D'Amelio… - arXiv preprint arXiv …, 2024 - arxiv.org
Human attention modelling has proven, in recent years, to be particularly useful not only for
understanding the cognitive processes underlying visual exploration, but also for providing …

Gaze Scanpath Transformer: Predicting Visual Search Target by Spatiotemporal Semantic Modeling of Gaze Scanpath

T Nishiyasu, Y Sato - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
We introduce a new method called the Gaze Scanpath Transformer for predicting a search
target category during a visual search task. Previous methods for estimating visual search …

TGPO-WRHNN: Two-stage Grad-CAM-guided PMRS Optimization and weighted-residual hypergraph neural network for pneumonia detection

C Tang, X Zhi, J Sun, S Wang, Y Zhang - Knowledge-Based Systems, 2024 - Elsevier
Recent studies based on chest X-ray images have shown that pneumonia can be effectively
detected using deep convolutional neural network methods. However, these methods tend …

Gaze-DETR: Using Expert Gaze to Reduce False Positives in Vulvovaginal Candidiasis Screening

Y Kong, S Wang, J Cai, Z Zhao, Z Shen, Y Li… - … Conference on Medical …, 2024 - Springer
Accurate detection of vulvovaginal candidiasis is critical for women's health, yet its sparse
distribution and visually ambiguous characteristics pose significant challenges for accurate …

Seeing Through Expert's Eyes: Leveraging Radiologist Eye Gaze and Speech Report with Graph Neural Networks for Chest X-ray Image Classification

J Sultana, R Qin, Z Yin - Proceedings of the Asian …, 2024 - openaccess.thecvf.com
Recently, integrating eye-tracking techniques and texts into disease classification has
gained traction. To address the unmet needs such as heterogeneous data alignment …

Multi-graph Networks with Graph Pooling for COVID-19 Diagnosis

C Tang, W Xu, J Sun, S Wang, Y Zhang… - Journal of Bionic …, 2024 - Springer
Abstract Convolutional Neural Networks (CNNs) have shown remarkable capabilities in
extracting local features from images, yet they often overlook the underlying relationships …