The Use of Machine Learning in Eye Tracking Studies in Medical Imaging: A Review
B Ibragimov, C Mello-Thoms - IEEE Journal of Biomedical and …, 2024 - ieeexplore.ieee.org
Machine learning (ML) has revolutionized medical image-based diagnostics. In this review,
we cover a rapidly emerging field that can be potentially significantly impacted by ML–eye …
we cover a rapidly emerging field that can be potentially significantly impacted by ML–eye …
Improving Medical Multi-modal Contrastive Learning with Expert Annotations
Y Kumar, P Marttinen - arXiv preprint arXiv:2403.10153, 2024 - arxiv.org
We introduce eCLIP, an enhanced version of the CLIP model that integrates expert
annotations in the form of radiologist eye-gaze heatmaps. It tackles key challenges in …
annotations in the form of radiologist eye-gaze heatmaps. It tackles key challenges in …
Vision-language models for decoding provider attention during neonatal resuscitation
F Parodi, JK Matelsky… - Proceedings of the …, 2024 - openaccess.thecvf.com
Neonatal resuscitations demand an exceptional level of attentiveness from providers who
must process multiple streams of information simultaneously. Gaze strongly influences …
must process multiple streams of information simultaneously. Gaze strongly influences …
[HTML][HTML] Three-stage framework for accurate pediatric chest X-ray diagnosis using self-supervision and transfer learning on small datasets
Pediatric respiratory disease diagnosis and subsequent treatment require accurate and
interpretable analysis. A chest X-ray is the most cost-effective and rapid method for …
interpretable analysis. A chest X-ray is the most cost-effective and rapid method for …
Trends, Applications, and Challenges in Human Attention Modelling
Human attention modelling has proven, in recent years, to be particularly useful not only for
understanding the cognitive processes underlying visual exploration, but also for providing …
understanding the cognitive processes underlying visual exploration, but also for providing …
Gaze Scanpath Transformer: Predicting Visual Search Target by Spatiotemporal Semantic Modeling of Gaze Scanpath
T Nishiyasu, Y Sato - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
We introduce a new method called the Gaze Scanpath Transformer for predicting a search
target category during a visual search task. Previous methods for estimating visual search …
target category during a visual search task. Previous methods for estimating visual search …
TGPO-WRHNN: Two-stage Grad-CAM-guided PMRS Optimization and weighted-residual hypergraph neural network for pneumonia detection
Recent studies based on chest X-ray images have shown that pneumonia can be effectively
detected using deep convolutional neural network methods. However, these methods tend …
detected using deep convolutional neural network methods. However, these methods tend …
Gaze-DETR: Using Expert Gaze to Reduce False Positives in Vulvovaginal Candidiasis Screening
Accurate detection of vulvovaginal candidiasis is critical for women's health, yet its sparse
distribution and visually ambiguous characteristics pose significant challenges for accurate …
distribution and visually ambiguous characteristics pose significant challenges for accurate …
Seeing Through Expert's Eyes: Leveraging Radiologist Eye Gaze and Speech Report with Graph Neural Networks for Chest X-ray Image Classification
Recently, integrating eye-tracking techniques and texts into disease classification has
gained traction. To address the unmet needs such as heterogeneous data alignment …
gained traction. To address the unmet needs such as heterogeneous data alignment …
Multi-graph Networks with Graph Pooling for COVID-19 Diagnosis
Abstract Convolutional Neural Networks (CNNs) have shown remarkable capabilities in
extracting local features from images, yet they often overlook the underlying relationships …
extracting local features from images, yet they often overlook the underlying relationships …