Consistency is key: Disentangling label variation in natural language processing with intra-annotator agreement
We commonly use agreement measures to assess the utility of judgements made by human
annotators in Natural Language Processing (NLP) tasks. While inter-annotator agreement is …
annotators in Natural Language Processing (NLP) tasks. While inter-annotator agreement is …
An expert-in-the-loop paradigm for learning medical image grouping
Image grouping in knowledge-rich domains is challenging, since domain knowledge and
expertise are key to transform image pixels into meaningful content. Manually marking and …
expertise are key to transform image pixels into meaningful content. Manually marking and …
Modeling eye movement patterns to characterize perceptual skill in image-based diagnostic reasoning processes
Experts have a remarkable capability of locating, perceptually organizing, identifying, and
categorizing objects in images specific to their domains of expertise. In this article, we …
categorizing objects in images specific to their domains of expertise. In this article, we …
[PDF][PDF] Modeling Physicians' Utterances to Explore Diagnostic Decision-making.
Diagnostic error prevention is a long-established but specialized topic in clinical and
psychological research. In this paper, we contribute to the field by exploring diagnostic …
psychological research. In this paper, we contribute to the field by exploring diagnostic …
[PDF][PDF] Decision style in a clinical reasoning corpus
L Hochberg, CO Alm, EM Rantanen… - … of BioNLP 2014, 2014 - aclanthology.org
The dual process model (Evans, 2008) posits two types of decision-making, which may be
ordered on a continuum from intuitive to analytical (Hammond, 1981). This work uses a …
ordered on a continuum from intuitive to analytical (Hammond, 1981). This work uses a …
Intelligent medical image grouping through interactive learning
Image grouping in knowledge-rich domains is challenging, since domain knowledge and
human expertise are key to transform image pixels into meaningful content. Manually …
human expertise are key to transform image pixels into meaningful content. Manually …
From spoken narratives to domain knowledge: Mining linguistic data for medical image understanding
Objectives Extracting useful visual clues from medical images allowing accurate diagnoses
requires physicians' domain knowledge acquired through years of systematic study and …
requires physicians' domain knowledge acquired through years of systematic study and …
Dynamic fusion of eye movement data and verbal narrations in knowledge-rich domains
We propose to jointly analyze experts' eye movements and verbal narrations to discover
important and interpretable knowledge patterns to better understand their decision-making …
important and interpretable knowledge patterns to better understand their decision-making …
Fusing multimodal human expert data to uncover hidden semantics
Problem solving in complex visual domains involves multiple levels of cognitive processing.
Analyzing and representing these cognitive processes requires the elicitation and study of …
Analyzing and representing these cognitive processes requires the elicitation and study of …
[PDF][PDF] Using linguistic analysis to characterize conceptual units of thought in spoken medical narratives.
This study explores spoken medical narratives in which dermatologists were shown images
of dermatological conditions and asked to explain their reasoning process while working …
of dermatological conditions and asked to explain their reasoning process while working …