Rater cognition: review and integration of research findings
Background Given the complexity of competency frameworks, associated skills and abilities,
and contexts in which they are to be assessed in competency‐based education (CBE), there …
and contexts in which they are to be assessed in competency‐based education (CBE), there …
Factors influencing mini-CEX rater judgments and their practical implications: a systematic literature review
V Lee, K Brain, J Martin - Academic Medicine, 2017 - journals.lww.com
Purpose At present, little is known about how mini-clinical evaluation exercise (mini-CEX)
raters translate their observations into judgments and ratings. The authors of this systematic …
raters translate their observations into judgments and ratings. The authors of this systematic …
Performance assessment: Consensus statement and recommendations from the 2020 Ottawa Conference
K Boursicot, S Kemp, T Wilkinson, A Findyartini… - Medical …, 2021 - Taylor & Francis
Abstract Introduction In 2011 the Consensus Statement on Performance Assessment was
published in Medical Teacher. That paper was commissioned by AMEE (Association for …
published in Medical Teacher. That paper was commissioned by AMEE (Association for …
Cognitive influences on complex performance assessment: lessons from the interplay between medicine and psychology
KW Eva - Journal of Applied Research in Memory and Cognition, 2018 - Elsevier
The assessment of healthcare professionals is a critical determinant of patient safety and
healthcare quality, playing both a gatekeeping function and a path toward performance …
healthcare quality, playing both a gatekeeping function and a path toward performance …
Inter-rater variability as mutual disagreement: identifying raters' divergent points of view
Whenever multiple observers provide ratings, even of the same performance, inter-rater
variation is prevalent. The resulting 'idiosyncratic rater variance'is considered to be unusable …
variation is prevalent. The resulting 'idiosyncratic rater variance'is considered to be unusable …
Managing extremes of assessor judgment within the OSCE
R Fuller, M Homer, G Pell, J Hallam - Medical Teacher, 2017 - Taylor & Francis
Context: There is a growing body of research investigating assessor judgments in complex
performance environments such as OSCE examinations. Post hoc analysis can be …
performance environments such as OSCE examinations. Post hoc analysis can be …
A randomised trial of the influence of racial stereotype bias on examiners' scores, feedback and recollections in undergraduate clinical exams
Background Asian medical students and doctors receive lower scores on average than their
white counterparts in examinations in the UK and internationally (a phenomenon known as …
white counterparts in examinations in the UK and internationally (a phenomenon known as …
Examiners' decision‐making processes in observation‐based clinical examinations
Background Objective structured clinical examinations (OSCEs) are commonly used to
assess the clinical skills of health professional students. Examiner judgement is one …
assess the clinical skills of health professional students. Examiner judgement is one …
From opening the 'black box'to looking behind the curtain: cognition and context in assessor-based judgements
V Lee, K Brain, J Martin - Advances in Health Sciences Education, 2019 - Springer
The increasing use of direct observation tools to assess routine performance has resulted in
the growing reliance on assessor-based judgements in the workplace. However, we have a …
the growing reliance on assessor-based judgements in the workplace. However, we have a …
Advancing our understanding of narrative comments generated by direct observation tools: lessons from the psychopharmacotherapy-structured clinical observation
JQ Young, R Sugarman, E Holmboe… - Journal of Graduate …, 2019 - meridian.allenpress.com
Background While prior research has focused on the validity of quantitative ratings
generated by direct observation tools, much less is known about the written comments …
generated by direct observation tools, much less is known about the written comments …