Rater cognition: review and integration of research findings

G Gauthier, C St‐Onge, W Tavares - Medical education, 2016 - Wiley Online Library
Background Given the complexity of competency frameworks, associated skills and abilities,
and contexts in which they are to be assessed in competency‐based education (CBE), there …

Factors influencing mini-CEX rater judgments and their practical implications: a systematic literature review

V Lee, K Brain, J Martin - Academic Medicine, 2017 - journals.lww.com
Purpose At present, little is known about how mini-clinical evaluation exercise (mini-CEX)
raters translate their observations into judgments and ratings. The authors of this systematic …

Performance assessment: Consensus statement and recommendations from the 2020 Ottawa Conference

K Boursicot, S Kemp, T Wilkinson, A Findyartini… - Medical …, 2021 - Taylor & Francis
Abstract Introduction In 2011 the Consensus Statement on Performance Assessment was
published in Medical Teacher. That paper was commissioned by AMEE (Association for …

Cognitive influences on complex performance assessment: lessons from the interplay between medicine and psychology

KW Eva - Journal of Applied Research in Memory and Cognition, 2018 - Elsevier
The assessment of healthcare professionals is a critical determinant of patient safety and
healthcare quality, playing both a gatekeeping function and a path toward performance …

Inter-rater variability as mutual disagreement: identifying raters' divergent points of view

A Gingerich, SE Ramlo, CPM van der Vleuten… - Advances in Health …, 2017 - Springer
Whenever multiple observers provide ratings, even of the same performance, inter-rater
variation is prevalent. The resulting 'idiosyncratic rater variance'is considered to be unusable …

Managing extremes of assessor judgment within the OSCE

R Fuller, M Homer, G Pell, J Hallam - Medical Teacher, 2017 - Taylor & Francis
Context: There is a growing body of research investigating assessor judgments in complex
performance environments such as OSCE examinations. Post hoc analysis can be …

A randomised trial of the influence of racial stereotype bias on examiners' scores, feedback and recollections in undergraduate clinical exams

P Yeates, K Woolf, E Benbow, B Davies, M Boohan… - Bmc Medicine, 2017 - Springer
Background Asian medical students and doctors receive lower scores on average than their
white counterparts in examinations in the UK and internationally (a phenomenon known as …

Examiners' decision‐making processes in observation‐based clinical examinations

BS Malau‐Aduli, RB Hays, K D'Souza… - Medical …, 2021 - Wiley Online Library
Background Objective structured clinical examinations (OSCEs) are commonly used to
assess the clinical skills of health professional students. Examiner judgement is one …

From opening the 'black box'to looking behind the curtain: cognition and context in assessor-based judgements

V Lee, K Brain, J Martin - Advances in Health Sciences Education, 2019 - Springer
The increasing use of direct observation tools to assess routine performance has resulted in
the growing reliance on assessor-based judgements in the workplace. However, we have a …

Advancing our understanding of narrative comments generated by direct observation tools: lessons from the psychopharmacotherapy-structured clinical observation

JQ Young, R Sugarman, E Holmboe… - Journal of Graduate …, 2019 - meridian.allenpress.com
Background While prior research has focused on the validity of quantitative ratings
generated by direct observation tools, much less is known about the written comments …