Rethinking think-alouds: The often-problematic collection of response process data

JP Leighton - Applied Measurement in Education, 2021 - Taylor & Francis
The objective of this paper is to comment on the think-aloud methods presented in the three
papers included in this special issue. The commentary offered stems from the author's own …

Response processes and validity evidence: Controlling for emotions in think aloud interviews

JP Leighton, W Tang, Q Guo - Understanding and investigating response …, 2017 - Springer
The objective of the chapter is to highlight the potentially problematic effects that emotional
variables and, in particular, evaluative anxiety may have on response processing data …

Item difficulty and interviewer knowledge effects on the accuracy and consistency of examinee response processes in verbal reports

JP Leighton - Applied Measurement in Education, 2013 - Taylor & Francis
The Standards for Educational and Psychological Testing indicate that multiple sources of
validity evidence should be used to support the interpretation of test scores. In the past …

'Hallelujah, very!'responding to 'very'in questionnaire items

G Low - Evaluation & Research in Education, 1995 - Taylor & Francis
This paper explores one of the claims reported in Gaskell et al.(1993), that respondents do
not attend to, or make use of, the intensifier very in survey questions. It argues that Think …

Using 'thinking aloud'to investigate judgements about A-level standards: Does verbalising thoughts result in different decisions?

J Greatorex, R Nadas - 2009 - repository.cam.ac.uk
The'think aloud'method entails people verbalising their thoughts while they do tasks,
resulting in'verbal protocols'. The verbal protocols are analysed by researchers to identify …

Cognitive interviewing and think aloud methods

JL Padilla, JP Leighton - Understanding and investigating response …, 2017 - Springer
There are no clear recommendations, best practices, or enough experience in validation
studies aimed at obtaining validity evidence using response processes. Cognitive …

Validity evidence based on response processes

JL Padilla García, I Benítez Baena - 2014 - digibug.ugr.es
Background: Validity evidence based on response processes was first introduced explicitly
as a source of validity evidence in the latest edition of Standards for Educational and …

[PDF][PDF] From impressions to data: Increasing the objectivity of cognitive interviews

F Conrad, J Blair - Proceedings of the section on survey research …, 1996 - Citeseer
The most tangible result of the dialogue between survey methods research and cognitive
psychology is the widespread use of think aloud methods for pre-testing questionnaires--so …

Gathering response process data for a problem-solving measure through whole-class think alouds

JD Bostic, TA Sondergeld, G Matney… - Applied measurement …, 2021 - Taylor & Francis
Response process validity evidence provides a window into a respondent's cognitive
processing. The purpose of this study is to describe a new data collection tool called a whole …

Think-aloud and thought-list procedures in investigating mental processes

MA Shapiro - Measuring psychological responses to media …, 2014 - api.taylorfrancis.com
Think-aloud and thought-list techniques ask a subject to report all his or her thoughts while
doing some task. The goal is to “increase the temporal density of observations of [mental] …