Gathering response process data for a problem-solving measure through whole-class think alouds

JD Bostic, TA Sondergeld, G Matney… - Applied measurement …, 2021 - Taylor & Francis
Response process validity evidence provides a window into a respondent's cognitive
processing. The purpose of this study is to describe a new data collection tool called a whole …

Think aloud: using cognitive interviewing to validate the PISA assessment of student self-efficacy in mathematics

D Pepper, J Hodgen, K Lamesoo, P Kõiv… - International Journal of …, 2018 - Taylor & Francis
Cognitive interviewing (CI) provides a method of systematically collecting validity evidence
of response processes for questionnaire items. CI involves a range of techniques for …

[图书][B] Determining the construct validity of problem-solving performance assessments through the use of verbal protocols

JM Conner - 1999 - search.proquest.com
A review of the research literature revealed a call for the validation of performance
assessments, especially those linked to complex processes like problem-solving. The …

Think alouds: Informing scholarship and broadening partnerships through assessment

JD Bostic - Applied Measurement in Education, 2021 - Taylor & Francis
Think alouds are valuable tools for academicians, test developers, and practitioners as they
provide a unique window into a respondent's thinking during an assessment. The purpose of …

Rethinking think-alouds: The often-problematic collection of response process data

JP Leighton - Applied Measurement in Education, 2021 - Taylor & Francis
The objective of this paper is to comment on the think-aloud methods presented in the three
papers included in this special issue. The commentary offered stems from the author's own …

[PDF][PDF] Using “Think alouds” to evaluate deep understanding

L Calder, S Carlson - Proving and improving, 2004 - ERIC
“Deep understanding” is what teachers want for students. But how do we know when it has
been achieved? Are certain assessments better than others at shedding light on what …

Linking test-taking process to performance through mixed-effects regression models: A response process–based validation study

MY Chen, AD Wu, Y Liu - Journal of Psychoeducational …, 2020 - journals.sagepub.com
Answering the call for response process–based validation, this study shows how
researchers can evaluate validity evidence of test scores based on the mental “processes” …

[图书][B] Using think-aloud interviews and cognitive labs in educational research

JP Leighton - 2017 - books.google.com
The field of education is rife with calls to action and for research to improve higher-level
thinking and learning outcomes in primary, secondary, and tertiary education. With the No …

Using Think Aloud Interviews in Evidence-Centered Assessment Design for the AP World History Exam.

P Kaliski, M France, K Huff, A Thurber - College Board, 2011 - ERIC
Developing a cognitive model of task performance is an important and often overlooked
phase in assessment design; failing to establish such a model can threaten the validity of the …

[PDF][PDF] The applicability of the cognitive laboratory method to the development of achievement test items

CA Paulsen, R Levine - annual meeting of the American Educational …, 1999 - Citeseer
This study explores the utility of the cognitive laboratory, and specifically the think aloud
technique, for the development of achievement test items in 4th grade reading and 8th grade …