Assessing speaking proficiency: a narrative review of speaking assessment research within the argument-based validation framework

J Fan, X Yan - Frontiers in psychology, 2020 - frontiersin.org
This paper provides a narrative review of empirical research on the assessment of speaking
proficiency published in selected journals in the field of language assessment. A total of 104 …

Validation of rating processes within an argument-based framework

U Knoch, CA Chapelle - Language Testing, 2018 - journals.sagepub.com
Argument-based validation requires test developers and researchers to specify what is
entailed in test interpretation and use. Doing so has been shown to yield advantages …

Fluency in language assessment

A Huhta, H Kallio, S Ohranen… - Fluency in L2 learning and …, 2019 - degruyter.com
Fluency is one of the most commonly used dimensions of proficiency in the assessment of
foreign and second language (L2) oral skills. However, as is the case with many other …

Revisiting rating scale development for rater-mediated language performance assessments: Modelling construct and contextual choices made by scale developers

U Knoch, B Deygers… - Language Testing, 2021 - journals.sagepub.com
Rating scale development in the field of language assessment is often considered in
dichotomous ways: It is assumed to be guided either by expert intuition or by drawing on …

Comparing two formats of data-driven rating scales for classroom assessment of pragmatic performance with roleplays

Y Su, SY Shin - Language Testing, 2024 - journals.sagepub.com
Rating scales that language testers design should be tailored to the specific test purpose
and score use as well as reflect the target construct. Researchers have long argued for the …

The impact of pre-task planning on speaking test performance for English-medium university admission

S O'Grady - Language Testing, 2019 - journals.sagepub.com
This study investigated the impact of different lengths of pre-task planning time on
performance in a test of second language speaking ability for university admission. In the …

Experienced but detached from reality: Theorizing and operationalizing the relationship between experience and rater effects

I Lamprianou, D Tsagari, N Kyriakou - Assessing Writing, 2023 - Elsevier
It is often argued that, to achieve a high quality of rating in writing assessment, it is important
to nurture a comprehensive measurement ecosystem involving experienced raters and …

Raters' perceptions of rating scales criteria and its effect on the process and outcome of their rating

N Heidari, N Ghanbari, A Abbasi - Language Testing in Asia, 2022 - Springer
It is widely believed that human rating performance is influenced by an array of different
factors. Among these, rater-related variables such as experience, language background …

Investigating and optimizing score dependability of a local ITA speaking test across language groups: A generalizability theory approach

J Shin - Language testing, 2022 - journals.sagepub.com
With the present study I investigated the sources of score variance and dependability in a
local oral English proficiency test for potential international teaching assistants (ITAs) across …

L2 speaking assessment in secondary school classrooms in Japan

R Koizumi - Language Assessment Quarterly, 2022 - Taylor & Francis
In Japanese secondary schools, speaking assessment in English classrooms is designed,
conducted, and scored by teachers. Although the assessment is intended to be used for …