Background Digital‐first assessments leverage the affordances of technology in all elements
of the assessment process: from design and development to score reporting and evaluation …

Automatic item generation (AIG) has the potential to greatly expand the number of items for
educational assessments, while simultaneously allowing for a more construct-driven …

This paper reports findings from the First Shared Task on Automated Prediction of Difficulty
and Response Time for Multiple-Choice Questions. The task was organized as part of the …

Abstract The Duolingo English Test Technical Manual provides an overview of the design,
development, administration, and scoring of the Duolingo English Test. Furthermore, the …

In light of the widespread adoption of technology-enhanced learning and assessment
platforms, there is a growing demand for innovative, high-quality, and diverse assessment …

In the past few years, our lives have changed due to the COVID-19 pandemic; many of these
changes resulted in pivoting our activities to a virtual environment, forcing many of us out of …

The remarkable strides in artificial intelligence (AI), exemplified by ChatGPT, have unveiled
a wealth of opportunities and challenges in assessment. Applying cutting‐edge large …

This paper presents the first multi-objective transformer model for constructing open cloze
tests that exploits generation and discrimination capabilities to improve performance. Our …

Language tests measure a person's ability to use a language in terms of listening, speaking,
reading, or writing. Such tests play an integral role in academic, professional, and …

Item response theory (IRT) is a class of interpretable factor models that are widely used in
computerized adaptive tests (CATs), such as language proficiency tests. Traditionally, these …