Applications of text analysis tools for spoken response grading.

S Crossley, D McNamara - Language Learning & Technology, 2013 - ERIC
This study explores the potential for automated indices related to speech delivery, language
use, and topic development to model human judgments of TOEFL speaking proficiency in …

Exploring relationships between automated and human evaluations of L2 texts

J Matthews, I Wijeyewardene - 2018 - scholarspace.manoa.hawaii.edu
Despite the current potential to use computers to automatically generate a large range of text-
based indices, many issues remain unresolved about how to apply these data in established …

Logic and validation of a fully automatic spoken English test

J Bernstein, J Cheng - The path of speech technologies in …, 2008 - taylorfrancis.com
Skillful performance in a human language often involves a composite of elementary skills,
such that language skills, cognitive skills, and social skills can be conflated in the judgment …

[PDF][PDF] Exploring content features for automated speech scoring

S Xie, K Evanini, K Zechner - … of the 2012 conference of the North …, 2012 - aclanthology.org
Most previous research on automated speech scoring has focused on restricted, predictable
speech. For automated scoring of unrestricted spontaneous speech, speech proficiency has …

[PDF][PDF] Modeling Discourse Coherence for the Automated Scoring of Spontaneous Spoken Responses.

X Wang, K Evanini, K Zechner, M Mulholland - SLaTE, 2017 - isca-archive.org
This study describes an approach for modeling the discourse coherence of spontaneous
spoken responses in the context of automated assessment of non-native speech. Although …

[PDF][PDF] Developing an evaluation methodology for spoken language systems

M Bates, S Boisen, J Makhoul - … of a Workshop Held at Hidden …, 1990 - aclanthology.org
There has been a long-standing methodology for evaluating work in speech recognition
(SR), but until recently no community-wide methodology existed for either natural language …

Predicting the proficiency level of language learners using lexical indices

SA Crossley, T Salsbury, DS McNamara - Language testing, 2012 - journals.sagepub.com
This study explores how second language (L2) texts written by learners at various
proficiency levels can be classified using computational indices that characterize lexical …

What is lexical proficiency? Some answers from computational models of speech data

SA Crossley, T Salsbury, DS McNamara, S Jarvis - Tesol Quarterly, 2011 - JSTOR
■ Lexical proficiency, as a cognitive construct, is poorly understood. However, lexical
proficiency is an important element of language proficiency and fluency, especially for …

Construct validity in TOEFL iBT speaking tasks: Insights from natural language processing

K Kyle, SA Crossley, DS McNamara - Language Testing, 2016 - journals.sagepub.com
This study explores the construct validity of speaking tasks included in the TOEFL iBT (eg,
integrated and independent speaking tasks). Specifically, advanced natural language …

[PDF][PDF] Prompt-based content scoring for automated spoken language assessment

K Evanini, S Xie, K Zechner - … of the eighth workshop on innovative …, 2013 - aclanthology.org
This paper investigates the use of promptbased content features for the automated
assessment of spontaneous speech in a spoken language proficiency assessment. The …