Statistical dialog systems (SDSs) are motivated by the need for a data-driven framework that
reduces the cost of laboriously handcrafting complex dialog managers and that provides …

Paid crowd work offers remarkable opportunities for improving productivity, social mobility,
and the global economy by engaging a geographically distributed workforce to complete …

In this paper we give an introduction to using Amazon's Mechanical Turk crowdsourcing
platform for the purpose of collecting data for human language technologies. We survey the …

Acoustic data collection for automatic speech recognition (ASR) purposes is a particularly
challenging task when working with under-resourced languages, many of which are found in …

Speech transcription is an expensive service with high turnaround time for audio files
containing languages spoken in developing countries and regional accents of well …

The development of an automatic speech recognizer is typically a highly supervised process
involving the specification of phonetic inventories, lexicons, acoustic and language models …

This paper examines the literature on the use of crowdsourcing for speech-related tasks:
speech acquisition, transcription and annotation as well as the assessment of speech …

We propose a collaborative filtering (CF) model to predict user satisfaction in SDS
evaluation. Inspired by the use of CF in recommendation systems, where a user's preference …

In this paper, we propose a two-stage transcription task design for crowdsourcing with an
automatic quality control mechanism embedded in each stage. For the first stage, a support …