In this paper, we survey the methods and concepts developed for the evaluation of dialogue
systems. Evaluation, in and of itself, is a crucial part during the development process. Often …

In this paper we discuss the recent evolution of spoken dialog systems in commercial
deployments. Yet based on a simple finite state machine design paradigm, dialog systems …

This study presents a novel expert-based approach to assess the quality of ongoing Spoken
Dialog System (SDS) interactions. We call this approach “Interaction Quality”(IQ). It is an …

Smart mobile devices have fostered new interaction scenarios that demand sophisticated
interfaces. The main developers of operating systems for such devices provide APIs for …

In this paper we propose a method for predicting the user mental state for the development
of more efficient and usable spoken dialogue systems. This prediction, carried out for each …

This paper proposes a novel approach for predicting user satisfaction transitions during a
dialogue only from the ratings given to entire dialogues, with the aim of reducing the cost of …

Abstract Ambient Assisted Living (AAL) systems must provide adapted services easily
accessible by a wide variety of users. This can only be possible if the communication …

Task-oriented dialogue systems (TODS) are continuing to rise in popularity as various
industries find ways to effectively harness their capabilities, saving both time and money …

In Monitoring Adaptive Spoken Dialog Systems, authors Alexander Schmitt and Wolfgang
Minker investigate statistical approaches that allow for recognition of negative dialog …

The automatic prediction of the quality of a dialogue is useful to keep track of a spoken
dialogue system's performance and, if necessary, adapt its behaviour. Classifiers and …