Abstract Evaluation practices in natural language generation (NLG) have many known flaws,
but improved evaluation approaches are rarely widely adopted. This issue has become …

In recent years some researchers have explored the use of reinforcement learning (RL)
algorithms as key components in the solution of various natural language processing (NLP) …

To promote the research and development of dialogue breakdown detection for dialogue
systems, we have been organizing a series of dialogue breakdown detection challenges to …

We observe a severe under-reporting of the different kinds of errors that Natural Language
Generation systems make. This is a problem, because mistakes are an important indicator of …

This paper describes the experimental setups and the evaluation results of the sixth Dialog
System Technology Challenges (DSTC6) aiming to develop end-to-end dialogue systems …

We give an overview of the NII Testbeds and Community for Information access Research
(NTCIR)-13 Short Text Conversation (STC) task, which was a core task of NTCIR-13. At …

This paper proposes a taxonomy of errors in chat-oriented dialogue systems. Previously, two
taxonomies were proposed; one is theory-driven and the other data-driven. The former …

Conversational interfaces are increasingly popular as a way of connecting people to
information. With the increased generative capacity of corpus‐based conversational agents …

This paper describes a novel annotation scheme specifically designed for a customer-
service context where written interactions take place between a given user and the chatbot …

Chatbot is increasingly thriving in different domains, however, because of unexpected
discourse complexity and training data sparseness, its potential distrust hatches vital …