[HTML][HTML] Conversational agents: Goals, technologies, vision and challenges

M Allouch, A Azaria, R Azoulay - Sensors, 2021 - mdpi.com
In recent years, conversational agents (CAs) have become ubiquitous and are a presence in
our daily routines. It seems that the technology has finally ripened to advance the use of CAs …

[HTML][HTML] Survey on evaluation methods for dialogue systems

J Deriu, A Rodrigo, A Otegi, G Echegoyen… - Artificial Intelligence …, 2021 - Springer
In this paper, we survey the methods and concepts developed for the evaluation of dialogue
systems. Evaluation, in and of itself, is a crucial part during the development process. Often …

Conversational ai: The science behind the alexa prize

A Ram, R Prasad, C Khatri, A Venkatesh… - arXiv preprint arXiv …, 2018 - arxiv.org
Conversational agents are exploding in popularity. However, much work remains in the area
of social conversation as well as free-form conversation over a broad range of domains and …

What makes a good conversation? how controllable attributes affect human judgments

A See, S Roller, D Kiela, J Weston - arXiv preprint arXiv:1902.08654, 2019 - arxiv.org
A good conversation requires balance--between simplicity and detail; staying on topic and
changing it; asking questions and answering them. Although dialogue agents are commonly …

Alexa prize—state of the art in conversational AI

C Khatri, A Venkatesh, B Hedayatnia, R Gabriel, A Ram… - AI magazine, 2018 - ojs.aaai.org
To advance the state of the art in conversational AI, Amazon launched the Alexa Prize, a 2.5
million dollar competition that challenges university teams to build conversational agents, or" …

Unsupervised evaluation of interactive dialog with DialoGPT

S Mehri, M Eskenazi - arXiv preprint arXiv:2006.12719, 2020 - arxiv.org
It is important to define meaningful and interpretable automatic evaluation metrics for open-
domain dialog research. Standard language generation metrics have been shown to be …

A comprehensive assessment of dialog evaluation metrics

YT Yeh, M Eskenazi, S Mehri - arXiv preprint arXiv:2106.03706, 2021 - arxiv.org
Automatic evaluation metrics are a crucial component of dialog systems research. Standard
language evaluation metrics are known to be ineffective for evaluating dialog. As such …

Survey on intelligent chatbots: State-of-the-art and future research directions

EH Almansor, FK Hussain - … Intensive Systems: Proceedings of the 13th …, 2020 - Springer
Human-computer interaction (HCI) is an area of interest which plays a major role in
understanding the interaction between humans and machines. Dialogue systems or …

Designing effective interview chatbots: Automatic chatbot profiling and design suggestion generation for chatbot debugging

X Han, M Zhou, MJ Turner, T Yeh - … of the 2021 CHI Conference on …, 2021 - dl.acm.org
Recent studies show the effectiveness of interview chatbots for information elicitation.
However, designing an effective interview chatbot is non-trivial. Few tools exist to help …

# MeToo Alexa: how conversational systems respond to sexual harassment

AC Curry, V Rieser - Proceedings of the second acl workshop on …, 2018 - aclanthology.org
Conversational AI systems, such as Amazon's Alexa, are rapidly developing from purely
transactional systems to social chatbots, which can respond to a wide variety of user …