" Do you follow me?": A Survey of Recent Approaches in Dialogue State Tracking

L Jacqmin, LM Rojas-Barahona, B Favre - arXiv preprint arXiv:2207.14627, 2022 - arxiv.org
While communicating with a user, a task-oriented dialogue system has to track the user's
needs at each turn according to the conversation history. This process called dialogue state …

Language models are few-shot multilingual learners

GI Winata, A Madotto, Z Lin, R Liu, J Yosinski… - arXiv preprint arXiv …, 2021 - arxiv.org
General-purpose language models have demonstrated impressive capabilities, performing
on par with state-of-the-art approaches on a range of downstream natural language …

Continual learning in task-oriented dialogue systems

A Madotto, Z Lin, Z Zhou, S Moon, P Crook… - arXiv preprint arXiv …, 2020 - arxiv.org
Continual learning in task-oriented dialogue systems can allow us to add new domains and
functionalities through time without incurring the high cost of a whole system retraining. In …

Unified dialog model pre-training for task-oriented dialog understanding and generation

W He, Y Dai, M Yang, J Sun, F Huang, L Si… - Proceedings of the 45th …, 2022 - dl.acm.org
Recently, pre-training methods have shown remarkable success in task-oriented dialog
(TOD) systems. However, most existing pre-trained models for TOD focus on either dialog …

NusaX: Multilingual parallel sentiment dataset for 10 Indonesian local languages

GI Winata, AF Aji, S Cahyawijaya, R Mahendra… - arXiv preprint arXiv …, 2022 - arxiv.org
Natural language processing (NLP) has a significant impact on society via technologies
such as machine translation and search engines. Despite its success, NLP technology is …

One country, 700+ languages: NLP challenges for underrepresented languages and dialects in Indonesia

AF Aji, GI Winata, F Koto, S Cahyawijaya… - arXiv preprint arXiv …, 2022 - arxiv.org
NLP research is impeded by a lack of resources and awareness of the challenges presented
by underrepresented languages and dialects. Focusing on the languages spoken in …

Few-shot bot: Prompt-based learning for dialogue systems

A Madotto, Z Lin, GI Winata, P Fung - arXiv preprint arXiv:2110.08118, 2021 - arxiv.org
Learning to converse using only a few examples is a great challenge in conversational AI.
The current best conversational models, which are either good chit-chatters (eg, BlenderBot) …

[HTML][HTML] Multi 3 WOZ: A Multilingual, Multi-Domain, Multi-Parallel Dataset for Training and Evaluating Culturally Adapted Task-Oriented Dialog Systems

S Hu, H Zhou, M Hergul, M Gritta, G Zhang… - Transactions of the …, 2023 - direct.mit.edu
Creating high-quality annotated data for task-oriented dialog (ToD) is known to be
notoriously difficult, and the challenges are amplified when the goal is to create equitable …

Zero-shot dialogue state tracking via cross-task transfer

Z Lin, B Liu, A Madotto, S Moon, P Crook… - arXiv preprint arXiv …, 2021 - arxiv.org
Zero-shot transfer learning for dialogue state tracking (DST) enables us to handle a variety
of task-oriented dialogue domains without the expense of collecting in-domain data. In this …

Space-2: Tree-structured semi-supervised contrastive pre-training for task-oriented dialog understanding

W He, Y Dai, B Hui, M Yang, Z Cao, J Dong… - arXiv preprint arXiv …, 2022 - arxiv.org
Pre-training methods with contrastive learning objectives have shown remarkable success
in dialog understanding tasks. However, current contrastive learning solely considers the …