A survey of controllable text generation using transformer-based pre-trained language models
Controllable Text Generation (CTG) is an emerging area in the field of natural language
generation (NLG). It is regarded as crucial for the development of advanced text generation …
generation (NLG). It is regarded as crucial for the development of advanced text generation …
A complete survey on generative ai (aigc): Is chatgpt from gpt-4 to gpt-5 all you need?
As ChatGPT goes viral, generative AI (AIGC, aka AI-generated content) has made headlines
everywhere because of its ability to analyze and create text, images, and beyond. With such …
everywhere because of its ability to analyze and create text, images, and beyond. With such …
Language models with image descriptors are strong few-shot video-language learners
The goal of this work is to build flexible video-language models that can generalize to
various video-to-text tasks from few examples. Existing few-shot video-language learners …
various video-to-text tasks from few examples. Existing few-shot video-language learners …
Pretrained language models for text generation: A survey
Text Generation aims to produce plausible and readable text in a human language from
input data. The resurgence of deep learning has greatly advanced this field, in particular …
input data. The resurgence of deep learning has greatly advanced this field, in particular …
Galaxy: A generative pre-trained model for task-oriented dialog with semi-supervised learning and explicit policy injection
Pre-trained models have proved to be powerful in enhancing task-oriented dialog systems.
However, current pre-training methods mainly focus on enhancing dialog understanding …
However, current pre-training methods mainly focus on enhancing dialog understanding …
Evaluation of text generation: A survey
A Celikyilmaz, E Clark, J Gao - arXiv preprint arXiv:2006.14799, 2020 - arxiv.org
The paper surveys evaluation methods of natural language generation (NLG) systems that
have been developed in the last few years. We group NLG evaluation methods into three …
have been developed in the last few years. We group NLG evaluation methods into three …
TOD-BERT: Pre-trained natural language understanding for task-oriented dialogue
The underlying difference of linguistic patterns between general text and task-oriented
dialogue makes existing pre-trained language models less useful in practice. In this work …
dialogue makes existing pre-trained language models less useful in practice. In this work …
Ubar: Towards fully end-to-end task-oriented dialog system with gpt-2
This paper presents our task-oriented dialog system UBAR which models task-oriented
dialogs on a dialog session level. Specifically, UBAR is acquired by fine-tuning the large pre …
dialogs on a dialog session level. Specifically, UBAR is acquired by fine-tuning the large pre …
Recent advances and challenges in task-oriented dialog systems
Due to the significance and value in human-computer interaction and natural language
processing, task-oriented dialog systems are attracting more and more attention in both …
processing, task-oriented dialog systems are attracting more and more attention in both …
Soloist: Building Task Bots at Scale with Transfer Learning and Machine Teaching
We present a new method, Soloist, that uses transfer learning and machine teaching to build
task bots at scale. We parameterize classical modular task-oriented dialog systems using a …
task bots at scale. We parameterize classical modular task-oriented dialog systems using a …