A survey of controllable text generation using transformer-based pre-trained language models
Controllable Text Generation (CTG) is an emerging area in the field of natural language
generation (NLG). It is regarded as crucial for the development of advanced text generation …
generation (NLG). It is regarded as crucial for the development of advanced text generation …
Ammus: A survey of transformer-based pretrained models in natural language processing
KS Kalyan, A Rajasekharan, S Sangeetha - arXiv preprint arXiv …, 2021 - arxiv.org
Transformer-based pretrained language models (T-PTLMs) have achieved great success in
almost every NLP task. The evolution of these models started with GPT and BERT. These …
almost every NLP task. The evolution of these models started with GPT and BERT. These …
Pre-trained language models for text generation: A survey
Text Generation aims to produce plausible and readable text in human language from input
data. The resurgence of deep learning has greatly advanced this field, in particular, with the …
data. The resurgence of deep learning has greatly advanced this field, in particular, with the …
A survey of knowledge enhanced pre-trained language models
Pre-trained Language Models (PLMs) which are trained on large text corpus via self-
supervised learning method, have yielded promising performance on various tasks in …
supervised learning method, have yielded promising performance on various tasks in …
A survey of knowledge-enhanced text generation
The goal of text-to-text generation is to make machines express like a human in many
applications such as conversation, summarization, and translation. It is one of the most …
applications such as conversation, summarization, and translation. It is one of the most …
The gem benchmark: Natural language generation, its evaluation and metrics
We introduce GEM, a living benchmark for natural language Generation (NLG), its
Evaluation, and Metrics. Measuring progress in NLG relies on a constantly evolving …
Evaluation, and Metrics. Measuring progress in NLG relies on a constantly evolving …
JGLUE: Japanese general language understanding evaluation
K Kurihara, D Kawahara, T Shibata - Proceedings of the Thirteenth …, 2022 - aclanthology.org
To develop high-performance natural language understanding (NLU) models, it is
necessary to have a benchmark to evaluate and analyze NLU ability from various …
necessary to have a benchmark to evaluate and analyze NLU ability from various …
Ar-diffusion: Auto-regressive diffusion model for text generation
Diffusion models have gained significant attention in the realm of image generation due to
their exceptional performance. Their success has been recently expanded to text generation …
their exceptional performance. Their success has been recently expanded to text generation …
Compression, transduction, and creation: A unified framework for evaluating natural language generation
Natural language generation (NLG) spans a broad range of tasks, each of which serves for
specific objectives and desires different properties of generated text. The complexity makes …
specific objectives and desires different properties of generated text. The complexity makes …
Prophetnet-x: Large-scale pre-training models for english, chinese, multi-lingual, dialog, and code generation
Now, the pre-training technique is ubiquitous in natural language processing field.
ProphetNet is a pre-training based natural language generation method which shows …
ProphetNet is a pre-training based natural language generation method which shows …