Survey of hallucination in natural language generation

Z Ji, N Lee, R Frieske, T Yu, D Su, Y Xu, E Ishii… - ACM Computing …, 2023 - dl.acm.org
Natural Language Generation (NLG) has improved exponentially in recent years thanks to
the development of sequence-to-sequence deep learning technologies such as Transformer …

On the opportunities and challenges of foundation models for geospatial artificial intelligence

G Mai, W Huang, J Sun, S Song, D Mishra… - arXiv preprint arXiv …, 2023 - arxiv.org
Large pre-trained models, also known as foundation models (FMs), are trained in a task-
agnostic manner on large-scale data and can be adapted to a wide range of downstream …

Trustworthy LLMs: A survey and guideline for evaluating large language models' alignment

Y Liu, Y Yao, JF Ton, X Zhang, RGH Cheng… - arXiv preprint arXiv …, 2023 - arxiv.org
Ensuring alignment, which refers to making models behave in accordance with human
intentions [1, 2], has become a critical task before deploying large language models (LLMs) …

KILT: a benchmark for knowledge intensive language tasks

F Petroni, A Piktus, A Fan, P Lewis, M Yazdani… - arXiv preprint arXiv …, 2020 - arxiv.org
Challenging problems such as open-domain question answering, fact checking, slot filling
and entity linking require access to large, external knowledge sources. While some models …

A survey of knowledge-enhanced text generation

W Yu, C Zhu, Z Li, Z Hu, Q Wang, H Ji… - ACM Computing …, 2022 - dl.acm.org
The goal of text-to-text generation is to make machines express like a human in many
applications such as conversation, summarization, and translation. It is one of the most …

Dart: Open-domain structured data record to text generation

L Nan, D Radev, R Zhang, A Rau, A Sivaprasad… - arXiv preprint arXiv …, 2020 - arxiv.org
We present DART, an open domain structured DAta Record to Text generation dataset with
over 82k instances (DARTs). Data-to-Text annotations can be a costly process, especially …

Dynamic neuro-symbolic knowledge graph construction for zero-shot commonsense question answering

A Bosselut, R Le Bras, Y Choi - Proceedings of the AAAI conference on …, 2021 - ojs.aaai.org
Understanding narratives requires reasoning about implicit world knowledge related to the
causes, effects, and states of situations described in text. At the core of this challenge is how …

Leveraging graph to improve abstractive multi-document summarization

W Li, X Xiao, J Liu, H Wu, H Wang, J Du - arXiv preprint arXiv:2005.10043, 2020 - arxiv.org
Graphs that capture relations between textual units have great benefits for detecting salient
information from multiple documents and generating overall coherent summaries. In this …

Knowledge graph-augmented abstractive summarization with semantic-driven cloze reward

L Huang, L Wu, L Wang - arXiv preprint arXiv:2005.01159, 2020 - arxiv.org
Sequence-to-sequence models for abstractive summarization have been studied
extensively, yet the generated summaries commonly suffer from fabricated content, and are …

Structure-aware abstractive conversation summarization via discourse and action graphs

J Chen, D Yang - arXiv preprint arXiv:2104.08400, 2021 - arxiv.org
Abstractive conversation summarization has received much attention recently. However,
these generated summaries often suffer from insufficient, redundant, or incorrect content …