Siren's song in the AI ocean: a survey on hallucination in large language models

Y Zhang, Y Li, L Cui, D Cai, L Liu, T Fu… - arXiv preprint arXiv …, 2023 - arxiv.org
While large language models (LLMs) have demonstrated remarkable capabilities across a
range of downstream tasks, a significant concern revolves around their propensity to exhibit …

Towards reasoning in large language models: A survey

J Huang, KCC Chang - arXiv preprint arXiv:2212.10403, 2022 - arxiv.org
Reasoning is a fundamental aspect of human intelligence that plays a crucial role in
activities such as problem solving, decision making, and critical thinking. In recent years …

Large language models cannot self-correct reasoning yet

J Huang, X Chen, S Mishra, HS Zheng, AW Yu… - arXiv preprint arXiv …, 2023 - arxiv.org
Large Language Models (LLMs) have emerged as a groundbreaking technology with their
unparalleled text generation capabilities across various applications. Nevertheless …

Are Emergent Abilities in Large Language Models just In-Context Learning?

S Lu, I Bigoulaeva, R Sachdeva, HT Madabushi… - arXiv preprint arXiv …, 2023 - arxiv.org
Large language models have exhibited emergent abilities, demonstrating exceptional
performance across diverse tasks for which they were not explicitly trained, including those …

Alignment for honesty

Y Yang, E Chern, X Qiu, G Neubig, P Liu - arXiv preprint arXiv:2312.07000, 2023 - arxiv.org
Recent research has made significant strides in applying alignment techniques to enhance
the helpfulness and harmlessness of large language models (LLMs) in accordance with …

Citation: A key to building responsible and accountable large language models

J Huang, KCC Chang - arXiv preprint arXiv:2307.02185, 2023 - arxiv.org
Large Language Models (LLMs) bring transformative benefits alongside unique challenges,
including intellectual property (IP) and ethical concerns. This position paper explores a …

Lilac: Log parsing using llms with adaptive parsing cache

Z Jiang, J Liu, Z Chen, Y Li, J Huang, Y Huo… - Proceedings of the …, 2024 - dl.acm.org
Log parsing transforms log messages into structured formats, serving as the prerequisite
step for various log analysis tasks. Although a variety of log parsing approaches have been …

Raven: In-context learning with retrieval augmented encoder-decoder language models

J Huang, W Ping, P Xu, M Shoeybi, KCC Chang… - arXiv preprint arXiv …, 2023 - arxiv.org
In this paper, we investigate the in-context learning ability of retrieval-augmented encoder-
decoder language models. We first conduct a comprehensive analysis of the state-of-the-art …

The Hitchhiker's Guide to Program Analysis: A Journey with Large Language Models

H Li, Y Hao, Y Zhai, Z Qian - arXiv preprint arXiv:2308.00245, 2023 - arxiv.org
Static analysis is a widely used technique in software engineering for identifying and
mitigating bugs. However, a significant hurdle lies in achieving a delicate balance between …

Alleviating hallucinations of large language models through induced hallucinations

Y Zhang, L Cui, W Bi, S Shi - arXiv preprint arXiv:2312.15710, 2023 - arxiv.org
Despite their impressive capabilities, large language models (LLMs) have been observed to
generate responses that include inaccurate or fabricated information, a phenomenon …