Unsupervised real-time hallucination detection based on the internal states of large language models

W Su, C Wang, Q Ai, Y Hu, Z Wu, Y Zhou… - arXiv preprint arXiv …, 2024 - arxiv.org
Hallucinations in large language models (LLMs) refer to the phenomenon of LLMs
producing responses that are coherent yet factually inaccurate. This issue undermines the …

SeaKR: Self-aware Knowledge Retrieval for Adaptive Retrieval Augmented Generation

Z Yao, W Qi, L Pan, S Cao, L Hu, W Liu, L Hou… - arXiv preprint arXiv …, 2024 - arxiv.org
This paper introduces Self-aware Knowledge Retrieval (SeaKR), a novel adaptive RAG
model that extracts self-aware uncertainty of LLMs from their internal states. SeaKR activates …

Mitigating Entity-Level Hallucination in Large Language Models

W Su, Y Tang, Q Ai, C Wang, Z Wu, Y Liu - arXiv preprint arXiv:2407.09417, 2024 - arxiv.org
The emergence of Large Language Models (LLMs) has revolutionized how users access
information, shifting from traditional search engines to direct question-and-answer …

STARD: A Chinese Statute Retrieval Dataset with Real Queries Issued by Non-professionals

W Su, Y Hu, A Xie, Q Ai, Z Que, N Zheng, Y Liu… - arXiv preprint arXiv …, 2024 - arxiv.org
Statute retrieval aims to find relevant statutory articles for specific queries. This process is the
basis of a wide range of legal applications such as legal advice, automated judicial …

Iterative Utility Judgment Framework via LLMs Inspired by Relevance in Philosophy

H Zhang, K Bi, J Guo, X Cheng - arXiv preprint arXiv:2406.11290, 2024 - arxiv.org
Utility and topical relevance are critical measures in information retrieval (IR), reflecting
system and user perspectives, respectively. While topical relevance has long been …

TC-RAG: Turing-Complete RAG's Case study on Medical LLM Systems

X Jiang, Y Fang, R Qiu, H Zhang, Y Xu, H Chen… - arXiv preprint arXiv …, 2024 - arxiv.org
In the pursuit of enhancing domain-specific Large Language Models (LLMs), Retrieval-
Augmented Generation (RAG) emerges as a promising solution to mitigate issues such as …

A Multi-Source Retrieval Question Answering Framework Based on RAG

R Wu, S Chen, X Su, Y Zhu, Y Liao, J Wu - arXiv preprint arXiv:2405.19207, 2024 - arxiv.org
With the rapid development of large-scale language models, Retrieval-Augmented
Generation (RAG) has been widely adopted. However, existing RAG paradigms are …