Look before you leap: An exploratory study of uncertainty measurement for large language models

Y Huang, J Song, Z Wang, S Zhao, H Chen… - arXiv preprint arXiv …, 2023 - arxiv.org
… to be of great importance with the potential wide-range applications of LLMs across … we
initiate an early exploratory study of the risk assessment of LLMs from the lens of uncertainty

Look Before You Leap: An Exploratory Study of Uncertainty Analysis for Large Language Models

Y Huang, J Song, Z Wang, S Zhao… - IEEE Transactions …, 2025 - ieeexplore.ieee.org
… to be of great importance with the potential wide-range applications of LLMs across … we
initiate an early exploratory study of the risk assessment of LLMs from the lens of uncertainty

Improving the Reliability of Large Language Models by Leveraging Uncertainty-Aware In-Context Learning

Y Yang, H Li, Y Wang, Y Wang - arXiv preprint arXiv:2310.04782, 2023 - arxiv.org
… in Lagre Language Models (LLM), we present an innovative framework known as
Uncertainty-Aware … linguistic fluency while endowing it with the capability to adapt responses …

A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directions

…, Z Mei, J Lidard, AZ Ren, A Majumdar - arXiv preprint arXiv …, 2024 - arxiv.org
… Furthermore, we highlight applications of uncertainty quantification … We conclude with open
research challenges in uncertainty quantification of LLMs, seeking to motivate future research

CLUE: Concept-Level Uncertainty Estimation for Large Language Models

YH Wang, A Bai, CP Tsai, CJ Hsieh - arXiv preprint arXiv:2409.03021, 2024 - arxiv.org
… In this paper, we focus on utilizing concept-level uncertainty to detect hallu… uncertainty in
outputs suggests hallucination, we examine the correlation between the concept uncertainty U(cj…

Large Language Model Uncertainty Measurement and Calibration for Medical Diagnosis and Treatment

…, A Boukil, V Patel, SA Ahmad Safavi-Naini, A Soroush… - medRxiv, 2024 - medrxiv.org
… of Large Language Models (LLMs) to communicate uncertainty is a significant barrier to
their use in medicine. Before … to measure uncertainty in ways that are useful to physician-users. …

Understanding the Relationship between Prompts and Response Uncertainty in Large Language Models

ZY Zhang, A Verma, F Doshi-Velez… - arXiv preprint arXiv …, 2024 - arxiv.org
… Our PRC modeluncertainty by measuring response uncertainty for prompts with varying
information about the task. We provide theoretical results that show that the uncertainty of …

Guiding Reinforcement Learning Using Uncertainty-Aware Large Language Models

M Shoaeinaeini, B Harrison - arXiv preprint arXiv:2411.14457, 2024 - arxiv.org
Look before you leap: An exploratory study of uncertainty measurement for large language
models. arXiv preprint arXiv:2307.10236 (2023). [22] Kathleen M Jagodnik, Philip S Thomas, …

Semantic density: Uncertainty quantification for large language models through confidence measurement in semantic space

X Qiu, R Miikkulainen - The Thirty-eighth Annual Conference on …, 2024 - openreview.net
… With the widespread application of Large Language Models (LLMs) to various domains,
con… [17] perform an explorative study using simple baselines on uncertainty measurement for …

Large language model uncertainty proxies: discrimination and calibration for medical diagnosis and treatment

T Savage, J Wang, R Gallo, A Boukil… - Journal of the …, 2025 - academic.oup.com
… of large language models (LLMs) to communicate uncertainty is a significant barrier to their
use in medicine. Before … properties to consider when evaluating LLM uncertainty proxies for …