Look before you leap: An exploratory study of uncertainty measurement for large language models
… to be of great importance with the potential wide-range applications of LLMs across … we
initiate an early exploratory study of the risk assessment of LLMs from the lens of uncertainty…
initiate an early exploratory study of the risk assessment of LLMs from the lens of uncertainty…
Look Before You Leap: An Exploratory Study of Uncertainty Analysis for Large Language Models
… to be of great importance with the potential wide-range applications of LLMs across … we
initiate an early exploratory study of the risk assessment of LLMs from the lens of uncertainty…
initiate an early exploratory study of the risk assessment of LLMs from the lens of uncertainty…
Improving the Reliability of Large Language Models by Leveraging Uncertainty-Aware In-Context Learning
Y Yang, H Li, Y Wang, Y Wang - arXiv preprint arXiv:2310.04782, 2023 - arxiv.org
… in Lagre Language Models (LLM), we present an innovative framework known as
Uncertainty-Aware … linguistic fluency while endowing it with the capability to adapt responses …
Uncertainty-Aware … linguistic fluency while endowing it with the capability to adapt responses …
A Survey on Uncertainty Quantification of Large Language Models: Taxonomy, Open Research Challenges, and Future Directions
… Furthermore, we highlight applications of uncertainty quantification … We conclude with open
research challenges in uncertainty quantification of LLMs, seeking to motivate future research…
research challenges in uncertainty quantification of LLMs, seeking to motivate future research…
CLUE: Concept-Level Uncertainty Estimation for Large Language Models
… In this paper, we focus on utilizing concept-level uncertainty to detect hallu… uncertainty in
outputs suggests hallucination, we examine the correlation between the concept uncertainty U(cj…
outputs suggests hallucination, we examine the correlation between the concept uncertainty U(cj…
Large Language Model Uncertainty Measurement and Calibration for Medical Diagnosis and Treatment
…, A Boukil, V Patel, SA Ahmad Safavi-Naini, A Soroush… - medRxiv, 2024 - medrxiv.org
… of Large Language Models (LLMs) to communicate uncertainty is a significant barrier to
their use in medicine. Before … to measure uncertainty in ways that are useful to physician-users. …
their use in medicine. Before … to measure uncertainty in ways that are useful to physician-users. …
Understanding the Relationship between Prompts and Response Uncertainty in Large Language Models
… Our PRC model … uncertainty by measuring response uncertainty for prompts with varying
information about the task. We provide theoretical results that show that the uncertainty of …
information about the task. We provide theoretical results that show that the uncertainty of …
Guiding Reinforcement Learning Using Uncertainty-Aware Large Language Models
M Shoaeinaeini, B Harrison - arXiv preprint arXiv:2411.14457, 2024 - arxiv.org
… Look before you leap: An exploratory study of uncertainty measurement for large language
models. arXiv preprint arXiv:2307.10236 (2023). [22] Kathleen M Jagodnik, Philip S Thomas, …
models. arXiv preprint arXiv:2307.10236 (2023). [22] Kathleen M Jagodnik, Philip S Thomas, …
Semantic density: Uncertainty quantification for large language models through confidence measurement in semantic space
X Qiu, R Miikkulainen - The Thirty-eighth Annual Conference on …, 2024 - openreview.net
… With the widespread application of Large Language Models (LLMs) to various domains,
con… [17] perform an explorative study using simple baselines on uncertainty measurement for …
con… [17] perform an explorative study using simple baselines on uncertainty measurement for …
Large language model uncertainty proxies: discrimination and calibration for medical diagnosis and treatment
T Savage, J Wang, R Gallo, A Boukil… - Journal of the …, 2025 - academic.oup.com
… of large language models (LLMs) to communicate uncertainty is a significant barrier to their
use in medicine. Before … properties to consider when evaluating LLM uncertainty proxies for …
use in medicine. Before … properties to consider when evaluating LLM uncertainty proxies for …