Epistemic neural networks

I Osband, Z Wen, SM Asghari… - Advances in …, 2023 - proceedings.neurips.cc
Intelligence relies on an agent's knowledge of what it does not know. This capability can be
assessed based on the quality of joint predictions of labels across multiple inputs. In …

[HTML][HTML] Evaluation of uncertainty quantification methods in multi-label classification: A case study with automatic diagnosis of electrocardiogram

M Barandas, L Famiglini, A Campagner, D Folgado… - Information …, 2024 - Elsevier
Artificial Intelligence (AI) use in automated Electrocardiogram (ECG) classification has
continuously attracted the research community's interest, motivated by their promising …

Coherent Blending of Biophysics-Based Knowledge with Bayesian Neural Networks for Robust Protein Property Prediction

H Nisonoff, Y Wang, J Listgarten - ACS Synthetic Biology, 2023 - ACS Publications
Predicting properties of proteins is of interest for basic biological understanding and protein
engineering alike. Increasingly, machine learning (ML) approaches are being used for this …

Leveraging demonstrations to improve online learning: Quality matters

B Hao, R Jain, T Lattimore… - … on Machine Learning, 2023 - proceedings.mlr.press
We investigate the extent to which offline demonstration data can improve online learning. It
is natural to expect some improvement, but the question is how, and by how much? We …

To Believe or Not to Believe Your LLM

YA Yadkori, I Kuzborskij, A György… - arXiv preprint arXiv …, 2024 - arxiv.org
We explore uncertainty quantification in large language models (LLMs), with the goal to
identify when uncertainty in responses given a query is large. We simultaneously consider …

Bayesian posterior approximation with stochastic ensembles

O Balabanov, B Mehlig… - 2023 IEEE/CVF …, 2023 - ieeexplore.ieee.org
We introduce ensembles of stochastic neural networks to approximate the Bayesian
posterior, combining stochastic methods such as dropout with deep ensembles. The stochas …

Probabilistic inference in reinforcement learning done right

J Tarbouriech, T Lattimore… - Advances in Neural …, 2024 - proceedings.neurips.cc
A popular perspective in Reinforcement learning (RL) casts the problem as probabilistic
inference on a graphical model of the Markov decision process (MDP). The core object of …

Satisficing exploration for deep reinforcement learning

D Arumugam, S Kumar, R Gummadi… - arXiv preprint arXiv …, 2024 - arxiv.org
A default assumption in the design of reinforcement-learning algorithms is that a decision-
making agent always explores to learn optimal behavior. In sufficiently complex …

Using ai uncertainty quantification to improve human decision-making

LR Marusich, JZ Bakdash, Y Zhou… - arXiv preprint arXiv …, 2023 - arxiv.org
AI Uncertainty Quantification (UQ) has the potential to improve human decision-making
beyond AI predictions alone by providing additional useful probabilistic information to users …

Efficient exploration via epistemic-risk-seeking policy optimization

B O'Donoghue - arXiv preprint arXiv:2302.09339, 2023 - arxiv.org
Exploration remains a key challenge in deep reinforcement learning (RL). Optimism in the
face of uncertainty is a well-known heuristic with theoretical guarantees in the tabular …