A gentle introduction to conformal prediction and distribution-free uncertainty quantification

AN Angelopoulos, S Bates - arXiv preprint arXiv:2107.07511, 2021 - arxiv.org
Black-box machine learning models are now routinely used in high-risk settings, like
medical diagnostics, which demand uncertainty quantification to avoid consequential model …

Conformal pid control for time series prediction

A Angelopoulos, E Candes… - Advances in neural …, 2024 - proceedings.neurips.cc
We study the problem of uncertainty quantification for time series prediction, with the goal of
providing easy-to-use algorithms with formal guarantees. The algorithms we present build …

Uncertainty sets for image classifiers using conformal prediction

A Angelopoulos, S Bates, J Malik, MI Jordan - arXiv preprint arXiv …, 2020 - arxiv.org
Convolutional image classifiers can achieve high predictive accuracy, but quantifying their
uncertainty remains an unresolved challenge, hindering their deployment in consequential …

Conformalized quantile regression

Y Romano, E Patterson… - Advances in neural …, 2019 - proceedings.neurips.cc
Conformal prediction is a technique for constructing prediction intervals that attain valid
coverage in finite samples, without making distributional assumptions. Despite this appeal …

Distribution-free, risk-controlling prediction sets

S Bates, A Angelopoulos, L Lei, J Malik… - Journal of the ACM …, 2021 - dl.acm.org
While improving prediction accuracy has been the focus of machine learning in recent years,
this alone does not suffice for reliable decision-making. Deploying learning systems in …

Deep k-nearest neighbors: Towards confident, interpretable and robust deep learning

N Papernot, P McDaniel - arXiv preprint arXiv:1803.04765, 2018 - arxiv.org
Deep neural networks (DNNs) enable innovative applications of machine learning like
image recognition, machine translation, or malware detection. However, deep learning is …

Image-to-image regression with distribution-free uncertainty quantification and applications in imaging

AN Angelopoulos, AP Kohli, S Bates… - International …, 2022 - proceedings.mlr.press
Image-to-image regression is an important learning task, used frequently in biological
imaging. Current algorithms, however, do not generally offer statistical guarantees that …

Conformal risk control

AN Angelopoulos, S Bates, A Fisch, L Lei… - arXiv preprint arXiv …, 2022 - arxiv.org
We extend conformal prediction to control the expected value of any monotone loss function.
The algorithm generalizes split conformal prediction together with its coverage guarantee …

Improved online conformal prediction via strongly adaptive online learning

A Bhatnagar, H Wang, C Xiong… - … Conference on Machine …, 2023 - proceedings.mlr.press
We study the problem of uncertainty quantification via prediction sets, in an online setting
where the data distribution may vary arbitrarily over time. Recent work develops online …

Testing for outliers with conformal p-values

S Bates, E Candès, L Lei, Y Romano… - The Annals of …, 2023 - projecteuclid.org
Testing for outliers with conformal p-values Page 1 The Annals of Statistics 2023, Vol. 51, No.
1, 149–178 https://doi.org/10.1214/22-AOS2244 © Institute of Mathematical Statistics, 2023 …