Human-aligned calibration for ai-assisted decision making

N Corvelo Benz, M Rodriguez - Advances in Neural …, 2024 - proceedings.neurips.cc
Whenever a binary classifier is used to provide decision support, it typically provides both a
label prediction and a confidence value. Then, the decision maker is supposed to use the …

Selection by prediction with conformal p-values

Y Jin, EJ Candès - Journal of Machine Learning Research, 2023 - jmlr.org
Decision making or scientific discovery pipelines such as job hiring and drug discovery often
involve multiple stages: before any resource-intensive step, there is often an initial screening …

Classifier calibration: a survey on how to assess and improve predicted class probabilities

T Silva Filho, H Song, M Perello-Nieto… - Machine Learning, 2023 - Springer
This paper provides both an introduction to and a detailed overview of the principles and
practice of classifier calibration. A well-calibrated classifier correctly quantifies the level of …

Calibrating multimodal learning

H Ma, Q Zhang, C Zhang, B Wu, H Fu… - International …, 2023 - proceedings.mlr.press
Multimodal machine learning has achieved remarkable progress in a wide range of
scenarios. However, the reliability of multimodal learning remains largely unexplored. In this …

Regression diagnostics meets forecast evaluation: Conditional calibration, reliability diagrams, and coefficient of determination

T Gneiting, J Resin - Electronic Journal of Statistics, 2023 - projecteuclid.org
Regression diagnostics meets forecast evaluation: conditional calibration, reliability diagrams,
and coefficient of determinatio Page 1 Electronic Journal of Statistics Vol. 17 (2023) 3226–3286 …

Classifier calibration: a survey on how to assess and improve predicted class probabilities

H Song, M Perello-Nieto, R Santos-Rodriguez… - arXiv preprint arXiv …, 2021 - arxiv.org
This paper provides both an introduction to and a detailed overview of the principles and
practice of classifier calibration. A well-calibrated classifier correctly quantifies the level of …

Improving screening processes via calibrated subset selection

L Wang, T Joachims… - … Conference on Machine …, 2022 - proceedings.mlr.press
Many selection processes such as finding patients qualifying for a medical trial or retrieval
pipelines in search engines consist of multiple stages, where an initial screening stage …

Uncertainty quantification for fairness in two-stage recommender systems

L Wang, T Joachims - Proceedings of the Sixteenth ACM International …, 2023 - dl.acm.org
Many large-scale recommender systems consist of two stages. The first stage efficiently
screens the complete pool of items for a small subset of promising candidates, from which …

Prognosing the risk of COVID-19 death through a machine learning-based routine blood panel: a retrospective study in Brazil

DC Araújo, AA Veloso, KBG Borges… - International Journal of …, 2022 - Elsevier
Background: Despite an extensive network of primary care availability, Brazil has suffered
profoundly during the COVID-19 pandemic, experiencing the greatest sanitary collapse in its …

Anomaly detection in financial time series by principal component analysis and neural networks

S Crépey, N Lehdili, N Madhar, M Thomas - Algorithms, 2022 - mdpi.com
A major concern when dealing with financial time series involving a wide variety of market
risk factors is the presence of anomalies. These induce a miscalibration of the models used …