Machine learning with a reject option: A survey

K Hendrickx, L Perini, D Van der Plas, W Meert… - Machine Learning, 2024 - Springer
Abstract Machine learning models always make a prediction, even when it is likely to be
inaccurate. This behavior should be avoided in many decision support applications, where …

Calibrated selective classification

A Fisch, T Jaakkola, R Barzilay - arXiv preprint arXiv:2208.12084, 2022 - arxiv.org
Selective classification allows models to abstain from making predictions (eg, say" I don't
know") when in doubt in order to obtain better effective accuracy. While typical selective …

Locally valid and discriminative prediction intervals for deep learning models

Z Lin, S Trivedi, J Sun - Advances in Neural Information …, 2021 - proceedings.neurips.cc
Crucial for building trust in deep learning models for critical real-world applications is
efficient and theoretically sound uncertainty quantification, a task that continues to be …

Fast online value-maximizing prediction sets with conformal cost control

Z Lin, S Trivedi, C Xiao, J Sun - International Conference on …, 2023 - proceedings.mlr.press
Many real-world multi-label prediction problems involve set-valued predictions that must
satisfy specific requirements dictated by downstream usage. We focus on a typical scenario …

Contextualized Sequence Likelihood: Enhanced Confidence Scores for Natural Language Generation

Z Lin, S Trivedi, J Sun - arXiv preprint arXiv:2406.01806, 2024 - arxiv.org
The advent of large language models (LLMs) has dramatically advanced the state-of-the-art
in numerous natural language generation tasks. For LLMs to be applied reliably, it is …

Effect of Dimensionality Reduction on Uncertainty Quantification in Trustworthy Machine Learning

YC Li, J Zhan - … on Machine Learning and Cybernetics (ICMLC), 2023 - ieeexplore.ieee.org
Machine learning (ML) is a commonly employed computer-assisted tool for ECG diagnosis
with above 85% correct. However, the interpretability of the prediction has become a barrier …

Deep Generalized Prediction Set Classifier and Its Theoretical Guarantees

Z Wang, X Qiao - Transactions on Machine Learning Research - openreview.net
A standard classification rule returns a single-valued prediction for any observation without a
confidence guarantee, which may result in severe consequences in many critical …

Distribution-free uncertainty quantification for deep learning

Z Lin - 2024 - ideals.illinois.edu
The integration of sophisticated deep learning models into critical domains, such as
healthcare, autonomous vehicles, and the legal system, is increasingly becoming a trend …

A simple Training-Free Method for Rejection Option

EDC Gomes, M Romanelli, F Granese, P Piantanida - openreview.net
We present a simple yet effective method to implement the rejection option for a pre-trained
classifier. Our method is based on a sound mathematical framework, enjoys good …

DEEP LEARNING METHOD FOR ENHANCING SLEEP STAGING CLASSIFICATION

Z Zhu - 2022 - ideals.illinois.edu
Traditionally, doctors classify the sleep staging of patients by manually examining the
spectrogram of electroencephalogram (EEG) data at different time intervals. We propose a …