Machine learning with a reject option: A survey
Abstract Machine learning models always make a prediction, even when it is likely to be
inaccurate. This behavior should be avoided in many decision support applications, where …
inaccurate. This behavior should be avoided in many decision support applications, where …
Calibrated selective classification
Selective classification allows models to abstain from making predictions (eg, say" I don't
know") when in doubt in order to obtain better effective accuracy. While typical selective …
know") when in doubt in order to obtain better effective accuracy. While typical selective …
Locally valid and discriminative prediction intervals for deep learning models
Crucial for building trust in deep learning models for critical real-world applications is
efficient and theoretically sound uncertainty quantification, a task that continues to be …
efficient and theoretically sound uncertainty quantification, a task that continues to be …
Fast online value-maximizing prediction sets with conformal cost control
Many real-world multi-label prediction problems involve set-valued predictions that must
satisfy specific requirements dictated by downstream usage. We focus on a typical scenario …
satisfy specific requirements dictated by downstream usage. We focus on a typical scenario …
Contextualized Sequence Likelihood: Enhanced Confidence Scores for Natural Language Generation
The advent of large language models (LLMs) has dramatically advanced the state-of-the-art
in numerous natural language generation tasks. For LLMs to be applied reliably, it is …
in numerous natural language generation tasks. For LLMs to be applied reliably, it is …
Effect of Dimensionality Reduction on Uncertainty Quantification in Trustworthy Machine Learning
YC Li, J Zhan - … on Machine Learning and Cybernetics (ICMLC), 2023 - ieeexplore.ieee.org
Machine learning (ML) is a commonly employed computer-assisted tool for ECG diagnosis
with above 85% correct. However, the interpretability of the prediction has become a barrier …
with above 85% correct. However, the interpretability of the prediction has become a barrier …
Deep Generalized Prediction Set Classifier and Its Theoretical Guarantees
A standard classification rule returns a single-valued prediction for any observation without a
confidence guarantee, which may result in severe consequences in many critical …
confidence guarantee, which may result in severe consequences in many critical …
Distribution-free uncertainty quantification for deep learning
Z Lin - 2024 - ideals.illinois.edu
The integration of sophisticated deep learning models into critical domains, such as
healthcare, autonomous vehicles, and the legal system, is increasingly becoming a trend …
healthcare, autonomous vehicles, and the legal system, is increasingly becoming a trend …
A simple Training-Free Method for Rejection Option
We present a simple yet effective method to implement the rejection option for a pre-trained
classifier. Our method is based on a sound mathematical framework, enjoys good …
classifier. Our method is based on a sound mathematical framework, enjoys good …
DEEP LEARNING METHOD FOR ENHANCING SLEEP STAGING CLASSIFICATION
Z Zhu - 2022 - ideals.illinois.edu
Traditionally, doctors classify the sleep staging of patients by manually examining the
spectrogram of electroencephalogram (EEG) data at different time intervals. We propose a …
spectrogram of electroencephalogram (EEG) data at different time intervals. We propose a …