ROC and AUC with a binary predictor: a potentially misleading metric

J Muschelli III - Journal of classification, 2020 - Springer
In analysis of binary outcomes, the receiver operator characteristic (ROC) curve is heavily
used to show the performance of a model or algorithm. The ROC curve is informative about …

[PDF][PDF] The many faces of ROC analysis in machine learning

P Flach - Icml Tutorial, 2004 - researchgate.net
Objectives▪ After this tutorial, you will be able to▪[model evaluation] produce ROC plots for
categorical and ranking classifiers and calculate their AUC; apply crossvalidation in doing …

An experimental comparison of cross-validation techniques for estimating the area under the ROC curve

A Airola, T Pahikkala, W Waegeman, B De Baets… - … Statistics & Data …, 2011 - Elsevier
Reliable estimation of the classification performance of inferred predictive models is difficult
when working with small data sets. Cross-validation is in this case a typical strategy for …

ROC analysis

PA Flach - … of machine learning and data mining, 2016 - research-information.bris.ac.uk
ROC analysis investigates and employs the relationship between sensitivity and specificity
of a binary classifier. Sensitivity or true positiverate measures the proportion of positives …

[PDF][PDF] A scored AUC metric for classifier evaluation and selection

S Wu, P Flach - Second workshop on ROC analysis in ML, bonn …, 2005 - Citeseer
The area under the ROC (Receiver Operating Characteristic) curve, or simply AUC, has
been widely used to measure model performance for binary classification tasks. It can be …

[HTML][HTML] Computationally efficient confidence intervals for cross-validated area under the ROC curve estimates

E LeDell, M Petersen… - Electronic journal of …, 2015 - ncbi.nlm.nih.gov
In binary classification problems, the area under the ROC curve (AUC) is commonly used to
evaluate the performance of a prediction model. Often, it is combined with cross-validation in …

Understanding auc-roc curve

S Narkhede - Towards data science, 2018 - 48hours.ai
In Machine Learning, performance measurement is an essential task. So when it comes to a
classification problem, we can count on an AUC-ROC Curve. When we need to check or …

Measuring classifier performance: a coherent alternative to the area under the ROC curve

DJ Hand - Machine learning, 2009 - Springer
The area under the ROC curve (AUC) is a very widely used measure of performance for
classification and diagnostic rules. It has the appealing property of being objective, requiring …

Volume under the ROC surface for multi-class problems

C Ferri, J Hernández-Orallo, MA Salido - European conference on …, 2003 - Springer
Operating Characteristic (ROC) analysis has been successfully applied to classifier
problems with two classes. The Area Under the ROC Curve (AUC) has been elected as a …

[HTML][HTML] Decision curve analysis revisited: overall net benefit, relationships to ROC curve analysis, and application to case-control studies

V Rousson, T Zumbrunn - BMC medical informatics and decision making, 2011 - Springer
Background Decision curve analysis has been introduced as a method to evaluate
prediction models in terms of their clinical consequences if used for a binary classification of …