A review of the F-measure: its history, properties, criticism, and alternatives

P Christen, DJ Hand, N Kirielle - ACM Computing Surveys, 2023 - dl.acm.org
Methods to classify objects into two or more classes are at the core of various disciplines.
When a set of objects with their true classes is available, a supervised classifier can be …

Making and evaluating point forecasts

T Gneiting - Journal of the American Statistical Association, 2011 - Taylor & Francis
Typically, point forecasting methods are compared and assessed by means of an error
measure or scoring function, with the absolute error and the squared error being key …

Learning in implicit generative models

S Mohamed, B Lakshminarayanan - arXiv preprint arXiv:1610.03483, 2016 - arxiv.org
Generative adversarial networks (GANs) provide an algorithmic framework for constructing
generative models with several appealing properties: they do not require a likelihood …

Mix-n-match: Ensemble and compositional methods for uncertainty calibration in deep learning

J Zhang, B Kailkhura, TYJ Han - International conference on …, 2020 - proceedings.mlr.press
This paper studies the problem of post-hoc calibration of machine learning classifiers. We
introduce the following desiderata for uncertainty calibration:(a) accuracy-preserving,(b) …

Gen: Pushing the limits of softmax-based out-of-distribution detection

X Liu, Y Lochman, C Zach - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Abstract Out-of-distribution (OOD) detection has been extensively studied in order to
successfully deploy neural networks, in particular, for safety-critical applications. Moreover …

Automatic localization of casting defects with convolutional neural networks

M Ferguson, R Ak, YTT Lee… - 2017 IEEE international …, 2017 - ieeexplore.ieee.org
Automatic localization of defects in metal castings is a challenging task, owing to the rare
occurrence and variation in appearance of defects. Convolutional neural networks (CNN) …

Detection of non-stationary GW signals in high noise from Cohen's class of time–frequency representations using deep learning

N Lopac, F Hržić, IP Vuksanović, J Lerga - IEEE access, 2021 - ieeexplore.ieee.org
Analysis of non-stationary signals in a noisy environment is a challenging research topic in
many fields often requiring simultaneous signal decomposition in the time and frequency …

Strictly proper scoring rules, prediction, and estimation

T Gneiting, AE Raftery - Journal of the American statistical …, 2007 - Taylor & Francis
Scoring rules assess the quality of probabilistic forecasts, by assigning a numerical score
based on the predictive distribution and on the event or value that materializes. A scoring …

An experimental comparison of performance measures for classification

C Ferri, J Hernández-Orallo, R Modroiu - Pattern recognition letters, 2009 - Elsevier
Performance metrics in classification are fundamental in assessing the quality of learning
methods and learned models. However, many different measures have been defined in the …

Boosting algorithms: Regularization, prediction and model fitting

P Bühlmann, T Hothorn - 2007 - projecteuclid.org
We present a statistical perspective on boosting. Special emphasis is given to estimating
potentially complex parametric or nonparametric models, including generalized linear and …