Cost curves: An improved method for visualizing classifier performance

C Drummond, RC Holte - Machine learning, 2006 - Springer
This paper introduces cost curves, a graphical technique for visualizing the performance
(error rate or expected cost) of 2-class classifiers over the full range of possible class …

[PDF][PDF] A unified view of performance metrics: Translating threshold choice into expected classification loss

J Hernández-Orallo, P Flach, C Ferri Ramírez - Journal of Machine …, 2012 - jmlr.org
Many performance metrics have been introduced in the literature for the evaluation of
classification performance, each of them with different origins and areas of application …

[PDF][PDF] Considering cost asymmetry in learning classifiers

FR Bach, D Heckerman, E Horvitz - The Journal of Machine Learning …, 2006 - jmlr.org
Abstract Receiver Operating Characteristic (ROC) curves are a standard way to display the
performance of a set of binary classifiers for all feasible ratios of the costs associated with …

Measuring classifier performance: a coherent alternative to the area under the ROC curve

DJ Hand - Machine learning, 2009 - Springer
The area under the ROC curve (AUC) is a very widely used measure of performance for
classification and diagnostic rules. It has the appealing property of being objective, requiring …

Comparing classifiers when the misallocation costs are uncertain

NM Adams, DJ Hand - Pattern Recognition, 1999 - Elsevier
Receiver Operating Characteristic (ROC) curves are popular ways of summarising the
performance of two class classification rules. In fact, however, they are extremely …

A simple generalisation of the area under the ROC curve for multiple class classification problems

DJ Hand, RJ Till - Machine learning, 2001 - Springer
The area under the ROC curve, or the equivalent Gini index, is a widely used measure of
performance of supervised classification rules. It has the attractive property that it side-steps …

[PDF][PDF] Brier Curves: a New Cost-Based Visualisation of Classifier Performance.

J Hernández-Orallo, PA Flach, CF Ramirez - Icml, 2011 - dmip.webs.upv.es
Brier Curves: a New Cost-Based Visualisation of Classifier Performance Page 1 Brier Curves: a
New Cost-Based Visualisation of Classifier Performance J. Hernández-Orallo1 and P. Flach2 …

Improving the practice of classifier performance assessment

NM Adams, DJ Hand - Neural computation, 2000 - direct.mit.edu
In this note we use examples from the literature to illustrate some poor practices in
assessing the performance of supervised classification rules, and we suggest guidelines for …

ROC analysis

PA Flach - … of machine learning and data mining, 2016 - research-information.bris.ac.uk
ROC analysis investigates and employs the relationship between sensitivity and specificity
of a binary classifier. Sensitivity or true positiverate measures the proportion of positives …

Confidence intervals for the area under the ROC curve

C Cortes, M Mohri - Advances in neural information …, 2004 - proceedings.neurips.cc
In many applications, good ranking is a highly desirable performance for a classifier. The
criterion commonly used to measure the ranking quality of a classification algorithm is the …