[PDF][PDF] Constructing New and Better Evaluation Measures for Machine Learning.

J Huang, CX Ling - IJCAI, 2007 - csd.uwo.ca
Abstract Evaluation measures play an important role in machine learning because they are
used not only to compare different learning algorithms, but also often as goals to optimize in …

Performance measures of machine learning

J Huang - University of Western Ontario, 2008 - library-archives.canada.ca
This thesis investigates some fundamental issues of performance measures of machine
learning. Performance measures (or evaluation measures) play important roles in machine …

[PDF][PDF] A quantification of distance bias between evaluation metrics in classification

R Vilalta, D Oblinger - ICML, 2000 - Citeseer
This paper provides a characterization of bias for evaluation metrics in classi cation (eg,
Information Gain, Gini, 2, etc.). Our characterization provides a uniform representation for all …

[PDF][PDF] Unbiased assessment of learning algorithms

T Scheffer, R Herbrich - IJCAI (2), 1997 - Citeseer
In order to rank the performance of machine learning algorithms, many researchers conduct
experiments on benchmark data sets. Since most learning algorithms have domain-specific …

[PDF][PDF] Why question machine learning evaluation methods

N Japkowicz - AAAI workshop on evaluation methods for machine …, 2006 - cdn.aaai.org
The evaluation of classifiers or learning algorithms is not a topic that has, generally, been
given much thought in the fields of Machine Learning and Data Mining. More often than not …

[PDF][PDF] AUC: a statistically consistent and more discriminating measure than accuracy

CX Ling, J Huang, H Zhang - Ijcai, 2003 - cs.unb.ca
Predictive accuracy has been used as the main and often only evaluation criterion for the
predictive performance of classification learning algorithms. In recent years, the area under …

Quality assessment and evaluation criteria in supervised learning

A Painsky - Machine Learning for Data Science Handbook: Data …, 2023 - Springer
Evaluating the performance of a learning algorithm is one of the basic tasks in machine
learning and data science. In this chapter, we review commonly used performance …

Evaluating learning algorithms and classifiers

N Lavesson, P Davidsson - International Journal of …, 2007 - inderscienceonline.com
We analyse 18 evaluation methods for learning algorithms and classifiers, and show how to
categorise these methods with the help of an evaluation method taxonomy based on several …

[PDF][PDF] Decision tree with better ranking

CX Ling, RJ Yan - Proceedings of the 20th International Conference on …, 2003 - cdn.aaai.org
Abstract AUC (Area Under the Curve) of ROC (Receiver Operating Characteristics) has
been recently used as a measure for ranking performance of learning algorithms. In this …

Recommending learning algorithms and their associated hyperparameters

MR Smith, L Mitchell, C Giraud-Carrier… - arXiv preprint arXiv …, 2014 - arxiv.org
The success of machine learning on a given task dependson, among other things, which
learning algorithm is selected and its associated hyperparameters. Selecting an appropriate …