Advanced nonparametric tests for multiple comparisons in the design of experiments in computational intelligence and data mining: Experimental analysis of power

S García, A Fernández, J Luengo, F Herrera - Information sciences, 2010 - Elsevier
Experimental analysis of the performance of a proposed method is a crucial and necessary
task in an investigation. In this paper, we focus on the use of nonparametric statistical …

Nonparametric statistical analysis for multiple comparison of machine learning regression algorithms

B Trawiński, M Smętek, Z Telec, T Lasota - International Journal of …, 2012 - sciendo.com
In the paper we present some guidelines for the application of nonparametric statistical tests
and post-hoc procedures devised to perform multiple comparisons of machine learning …

[PDF][PDF] An Extension on" Statistical Comparisons of Classifiers over Multiple Data Sets" for all Pairwise Comparisons.

S Garcia, F Herrera - Journal of machine learning research, 2008 - jmlr.org
In a recently published paper in JMLR, Demšar (2006) recommends a set of non-parametric
statistical tests and procedures which can be safely used for comparing the performance of …

A study on the use of statistical tests for experimentation with neural networks: Analysis of parametric test conditions and non-parametric tests

J Luengo, S García, F Herrera - Expert Systems with Applications, 2009 - Elsevier
In this paper, we focus on the experimental analysis on the performance in artificial neural
networks with the use of statistical tests on the classification task. Particularly, we have …

[图书][B] Data analysis with small samples and non-normal data: Nonparametrics and other strategies

CF Siebert, DC Siebert - 2017 - books.google.com
In social sciences, education, and public health research, researchers often conduct small
pilot studies (or may have planned for a larger sample but lost too many cases due to …

[PDF][PDF] Statistical comparisons of classifiers over multiple data sets

J Demšar - The Journal of Machine learning research, 2006 - jmlr.org
While methods for comparing two learning algorithms on a single data set have been
scrutinized for quite some time already, the issue of statistical tests for comparisons of more …

[图书][B] Data analysis in business research: A step-by-step nonparametric approach

D Israel - 2009 - books.google.com
While there are books focusing on parametric tests, the domain of nonparametric tests is
mostly unexplored. Data Analysis in Business Research: A Step by Step Nonparametric …

[PDF][PDF] Should we really use post-hoc tests based on mean-ranks?

A Benavoli, G Corani, F Mangili - The Journal of Machine Learning …, 2016 - jmlr.org
The statistical comparison of multiple algorithms over multiple data sets is fundamental in
machine learning. This is typically carried out by the Friedman test. When the Friedman test …

The design and analysis of benchmark experiments

T Hothorn, F Leisch, A Zeileis… - Journal of Computational …, 2005 - Taylor & Francis
The assessment of the performance of learners by means of benchmark experiments is an
established exercise. In practice, benchmark studies are a tool to compare the performance …

Statistical comparisons of the top 10 algorithms in data mining for classification task

N Settouti, M El Amine Bechar, M Amine Chikh - 2016 - reunir.unir.net
This work is builds on the study of the 10 top data mining algorithms identified by the IEEE
International Conference on Data Mining (ICDM) community in December 2006. We address …