Enhancement of cross validation using hybrid visual and analytical means with Shannon function

B Kovalerchuk - … Data Processing Techniques: Interval, Fuzzy etc …, 2020 - Springer
The algorithm of k-fold cross validation is actively used to evaluate and compare machine
learning algorithms. However, it has several important deficiencies documented in the …

[PDF][PDF] Performance of machine learning algorithms with different K values in K-fold CrossValidation

IK Nti, O Nyarko-Boateng, J Aning - International Journal of …, 2021 - researchgate.net
The numerical value of k in a k-fold cross-validation training technique of machine learning
predictive models is an essential element that impacts the model's performance. A right …

Examining the Impact of Different K Values on the Performance of Multiple Algorithms in K-Fold Cross-Validation

U Imran, A Waris, M Nayab… - 2023 3rd International …, 2023 - ieeexplore.ieee.org
Myoelectric interface advancements have the potential to modify the use of wearable
prosthetics as limb replacements by using EMG signals to control active hand and arm …

Bias in Estimating the Variance of K-Fold Cross-Validation

Y Bengio, Y Grandvalet - Statistical modeling and analysis for complex …, 2005 - Springer
Most machine learning researchers perform quantitative experiments to estimate
generalization error and compare the perforniance of different algorithms (in particular, their …

[PDF][PDF] Hypothesis testing for cross-validation

Y Grandvalet, Y Bengio - Montreal Universite de Montreal …, 2006 - iro.umontreal.ca
K-fold cross-validation produces variable estimates, whose variance cannot be estimated
unbiasedly. However, in practice, one would like to provide a figure related to the variability …

[PDF][PDF] origami: A generalized framework for cross-validation in R

JR Coyle, NS Hejazi - Journal of Open Source Software, 2018 - joss.theoj.org
Cross-validation is an essential tool for evaluating how any given data analytic procedure
extends from a sample to the target population from which the sample is derived. It has seen …

[HTML][HTML] A Bayesian approach for comparing cross-validated algorithms on multiple data sets

G Corani, A Benavoli - Machine Learning, 2015 - Springer
We present a Bayesian approach for making statistical inference about the accuracy (or any
other score) of two competing algorithms which have been assessed via cross-validation on …

No unbiased estimator of the variance of k-fold cross-validation

Y Bengio, Y Grandvalet - Advances in Neural Information …, 2003 - proceedings.neurips.cc
Most machine learning researchers perform quantitative experiments to estimate
generalization error and compare algorithm performances. In order to draw statistically …

Determining the optimal number of folds to use in a K-fold cross-validation: A neural network classification experiment

O Oyedele - Research in Mathematics, 2023 - Taylor & Francis
ABSTRACT A large dataset is needed to obtain a large learning set for a suitable classifier,
while a large testing set is needed for a good estimate of the classifier's performance (ie …

Sensitivity analysis of k-fold cross validation in prediction error estimation

JD Rodriguez, A Perez… - IEEE transactions on …, 2009 - ieeexplore.ieee.org
In the machine learning field, the performance of a classifier is usually measured in terms of
prediction error. In most real-world problems, the error cannot be exactly calculated and it …