A meta-analysis of overfitting in machine learning

R Roelofs, V Shankar, B Recht… - Advances in …, 2019 - proceedings.neurips.cc
… drop of a machine learning model. Here, we focus on adaptive overfitting, which is overfitting
caused by test set reuse. While other phenomena under the overfitting umbrella are also …

An overview of overfitting and its solutions

X Ying - Journal of physics: Conference series, 2019 - iopscience.iop.org
Overfitting is general issue in supervised machine learning, which cannot be completely
avoided. It happens because of either the limits of training data, which can have a limited size or …

An empirical overview of nonlinearity and overfitting in machine learning using COVID-19 data

Y Peng, MH Nagata - Chaos, Solitons & Fractals, 2020 - Elsevier
… predictions, a typical example of overfitting in a machine learning model. On the other hand,
… the need for caution when applying machine learning models to support real-world decision …

[PDF][PDF] Overfitting and undercomputing in machine learning

T Dietterich - ACM computing surveys (CSUR), 1995 - dl.acm.org
A central problem in machine learning is supervised learning—that is, learning from labeled
training data. For example, a learning system for medical diagnosis might be trained with …

[PDF][PDF] Methods to avoid over-fitting and under-fitting in supervised machine learning (comparative study)

H Jabbar, RZ Khan - Computer Science, Communication and …, 2015 - academia.edu
… ABSTRACT: Machine learning is an important task for learning artificial neural … in the
learning one of the common problems of learning the Artificial Neural Network (ANN) is over-fitting

Privacy risk in machine learning: Analyzing the connection to overfitting

S Yeom, I Giacomelli, M Fredrikson… - 2018 IEEE 31st …, 2018 - ieeexplore.ieee.org
… arises in several popular machine learning algorithms. We find that overfitting is sufficient to
allow … Interestingly, our formal analysis also shows that overfitting is not necessary for these …

A study on overfitting in deep reinforcement learning

C Zhang, O Vinyals, R Munos, S Bengio - arXiv preprint arXiv:1804.06893, 2018 - arxiv.org
… trade-off in machine learning, preventing overfitting by properly … of overfitting could be
performed from the theory side, where generalization guarantees are derived for specific learning

Overfitting in adversarially robust deep learning

L Rice, E Wong, Z Kolter - … conference on machine learning, 2020 - proceedings.mlr.press
… Second, we study various empirical properties of overfitting for … such overfitting appear
closely tied to the learning rate schedule, we begin by investigating how changes to the learning

[PDF][PDF] Overfitting in making comparisons between variable selection methods

J Reunanen - Journal of Machine Learning Research, 2003 - jmlr.org
This paper addresses a common methodological flaw in the comparison of variable selection
methods. A practical approach to guide the search or the selection process is to compute …

[PDF][PDF] Dropout: a simple way to prevent neural networks from overfitting

N Srivastava, G Hinton, A Krizhevsky… - … of machine learning …, 2014 - jmlr.org
… are very powerful machine learning systems. However, overfitting is a serious problem in
such networks. Large networks are also slow to use, making it difficult to deal with overfitting by …