[HTML][HTML] Data augmentation: A comprehensive survey of modern approaches

A Mumuni, F Mumuni - Array, 2022 - Elsevier
To ensure good performance, modern machine learning models typically require large
amounts of quality annotated data. Meanwhile, the data collection and annotation processes …

Avoiding overfitting: A survey on regularization methods for convolutional neural networks

CFGD Santos, JP Papa - ACM Computing Surveys (CSUR), 2022 - dl.acm.org
Several image processing tasks, such as image classification and object detection, have
been significantly improved using Convolutional Neural Networks (CNN). Like ResNet and …

Asam: Adaptive sharpness-aware minimization for scale-invariant learning of deep neural networks

J Kwon, J Kim, H Park, IK Choi - International Conference on …, 2021 - proceedings.mlr.press
Recently, learning algorithms motivated from sharpness of loss surface as an effective
measure of generalization gap have shown state-of-the-art performances. Nevertheless …

Meta pseudo labels

H Pham, Z Dai, Q Xie, QV Le - Proceedings of the IEEE/CVF …, 2021 - openaccess.thecvf.com
Abstract We present Meta Pseudo Labels, a semi-supervised learning method that achieves
a new state-of-the-art top-1 accuracy of 90.2% on ImageNet, which is 1.6% better than the …

A comprehensive survey on regularization strategies in machine learning

Y Tian, Y Zhang - Information Fusion, 2022 - Elsevier
In machine learning, the model is not as complicated as possible. Good generalization
ability means that the model not only performs well on the training data set, but also can …

Cutmix: Regularization strategy to train strong classifiers with localizable features

S Yun, D Han, SJ Oh, S Chun… - Proceedings of the …, 2019 - openaccess.thecvf.com
Regional dropout strategies have been proposed to enhance performance of convolutional
neural network classifiers. They have proved to be effective for guiding the model to attend …

Unsupervised data augmentation for consistency training

Q Xie, Z Dai, E Hovy, T Luong… - Advances in neural …, 2020 - proceedings.neurips.cc
Semi-supervised learning lately has shown much promise in improving deep learning
models when labeled data is scarce. Common among recent approaches is the use of …

Attention augmented convolutional networks

I Bello, B Zoph, A Vaswani… - Proceedings of the …, 2019 - openaccess.thecvf.com
Convolutional networks have enjoyed much success in many computer vision applications.
The convolution operation however has a significant weakness in that it only operates on a …

Fast autoaugment

S Lim, I Kim, T Kim, C Kim… - Advances in neural …, 2019 - proceedings.neurips.cc
Data augmentation is an essential technique for improving generalization ability of deep
learning models. Recently, AutoAugment\cite {cubuk2018autoaugment} has been proposed …

Delving deep into label smoothing

CB Zhang, PT Jiang, Q Hou, Y Wei… - … on Image Processing, 2021 - ieeexplore.ieee.org
Label smoothing is an effective regularization tool for deep neural networks (DNNs), which
generates soft labels by applying a weighted average between the uniform distribution and …