Avoiding overfitting: A survey on regularization methods for convolutional neural networks

CFGD Santos, JP Papa - ACM Computing Surveys (CSUR), 2022 - dl.acm.org
Several image processing tasks, such as image classification and object detection, have
been significantly improved using Convolutional Neural Networks (CNN). Like ResNet and …

Review of deep learning: concepts, CNN architectures, challenges, applications, future directions

L Alzubaidi, J Zhang, AJ Humaidi, A Al-Dujaili… - Journal of big Data, 2021 - Springer
In the last few years, the deep learning (DL) computing paradigm has been deemed the
Gold Standard in the machine learning (ML) community. Moreover, it has gradually become …

Weighted feature fusion of convolutional neural network and graph attention network for hyperspectral image classification

Y Dong, Q Liu, B Du, L Zhang - IEEE Transactions on Image …, 2022 - ieeexplore.ieee.org
Convolutional Neural Networks (CNN) and Graph Neural Networks (GNN), such as Graph
Attention Networks (GAT), are two classic neural network models, which are applied to the …

Rethinking spatial dimensions of vision transformers

B Heo, S Yun, D Han, S Chun… - Proceedings of the …, 2021 - openaccess.thecvf.com
Abstract Vision Transformer (ViT) extends the application range of transformers from
language processing to computer vision tasks as being an alternative architecture against …

Attentional feature fusion

Y Dai, F Gieseke, S Oehmcke, Y Wu… - Proceedings of the …, 2021 - openaccess.thecvf.com
Feature fusion, the combination of features from different layers or branches, is an
omnipresent part of modern network architectures. It is often implemented via simple …

Asam: Adaptive sharpness-aware minimization for scale-invariant learning of deep neural networks

J Kwon, J Kim, H Park, IK Choi - International Conference on …, 2021 - proceedings.mlr.press
Recently, learning algorithms motivated from sharpness of loss surface as an effective
measure of generalization gap have shown state-of-the-art performances. Nevertheless …

CSPNet: A new backbone that can enhance learning capability of CNN

CY Wang, HYM Liao, YH Wu… - Proceedings of the …, 2020 - openaccess.thecvf.com
Neural networks have enabled state-of-the-art approaches to achieve incredible results on
computer vision tasks such as object detection. However, such success greatly relies on …

Attention-based adaptive spectral–spatial kernel ResNet for hyperspectral image classification

SK Roy, S Manna, T Song… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
Hyperspectral images (HSIs) provide rich spectral–spatial information with stacked
hundreds of contiguous narrowbands. Due to the existence of noise and band correlation …

Randaugment: Practical automated data augmentation with a reduced search space

ED Cubuk, B Zoph, J Shlens… - Proceedings of the IEEE …, 2020 - openaccess.thecvf.com
Recent work on automated augmentation strategies has led to state-of-the-art results in
image classification and object detection. An obstacle to a large-scale adoption of these …

A review of convolutional neural network architectures and their optimizations

S Cong, Y Zhou - Artificial Intelligence Review, 2023 - Springer
The research advances concerning the typical architectures of convolutional neural
networks (CNNs) as well as their optimizations are analyzed and elaborated in detail in this …