A review of convolutional neural network architectures and their optimizations

S Cong, Y Zhou - Artificial Intelligence Review, 2023 - Springer
The research advances concerning the typical architectures of convolutional neural
networks (CNNs) as well as their optimizations are analyzed and elaborated in detail in this …

Structured pruning for deep convolutional neural networks: A survey

Y He, L Xiao - IEEE transactions on pattern analysis and …, 2023 - ieeexplore.ieee.org
The remarkable performance of deep Convolutional neural networks (CNNs) is generally
attributed to their deeper and wider architectures, which can come with significant …

Channel pruning via automatic structure search

M Lin, R Ji, Y Zhang, B Zhang, Y Wu, Y Tian - arXiv preprint arXiv …, 2020 - arxiv.org
Channel pruning is among the predominant approaches to compress deep neural networks.
To this end, most existing pruning methods focus on selecting channels (filters) by …

Fairgrape: Fairness-aware gradient pruning method for face attribute classification

X Lin, S Kim, J Joo - European Conference on Computer Vision, 2022 - Springer
Existing pruning techniques preserve deep neural networks' overall ability to make correct
predictions but could also amplify hidden biases during the compression process. We …

Accelerate cnns from three dimensions: A comprehensive pruning framework

W Wang, M Chen, S Zhao, L Chen… - International …, 2021 - proceedings.mlr.press
Most neural network pruning methods, such as filter-level and layer-level prunings, prune
the network model along one dimension (depth, width, or resolution) solely to meet a …

On the opportunities of green computing: A survey

Y Zhou, X Lin, X Zhang, M Wang, G Jiang, H Lu… - arXiv preprint arXiv …, 2023 - arxiv.org
Artificial Intelligence (AI) has achieved significant advancements in technology and research
with the development over several decades, and is widely used in many areas including …

Rethinking the pruning criteria for convolutional neural network

Z Huang, W Shao, X Wang, L Lin… - Advances in Neural …, 2021 - proceedings.neurips.cc
Channel pruning is a popular technique for compressing convolutional neural networks
(CNNs), where various pruning criteria have been proposed to remove the redundant filters …

Hrel: Filter pruning based on high relevance between activation maps and class labels

CH Sarvani, M Ghorai, SR Dubey, SHS Basha - Neural Networks, 2022 - Elsevier
This paper proposes an Information Bottleneck theory based filter pruning method that uses
a statistical measure called Mutual Information (MI). The MI between filters and class labels …

Filter pruning via feature discrimination in deep neural networks

Z He, Y Qian, Y Wang, B Wang, X Guan, Z Gu… - European conference on …, 2022 - Springer
Filter pruning is one of the most effective methods to compress deep convolutional networks
(CNNs). In this paper, as a key component in filter pruning, We first propose a feature …

Prior gradient mask guided pruning-aware fine-tuning

L Cai, Z An, C Yang, Y Yan, Y Xu - … of the AAAI Conference on Artificial …, 2022 - ojs.aaai.org
Abstract We proposed a Prior Gradient Mask Guided Pruning-aware Fine-Tuning (PGMPF)
framework to accelerate deep Convolutional Neural Networks (CNNs). In detail, the …