Structured pruning for deep convolutional neural networks: A survey

Y He, L Xiao - IEEE transactions on pattern analysis and …, 2023 - ieeexplore.ieee.org
The remarkable performance of deep Convolutional neural networks (CNNs) is generally
attributed to their deeper and wider architectures, which can come with significant …

Capsule networks with residual pose routing

Y Liu, D Cheng, D Zhang, S Xu… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Capsule networks (CapsNets) have been known difficult to develop a deeper architecture,
which is desirable for high performance in the deep learning era, due to the complex …

Iterative clustering pruning for convolutional neural networks

J Chang, Y Lu, P Xue, Y Xu, Z Wei - Knowledge-Based Systems, 2023 - Elsevier
Convolutional neural networks (CNNs) have shown excellent performance in numerous
computer vision tasks. However, the high computational and memory demands in computer …

Adaptive filter pruning via sensitivity feedback

Y Zhang, NM Freris - IEEE Transactions on Neural Networks …, 2023 - ieeexplore.ieee.org
Filter pruning is advocated for accelerating deep neural networks without dedicated
hardware or libraries, while maintaining high prediction accuracy. Several works have cast …

Pruning-as-search: Efficient neural architecture search via channel pruning and structural reparameterization

Y Li, P Zhao, G Yuan, X Lin, Y Wang… - arXiv preprint arXiv …, 2022 - arxiv.org
Neural architecture search (NAS) and network pruning are widely studied efficient AI
techniques, but not yet perfect. NAS performs exhaustive candidate architecture search …

CP3: Channel pruning plug-in for point-based networks

Y Huang, N Liu, Z Che, Z Xu, C Shen… - Proceedings of the …, 2023 - openaccess.thecvf.com
Channel pruning has been widely studied as a prevailing method that effectively reduces
both computational cost and memory footprint of the original network while keeping a …

Pruning parameterization with bi-level optimization for efficient semantic segmentation on the edge

C Yang, P Zhao, Y Li, W Niu, J Guan… - Proceedings of the …, 2023 - openaccess.thecvf.com
With the ever-increasing popularity of edge devices, it is necessary to implement real-time
segmentation on the edge for autonomous driving and many other applications. Vision …

CATRO: Channel pruning via class-aware trace ratio optimization

W Hu, Z Che, N Liu, M Li, J Tang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Deep convolutional neural networks are shown to be overkill with high parametric and
computational redundancy in many application scenarios, and an increasing number of …

Neural network developments: A detailed survey from static to dynamic models

PR Verma, NP Singh, D Pantola, X Cheng - Computers and Electrical …, 2024 - Elsevier
Abstract Dynamic Neural Networks (DNNs) are an evolving research field within deep
learning (DL), offering a robust, adaptable, and efficient alternative to the conventional Static …

Design automation for fast, lightweight, and effective deep learning models: A survey

D Zhang, K Chen, Y Zhao, B Yang, L Yao… - arXiv preprint arXiv …, 2022 - arxiv.org
Deep learning technologies have demonstrated remarkable effectiveness in a wide range of
tasks, and deep learning holds the potential to advance a multitude of applications …