Interspace pruning: Using adaptive filter representations to improve training of sparse cnns

P Wimmer, J Mehnert… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Unstructured pruning is well suited to reduce the memory footprint of convolutional neural
networks (CNNs), both at training and inference time. CNNs contain parameters arranged in …

Dimensionality reduced training by pruning and freezing parts of a deep neural network: a survey

P Wimmer, J Mehnert, AP Condurache - Artificial Intelligence Review, 2023 - Springer
State-of-the-art deep learning models have a parameter count that reaches into the billions.
Training, storing and transferring such models is energy and time consuming, thus costly. A …

Pruning rPPG networks: Toward small dense network with limited number of training samples

C Zhao, P Cao, S Xu, Z Li… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Neural network pruning reduces network complexity and storage by removing unimportant
connections in the network, enabling network miniaturization, fast training and inference …

One-shot network pruning at initialization with discriminative image patches

Y Yang, Y Wang, Y Ji, H Qi, J Kato - arXiv preprint arXiv:2209.05683, 2022 - arxiv.org
One-shot Network Pruning at Initialization (OPaI) is an effective method to decrease network
pruning costs. Recently, there is a growing belief that data is unnecessary in OPaI. However …

CNN Mixture-of-Depths

R Cakaj, J Mehnert, B Yang - arXiv preprint arXiv:2409.17016, 2024 - arxiv.org
We introduce Mixture-of-Depths (MoD) for Convolutional Neural Networks (CNNs), a novel
approach that enhances the computational efficiency of CNNs by selectively processing …

Pruning threshold search algorithm combined with PDARTS

J Ma - 4th International Conference on Information Science …, 2022 - spiedigitallibrary.org
With the continuous improvement of network accuracy, the depth and width of the network
also increase, so the requirements for storage and operation equipment are also higher and …

Multiscale importance evaluation pruning algorithm

J Ma - Journal of Physics: Conference Series, 2022 - iopscience.iop.org
With the continuous increase of the number of network layers, while the network
performance is constantly improving, the complexity of the network is also increasing …