Structured pruning for deep convolutional neural networks: A survey

Y He, L Xiao - IEEE transactions on pattern analysis and …, 2023 - ieeexplore.ieee.org
The remarkable performance of deep Convolutional neural networks (CNNs) is generally
attributed to their deeper and wider architectures, which can come with significant …

Pruning deep neural networks for green energy-efficient models: A survey

J Tmamna, EB Ayed, R Fourati, M Gogate, T Arslan… - Cognitive …, 2024 - Springer
Over the past few years, larger and deeper neural network models, particularly convolutional
neural networks (CNNs), have consistently advanced state-of-the-art performance across …

OnceNAS: Discovering efficient on-device inference neural networks for edge devices

Y Zhang, Y Qin, Y Zhang, X Zhou, S Jian, Y Tan… - Information Sciences, 2024 - Elsevier
Edge Intelligence (EI) offers an attractive approach for local AI processing at the network
edge for privacy protection and reduced transmission, but deploying resource-intensive …

Achieving More with Less: A Tensor-Optimization-Powered Ensemble Method

J Yuan, W Jiang, Z Cao, F Xie, R Wang, F Nie… - arXiv preprint arXiv …, 2024 - arxiv.org
Ensemble learning is a method that leverages weak learners to produce a strong learner.
However, obtaining a large number of base learners requires substantial time and …

Harnessing Orthogonality to Train Low-Rank Neural Networks

D Coquelin, K Flügel, M Weiel, N Kiefer… - arXiv preprint arXiv …, 2024 - arxiv.org
This study explores the learning dynamics of neural networks by analyzing the singular
value decomposition (SVD) of their weights throughout training. Our investigation reveals …

Leveraging discriminative data: A pathway to high-performance, stable One-shot Network Pruning at Initialization

Y Yang, Y Ji, J Kato - Neurocomputing, 2024 - Elsevier
Abstract One-shot Network Pruning at Initialization (OPaI) is acknowledged as a highly cost-
effective strategy for network pruning. However, it has been observed that OPaI models tend …

Context-aware Code Summary Generation

CY Su, A Bansal, Y Huang, TJJ Li… - arXiv preprint arXiv …, 2024 - arxiv.org
Code summary generation is the task of writing natural language descriptions of a section of
source code. Recent advances in Large Language Models (LLMs) and other AI-based …

LUM-ViT: Learnable Under-sampling Mask Vision Transformer for Bandwidth Limited Optical Signal Acquisition

L Liu, D Ni, H Yuan - arXiv preprint arXiv:2403.01412, 2024 - arxiv.org
Bandwidth constraints during signal acquisition frequently impede real-time detection
applications. Hyperspectral data is a notable example, whose vast volume compromises …

[PDF][PDF] Deep learning for necrosis and mitosis detection in canine soft tissue sarcoma whole slide images

TS Rai - 2023 - openresearch.surrey.ac.uk
Assessment of histology presented within tissue slides is an essential expert task
undertaken by pathologists to determine diagnosis and the aggressiveness of a tumour thus …

Learning effective pruning at initialization from iterative pruning

S Liu, Y Cheng, F Zha, W Guo, L Sun, Z Bing… - arXiv preprint arXiv …, 2024 - arxiv.org
Pruning at initialization (PaI) reduces training costs by removing weights before training,
which becomes increasingly crucial with the growing network size. However, current PaI …