Similarity of neural network models: A survey of functional and representational measures

M Klabunde, T Schumacher, M Strohmaier… - arXiv preprint arXiv …, 2023 - arxiv.org
Measuring similarity of neural networks to understand and improve their behavior has
become an issue of great importance and research interest. In this survey, we provide a …

Sr-init: An interpretable layer pruning method

H Tang, Y Lu, Q Xuan - ICASSP 2023-2023 IEEE International …, 2023 - ieeexplore.ieee.org
Despite the popularization of deep neural networks (DNNs) in many fields, it is still
challenging to deploy state-of-the-art models to resource-constrained devices due to high …

Universal structural patterns in sparse recurrent neural networks

XJ Zhang, JM Moore, G Yan, X Li - Communications Physics, 2023 - nature.com
Sparse neural networks can achieve performance comparable to fully connected networks
but need less energy and memory, showing great promise for deploying artificial intelligence …

Graph-Based Similarity of Deep Neural Networks

Z Chen, Y Lu, JX Hu, Q Xuan, Z Wang, X Yang - Neurocomputing, 2024 - Elsevier
Understanding the enigmatic black-box representations within Deep Neural Networks
(DNNs) is an essential problem in the community of deep learning. An initial step towards …

Automatic Meter Pointer Reading Based on Knowledge Distillation

R Sun, W Yang, F Zhang, Y Xiang, H Wang… - … on Knowledge Science …, 2024 - Springer
With the rapid development of industrial automation, automatic reading of pointer meters has
become a trend of data monitoring and efficient measurement in the industrial field. In the …

SGLP: A Similarity Guided Fast Layer Partition Pruning for Compressing Large Deep Models

Y Li, Y Lu, Z Dong, C Yang, Y Chen, J Gou - arXiv preprint arXiv …, 2024 - arxiv.org
The deployment of Deep Neural Network (DNN)-based networks on resource-constrained
devices remains a significant challenge due to their high computational and parameter …

PDD: Pruning Neural Networks During Knowledge Distillation

X Dan, W Yang, F Zhang, Y Zhou, Z Yu, Z Qiu… - Cognitive …, 2024 - Springer
Although deep neural networks have developed at a high level, the large computational
requirement limits the deployment in end devices. To this end, a variety of model …

A Generic Layer Pruning Method for Signal Modulation Recognition Deep Learning Models

Y Lu, Y Zhu, Y Li, D Xu, Y Lin, Q Xuan… - arXiv preprint arXiv …, 2024 - arxiv.org
With the successful application of deep learning in communications systems, deep neural
networks are becoming the preferred method for signal classification. Although these …

Structure of Artificial Neural Networks--Empirical Investigations

J Stier - arXiv preprint arXiv:2410.09579, 2024 - arxiv.org
Within one decade, Deep Learning overtook the dominating solution methods of countless
problems of artificial intelligence.``Deep''refers to the deep architectures with operations in …

RK-CORE: An Established Methodology for Exploring the Hierarchical Structure within Datasets

Y Lu, Y Huang, J Nie, Z Chen… - ICASSP 2024-2024 IEEE …, 2024 - ieeexplore.ieee.org
Recently, the field of machine learning has undergone a transition from model-centric to
data-centric. The advancements in diverse learning tasks have been propelled by the …