Prevalence of neural collapse during the terminal phase of deep learning training

V Papyan, XY Han, DL Donoho - Proceedings of the …, 2020 - National Acad Sciences
Modern practice for training classification deepnets involves a terminal phase of training
(TPT), which begins at the epoch where training error first vanishes. During TPT, the training …

Model-driven deep unrolling: Towards interpretable deep learning against noise attacks for intelligent fault diagnosis

Z Zhao, T Li, B An, S Wang, B Ding, R Yan, X Chen - ISA transactions, 2022 - Elsevier
Intelligent fault diagnosis (IFD) has experienced tremendous progress owing to a great deal
to deep learning (DL)-based methods over the decades. However, the “black box” nature of …

Revisiting sparse convolutional model for visual recognition

M Li, P Zhai, S Tong, X Gao… - Advances in …, 2022 - proceedings.neurips.cc
Despite strong empirical performance for image classification, deep neural networks are
often regarded as``black boxes''and they are difficult to interpret. On the other hand, sparse …

A personalized federated learning-based fault diagnosis method for data suffering from network attacks

Z Zhang, F Zhou, C Zhang, C Wen, X Hu, T Wang - Applied Intelligence, 2023 - Springer
Federated learning (FL) is an effective way to incorporate information provided by different
clients when a single local client is unable to provide sufficient training samples for …

[图书][B] Adversarial Machine Learning: Attack Surfaces, Defence Mechanisms, Learning Theories in Artificial Intelligence

AS Chivukula, X Yang, B Liu, W Liu, W Zhou - 2023 - Springer
A significant robustness gap exists between machine intelligence and human perception
despite recent advances in deep learning. Deep learning is not provably secure. A critical …

Adversarial robustness of supervised sparse coding

J Sulam, R Muthukumar… - Advances in neural …, 2020 - proceedings.neurips.cc
Several recent results provide theoretical insights into the phenomena of adversarial
examples. Existing results, however, are often limited due to a gap between the simplicity of …

Pivotal Auto-Encoder via Self-Normalizing ReLU

N Goldenstein, J Sulam… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Sparse auto-encoders are useful for extracting low-dimensional representations from high-
dimensional data. However, their performance degrades sharply when the input noise at test …

Architectural adversarial robustness: The case for deep pursuit

G Cazenavette, C Murdock… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Despite their unmatched performance, deep neural networks remain susceptible to targeted
attacks by nearly imperceptible levels of adversarial noise. While the underlying cause of …

Adversarial robustness of sparse local lipschitz predictors

R Muthukumar, J Sulam - SIAM Journal on Mathematics of Data Science, 2023 - SIAM
This work studies the adversarial robustness of parametric functions composed of a linear
predictor and a nonlinear representation map. Our analysis relies on sparse local …

[HTML][HTML] 利用基于深度学习的过完备字典信号稀疏表示算法压制地震随机噪声

唐杰, 孟涛, 张文征, 陈学国 - 石油地球物理勘探, 2020 - html.rhhz.net
曲波变换去噪处理使同相轴在断层等不连续区域发生畸变, 对有效信号产生干扰.
基于过完备字典信号稀疏表示(K-SVD) 需要人工反复调整参数才能改善去噪效果. 为此, 将K …