On information plane analyses of neural network classifiers—A review

BC Geiger - IEEE Transactions on Neural Networks and …, 2021 - ieeexplore.ieee.org
We review the current literature concerned with information plane (IP) analyses of neural
network (NN) classifiers. While the underlying information bottleneck theory and the claim …

An effective low-rank compression with a joint rank selection followed by a compression-friendly training

M Eo, S Kang, W Rhee - Neural Networks, 2023 - Elsevier
Low-rank compression of a neural network is one of the popular compression techniques,
where it has been known to have two main challenges. The first challenge is determining the …

A Highly Effective Low-Rank Compression of Deep Neural Networks with Modified Beam-Search and Modified Stable Rank

M Eo, S Kang, W Rhee - arXiv preprint arXiv:2111.15179, 2021 - arxiv.org
Compression has emerged as one of the essential deep learning research topics, especially
for the edge devices that have limited computation power and storage capacity. Among the …