Sparse low-rank matrix approximation for data compression

J Hou, LP Chau… - IEEE Transactions on …, 2015 - ieeexplore.ieee.org
… However, its potential for data compression has not yet been fully investigated in the … sparse
lowrank matrix approximation (SLRMA), an effective computational tool for data compression

On the compression of low rank matrices

H Cheng, Z Gimbutas, PG Martinsson, V Rokhlin - SIAM Journal on Scientific …, 2005 - SIAM
… We have described a compression scheme for low rank matrices. For a matrix A of dimensionality
m × n and rank k, the factorization can be applied to an arbitrary vector for the cost of (n …

Matrix compression via randomized low rank and low precision factorization

R Saha, V Srivastava, M Pilanci - Advances in Neural …, 2023 - proceedings.neurips.cc
… Although prohibitively large, such matrices are often approximately low rank. We propose …
a low rank decomposition of any matrix A as A ≈ LR, where L and R are the low rank factors. …

From compressed sensing to low-rank matrix recovery: theory and applications

P Yi-Gang, S Jin-Li, DAI Qiong-Hai, XU Wen-Li - Acta Automatica Sinica, 2013 - Elsevier
compressed sensing; in Section 2, we introduce the fundamental theory of matrix rank
minimization and low-rank matrix … introduce the fundamental theory of low-rank matrix recovery; in …

Low-rank compression of neural nets: Learning the rank of each layer

Y Idelbayev… - Proceedings of the IEEE …, 2020 - openaccess.thecvf.com
compression forms we focus on low-rank compression, whose roots lie in matrix algebra, and
where we replace a matrix W with another one having lower rank (… smaller matrices). That …

Learning and compressing: low-rank matrix factorization for deep neural network compression

G Cai, J Li, X Liu, Z Chen, H Zhang - Applied Sciences, 2023 - mdpi.com
… method may have its own unique accuracy-compression ratio. … a low-rank DNN compression
algorithm that can solve the rank selection and freely control the degree of compression. …

Online embedding compression for text classification using low rank matrix factorization

A Acharya, R Goel, A Metallinou, I Dhillon - Proceedings of the aaai …, 2019 - ojs.aaai.org
… Existing compression methods are either lossy or introduce significant latency. We propose
compression method that leverages low rank matrix factorization during training, to compress

On compressing deep models by low rank and sparse decomposition

X Yu, T Liu, X Wang, D Tao - Proceedings of the IEEE …, 2017 - openaccess.thecvf.com
matrix components usually reside in low-rank subspaces but some important entries are
sparsely scattered in the weight matrices and … for deep compression by the low-rank and sparse …

On the effectiveness of low-rank matrix factorization for lstm model compression

GI Winata, A Madotto, J Shin, EJ Barezi… - arXiv preprint arXiv …, 2019 - arxiv.org
… the limits of compressing LSTM gates using low-rank matrix factorization and … Low-Rank
Matrix Factorization works better in general than pruning, except for particularly sparse matrices

Sparse low rank factorization for deep neural network compression

S Swaminathan, D Garg, R Kannan, F Andres - Neurocomputing, 2020 - Elsevier
… sparse low rank (SLR) method which sparsifies SVD matrices to achieve better compression
rate by keeping lower rank … We demonstrate the effectiveness of our method in compressing