RandNLA: randomized numerical linear algebra

P Drineas, MW Mahoney - Communications of the ACM, 2016 - dl.acm.org
RandNLA: randomized numerical linear algebra Page 1 80 COMMUNICATIONS OF THE ACM
| JUNE 2016 | VOL. 59 | NO. 6 review articles DOI:10.1145/2842602 Randomization offers new …

[HTML][HTML] Dictionary learning for integrative, multimodal and scalable single-cell analysis

Y Hao, T Stuart, MH Kowalski, S Choudhary… - Nature …, 2024 - nature.com
Mapping single-cell sequencing profiles to comprehensive reference datasets provides a
powerful alternative to unsupervised analysis. However, most reference datasets are …

Deja vu: Contextual sparsity for efficient llms at inference time

Z Liu, J Wang, T Dao, T Zhou, B Yuan… - International …, 2023 - proceedings.mlr.press
Large language models (LLMs) with hundreds of billions of parameters have sparked a new
wave of exciting AI applications. However, they are computationally expensive at inference …

Randomized numerical linear algebra: Foundations and algorithms

PG Martinsson, JA Tropp - Acta Numerica, 2020 - cambridge.org
This survey describes probabilistic algorithms for linear algebraic computations, such as
factorizing matrices and solving linear systems. It focuses on techniques that have a proven …

Solving linear programs in the current matrix multiplication time

MB Cohen, YT Lee, Z Song - Journal of the ACM (JACM), 2021 - dl.acm.org
This article shows how to solve linear programs of the form min Ax= b, x≥ 0 c⊤ x with n
variables in time O*((n ω+ n 2.5− α/2+ n 2+ 1/6) log (n/δ)), where ω is the exponent of matrix …

Minimum cost flows, MDPs, and ℓ1-regression in nearly linear time for dense instances

J Van Den Brand, YT Lee, YP Liu, T Saranurak… - Proceedings of the 53rd …, 2021 - dl.acm.org
In this paper we provide new randomized algorithms with improved runtimes for solving
linear programs with two-sided constraints. In the special case of the minimum cost flow …

An introduction to matrix concentration inequalities

JA Tropp - Foundations and Trends® in Machine Learning, 2015 - nowpublishers.com
Random matrices now play a role in many areas of theoretical, applied, and computational
mathematics. Therefore, it is desirable to have tools for studying random matrices that are …

Sketching as a tool for numerical linear algebra

DP Woodruff - … and Trends® in Theoretical Computer Science, 2014 - nowpublishers.com
This survey highlights the recent advances in algorithms for numerical linear algebra that
have come from the technique of linear sketching, whereby given a matrix, one first …

[图书][B] Machine learning: a Bayesian and optimization perspective

S Theodoridis - 2015 - books.google.com
This tutorial text gives a unifying perspective on machine learning by covering both
probabilistic and deterministic approaches-which are based on optimization techniques …

An online and unified algorithm for projection matrix vector multiplication with application to empirical risk minimization

L Qin, Z Song, L Zhang, D Zhuo - … Conference on Artificial …, 2023 - proceedings.mlr.press
Online matrix vector multiplication is a fundamental step and bottleneck in many machine
learning algorithms. It is defined as follows: given a matrix at the pre-processing phase, at …