Randomized numerical linear algebra: A perspective on the field with an eye to software

R Murray, J Demmel, MW Mahoney… - arXiv preprint arXiv …, 2023 - arxiv.org
Randomized numerical linear algebra-RandNLA, for short-concerns the use of
randomization as a resource to develop improved algorithms for large-scale linear algebra …

Recent and upcoming developments in randomized numerical linear algebra for machine learning

M Dereziński, MW Mahoney - Proceedings of the 30th ACM SIGKDD …, 2024 - dl.acm.org
Large matrices arise in many machine learning and data analysis applications, including as
representations of datasets, graphs, model weights, and first and second-order derivatives …

Correlation aware sparsified mean estimation using random projection

S Jiang, P Sharma, G Joshi - Advances in Neural …, 2024 - proceedings.neurips.cc
We study the problem of communication-efficient distributed vector mean estimation, which
is a commonly used subroutine in distributed optimization and Federated Learning (FL) …

Gradient coding through iterative block leverage score sampling

N Charalambides, M Pilanci, A Hero - arXiv preprint arXiv:2308.03096, 2023 - arxiv.org
We generalize the leverage score sampling sketch for $\ell_2 $-subspace embeddings, to
accommodate sampling subsets of the transformed data, so that the sketching approach is …

Gradient Coding With Iterative Block Leverage Score Sampling

N Charalambides, M Pilanci… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Gradient coding is a method for mitigating straggling servers in a centralized computing
network that uses erasure-coding techniques to distributively carry out first-order …

Parallel algorithms for computing low rank decompositions of matrices and tensors

M Beaupère - 2023 - theses.hal.science
Matrices and tensors are amongst the most common tools to represent and exploit
information. Some sources produce large quantities of data, and analyzing the information …

Randomized Householder QR

L Grigori, E Timsit - arXiv preprint arXiv:2405.10923, 2024 - arxiv.org
This paper introduces a randomized Householder QR factorization (RHQR). This
factorization can be used to obtain a well conditioned basis of a set of vectors and thus can …

Coding Theory and Randomized Sketching for Distributed Optimization

N Charalambides - 2023 - search.proquest.com
With the advent of massive datasets, distributed techniques for processing information and
carrying out computations are expected to enable exceptional possibilities for engineering …