M Dereziński, J Yang - Proceedings of the 56th Annual ACM Symposium …, 2024 - dl.acm.org
We give a stochastic optimization algorithm that solves a dense n× n real-valued linear system Ax= b, returning x such that|| A x− b||≤ є|| b|| in time: Õ ((n 2+ nk ω− 1) log1/є), where …
We take a random matrix theory approach to random sketching and show an asymptotic first- order equivalence of the regularized sketched pseudoinverse of a positive semidefinite …
K Hänni, J Mendel, D Vaintrob, L Chan - arXiv preprint arXiv:2408.05451, 2024 - arxiv.org
Superposition--when a neural network represents more``features''than it has dimensions-- seems to pose a serious challenge to mechanistically interpreting current AI systems …
Rational approximation is a powerful tool to obtain accurate surrogates for nonlinear functions that are easy to evaluate and linearize. The interpolatory adaptive Antoulas …
Z Drmač - ACM Transactions on Mathematical Software, 2024 - dl.acm.org
The Dynamic Mode Decomposition (DMD) is a versatile and increasingly popular method for data driven analysis of dynamical systems that arise in a variety of applications in, eg …
P Patil, D LeJeune - arXiv preprint arXiv:2310.04357, 2023 - arxiv.org
We employ random matrix theory to establish consistency of generalized cross validation (GCV) for estimating prediction risks of sketched ridge regression ensembles, enabling …
Parker and Lê introduced random butterfly transforms (RBTs) as a preprocessing technique to replace pivoting in dense LU factorization. Unfortunately, their FFT-like recursive structure …
Z Drmač - ACM Transactions on Mathematical Software, 2022 - dl.acm.org
The Dynamic Mode Decomposition (DMD) is a method for computational analysis of nonlinear dynamical systems in data driven scenarios. Based on high fidelity numerical …
I Hong, S Na, MW Mahoney… - … Conference on Machine …, 2023 - proceedings.mlr.press
We consider solving equality-constrained nonlinear, nonconvex optimization problems. This class of problems appears widely in a variety of applications in machine learning and …