Hutch++: Optimal stochastic trace estimation

RA Meyer, C Musco, C Musco, DP Woodruff - Symposium on Simplicity in …, 2021 - SIAM
We study the problem of estimating the trace of a matrix A that can only be accessed through
matrix-vector multiplication. We introduce a new randomized algorithm, Hutch++, which …

A review of change of variable formulas for generative modeling

U Köthe - arXiv preprint arXiv:2308.02652, 2023 - arxiv.org
Change-of-variables (CoV) formulas allow to reduce complicated probability densities to
simpler ones by a learned transformation with tractable Jacobian determinant. They are thus …

Fast Estimation of via Stochastic Lanczos Quadrature

S Ubaru, J Chen, Y Saad - SIAM Journal on Matrix Analysis and Applications, 2017 - SIAM
The problem of estimating the trace of matrix functions appears in applications ranging from
machine learning and scientific computing, to computational biology. This paper presents an …

Scalable log determinants for Gaussian process kernel learning

K Dong, D Eriksson, H Nickisch… - Advances in Neural …, 2017 - proceedings.neurips.cc
For applications as varied as Bayesian neural networks, determinantal point processes,
elliptical graphical models, and kernel learning for Gaussian processes (GPs), one must …

Large-scale log-determinant computation through stochastic Chebyshev expansions

I Han, D Malioutov, J Shin - International Conference on …, 2015 - proceedings.mlr.press
Logarithms of determinants of large positive definite matrices appear ubiquitously in
machine learning applications including Gaussian graphical and Gaussian process models …

Krylov-aware stochastic trace estimation

T Chen, E Hallman - SIAM Journal on Matrix Analysis and Applications, 2023 - SIAM
We introduce an algorithm for estimating the trace of a matrix function using implicit products
with a symmetric matrix. Existing methods for implicit trace estimation of a matrix function …

On randomized trace estimates for indefinite matrices with an application to determinants

A Cortinovis, D Kressner - Foundations of Computational Mathematics, 2022 - Springer
Randomized trace estimation is a popular and well-studied technique that approximates the
trace of a large-scale matrix B by computing the average of x^ T Bx x TB x for many samples …

Approximating spectral sums of large-scale matrices using stochastic Chebyshev approximations

I Han, D Malioutov, H Avron, J Shin - SIAM Journal on Scientific Computing, 2017 - SIAM
Computation of the trace of a matrix function plays an important role in many scientific
computing applications, including applications in machine learning, computational physics …

Randomized matrix-free trace and log-determinant estimators

AK Saibaba, A Alexanderian, ICF Ipsen - Numerische Mathematik, 2017 - Springer
We present randomized algorithms for estimating the trace and determinant of Hermitian
positive semi-definite matrices. The algorithms are based on subspace iteration, and access …

Exponential family estimation via adversarial dynamics embedding

B Dai, Z Liu, H Dai, N He, A Gretton… - Advances in …, 2019 - proceedings.neurips.cc
We present an efficient algorithm for maximum likelihood estimation (MLE) of exponential
family models, with a general parametrization of the energy function that includes neural …