Fundamental limits in structured principal component analysis and how to reach them

J Barbier, F Camilli, M Mondelli… - Proceedings of the …, 2023 - National Acad Sciences
How do statistical dependencies in measurement noise influence high-dimensional
inference? To answer this, we study the paradigmatic spiked matrix model of principal …

A unifying tutorial on approximate message passing

OY Feng, R Venkataramanan, C Rush… - … and Trends® in …, 2022 - nowpublishers.com
Over the last decade or so, Approximate Message Passing (AMP) algorithms have become
extremely popular in various structured high-dimensional statistical problems. Although the …

Learning gaussian mixtures with generalized linear models: Precise asymptotics in high-dimensions

B Loureiro, G Sicuro, C Gerbelot… - Advances in …, 2021 - proceedings.neurips.cc
Generalised linear models for multi-class classification problems are one of the fundamental
building blocks of modern machine learning tasks. In this manuscript, we characterise the …

Universality of approximate message passing with semirandom matrices

R Dudeja, Y M. Lu, S Sen - The Annals of Probability, 2023 - projecteuclid.org
Universality of approximate message passing with semirandom matrices Page 1 The
Annals of Probability 2023, Vol. 51, No. 5, 1616–1683 https://doi.org/10.1214/23-AOP1628 …

Estimation in rotationally invariant generalized linear models via approximate message passing

R Venkataramanan, K Kögler… - … on Machine Learning, 2022 - proceedings.mlr.press
We consider the problem of signal estimation in generalized linear models defined via
rotationally invariant design matrices. Since these matrices can have an arbitrary spectral …

Universality of regularized regression estimators in high dimensions

Q Han, Y Shen - The Annals of Statistics, 2023 - projecteuclid.org
Universality of regularized regression estimators in high dimensions Page 1 The Annals of
Statistics 2023, Vol. 51, No. 4, 1799–1823 https://doi.org/10.1214/23-AOS2309 © Institute of …

Spectral universality in regularized linear regression with nearly deterministic sensing matrices

R Dudeja, S Sen, YM Lu - IEEE Transactions on Information …, 2024 - ieeexplore.ieee.org
It has been observed that the performances of many high-dimensional estimation problems
are universal with respect to underlying sensing (or design) matrices. Specifically, matrices …

PCA initialization for approximate message passing in rotationally invariant models

M Mondelli, R Venkataramanan - Advances in Neural …, 2021 - proceedings.neurips.cc
We study the problem of estimating a rank-1 signal in the presence of rotationally invariant
noise--a class of perturbations more general than Gaussian noise. Principal Component …

The price of ignorance: how much does it cost to forget noise structure in low-rank matrix estimation?

J Barbier, TQ Hou, M Mondelli… - Advances in Neural …, 2022 - proceedings.neurips.cc
We consider the problem of estimating a rank-$1 $ signal corrupted by structured rotationally
invariant noise, and address the following question:\emph {how well do inference algorithms …

On the convergence of orthogonal/vector AMP: Long-memory message-passing strategy

K Takeuchi - IEEE Transactions on Information Theory, 2022 - ieeexplore.ieee.org
Orthogonal/vector approximate message-passing (AMP) is a powerful message-passing
(MP) algorithm for signal reconstruction in compressed sensing. This paper proves the …