High dimensional inference with random maximum a-posteriori perturbations

T Hazan, F Orabona, AD Sarwate… - IEEE Transactions …, 2019 - ieeexplore.ieee.org
This paper presents a new approach, called perturb-max, for high-dimensional statistical
inference in graphical models that is based on applying random perturbations followed by …

On measure concentration of random maximum a-posteriori perturbations

F Orabona, T Hazan, A Sarwate… - … on Machine Learning, 2014 - proceedings.mlr.press
The maximum a-posteriori (MAP) perturbation framework has emerged as a useful approach
for inference and learning in high dimensional complex models. By maximizing a randomly …

Prediction in High-Dimensional Statistical Modelling Using Greedy Algorithms and Information Theoretic Criteria

F Li - 2020 - researchspace.auckland.ac.nz
A substantial amount of research in the elds of statistics, machine learning and signal
processing during the last three decades considers the problem of variable selection for …

Finite sample posterior concentration in high-dimensional regression

N Strawn, A Armagan, R Saab, L Carin… - arXiv preprint arXiv …, 2012 - arxiv.org
We study the behavior of the posterior distribution in high-dimensional Bayesian Gaussian
linear regression models having $ p\gg n $, with $ p $ the number of predictors and $ n $ the …

High dimensional expectation-maximization algorithm: Statistical optimization and asymptotic normality

Z Wang, Q Gu, Y Ning, H Liu - arXiv preprint arXiv:1412.8729, 2014 - arxiv.org
We provide a general theory of the expectation-maximization (EM) algorithm for inferring
high dimensional latent variable models. In particular, we make two contributions:(i) For …

Consistent risk estimation in moderately high-dimensional linear regression

J Xu, A Maleki, KR Rad, D Hsu - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Risk estimation is at the core of many learning systems. The importance of this problem has
motivated researchers to propose different schemes, such as cross validation, generalized …

Confidence intervals and hypothesis testing for high-dimensional statistical models

A Javanmard, A Montanari - Advances in neural information …, 2013 - proceedings.neurips.cc
Fitting high-dimensional statistical models often requires the use of non-linear parameter
estimation procedures. As a consequence, it is generally impossible to obtain an exact …

High dimensional em algorithm: Statistical optimization and asymptotic normality

Z Wang, Q Gu, Y Ning, H Liu - Advances in neural …, 2015 - proceedings.neurips.cc
We provide a general theory of the expectation-maximization (EM) algorithm for inferring
high dimensional latent variable models. In particular, we make two contributions:(i) For …

Universality laws for high-dimensional learning with random features

H Hu, YM Lu - IEEE Transactions on Information Theory, 2022 - ieeexplore.ieee.org
We prove a universality theorem for learning with random features. Our result shows that, in
terms of training and generalization errors, a random feature model with a nonlinear …

Robust high dimensional expectation maximization algorithm via trimmed hard thresholding

D Wang, X Guo, S Li, J Xu - Machine Learning, 2020 - Springer
In this paper, we study the problem of estimating latent variable models with arbitrarily
corrupted samples in high dimensional space (ie, d ≫ nd≫ n) where the underlying …