A geometric view on constrained M-estimators

YH Li, YP Hsieh, N Zerbib, V Cevher - arXiv preprint arXiv:1506.08163, 2015 - arxiv.org
We study the estimation error of constrained M-estimators, and derive explicit upper bounds
on the expected estimation error determined by the Gaussian width of the constraint set …

Regularized M-estimators with nonconvexity: Statistical and algorithmic theory for local optima

PL Loh, MJ Wainwright - The Journal of Machine Learning Research, 2015 - dl.acm.org
We provide novel theoretical results regarding local optima of regularized M-estimators,
allowing for nonconvexity in both loss and penalty functions. Under restricted strong …

The mismatch principle: The generalized lasso under large model uncertainties

M Genzel, G Kutyniok - arXiv preprint arXiv:1808.06329, 2018 - arxiv.org
We study the estimation capacity of the generalized Lasso, ie, least squares minimization
combined with a (convex) structural constraint. While Lasso-type estimators were originally …

Generalized Information Criteria for Structured Sparse Models

EF Mendes, GJP Pinto - arXiv preprint arXiv:2309.01764, 2023 - arxiv.org
Regularized m-estimators are widely used due to their ability of recovering a low-
dimensional model in high-dimensional scenarios. Some recent efforts on this subject …

Existence of solutions to the nonlinear equations characterizing the precise error of M-estimators

PC Bellec, T Koriyama - arXiv preprint arXiv:2312.13254, 2023 - arxiv.org
Major progress has been made in the previous decade to characterize the asymptotic
behavior of regularized M-estimators in high-dimensional regression problems in the …

[PDF][PDF] Local optima of nonconvex regularized M-estimators

PL Loh - 2013 - eecs.berkeley.edu
The problem of optimizing a nonconvex function is known to be computationally intractable
in general [19, 24]. Unlike convex functions, nonconvex functions may possess local optima …

Error estimation and adaptive tuning for unregularized robust M-estimator

PC Bellec, T Koriyama - arXiv preprint arXiv:2312.13257, 2023 - arxiv.org
We consider unregularized robust M-estimators for linear models under Gaussian design
and heavy-tailed noise, in the proportional asymptotics regime where the sample size n and …

Errors-in-variables models with dependent measurements

M Rudelson, S Zhou - 2017 - projecteuclid.org
Suppose that we observe y∈R^n and X∈R^n*m in the following errors-in-variables model:
y&= &X_ 0 β^*+ ϵ\X&= &X_ 0+ W where X_0 is an n*m design matrix with independent …

Optimal convex -estimation via score matching

OY Feng, YC Kao, M Xu, RJ Samworth - arXiv preprint arXiv:2403.16688, 2024 - arxiv.org
In the context of linear regression, we construct a data-driven convex loss function with
respect to which empirical risk minimisation yields optimal asymptotic variance in the …

[PDF][PDF] Adaptive minimax regression estimation over sparse lq-hulls

Z Wang, S Paterlini, F Gao, Y Yang - The Journal of Machine Learning …, 2014 - jmlr.org
Given a dictionary of Mn predictors, in a random design regression setting with n
observations, we construct estimators that target the best performance among all the linear …