Optimal average-case reductions to sparse pca: From weak assumptions to strong hardness

M Brennan, G Bresler - Conference on Learning Theory, 2019 - proceedings.mlr.press
In the past decade, sparse principal component analysis has emerged as an archetypal
problem for illustrating statistical-computational tradeoffs. This trend has largely been driven …

On the approximability of sparse PCA

SO Chan, D Papailliopoulos… - … on Learning Theory, 2016 - proceedings.mlr.press
It is well known that Sparse PCA (Sparse Principal Component Analysis) is NP-hard to solve
exactly on worst-case instances. What is the complexity of solving Sparse PCA …

Free energy wells and overlap gap property in sparse PCA

GB Arous, AS Wein, I Zadik - Conference on Learning …, 2020 - proceedings.mlr.press
We study a variant of the sparse PCA (principal component analysis) problem in the “hard”
regime, where the inference task is possible yet no polynomial-time algorithm is known to …

Sum-of-squares lower bounds for sparse PCA

T Ma, A Wigderson - Advances in Neural Information …, 2015 - proceedings.neurips.cc
This paper establishes a statistical versus computational trade-offfor solving a basic high-
dimensional machine learning problem via a basic convex relaxation method. Specifically …

Sparse PCA via covariance thresholding

Y Deshp, A Montanari - Journal of Machine Learning Research, 2016 - jmlr.org
In sparse principal component analysis we are given noisy observations of a low-rank matrix
of dimension n× p and seek to reconstruct it under additional sparsity assumptions. In …

Learning sparse polynomial functions

A Andoni, R Panigrahy, G Valiant, L Zhang - … of the twenty-fifth annual ACM …, 2014 - SIAM
We study the question of learning a sparse multivariate polynomial over the real domain. In
particular, for some unknown polynomial f (x) of degree-d and k monomials, we show how to …

NP-hardness and inapproximability of sparse PCA

M Magdon-Ismail - Information Processing Letters, 2017 - Elsevier
We give a reduction from clique to establish that sparse Principal Components Analysis
(sparse PCA) is NP-hard. Using our reduction, we exclude a fully polynomial time …

Sub-exponential time Sum-of-Squares lower bounds for Principal Components Analysis

A Potechin, G Rajendran - Advances in Neural Information …, 2022 - proceedings.neurips.cc
Abstract Principal Components Analysis (PCA) is a dimension-reduction technique widely
used in machine learning and statistics. However, due to the dependence of the principal …

Tighten after relax: Minimax-optimal sparse PCA in polynomial time

Z Wang, H Lu, H Liu - Advances in neural information …, 2014 - proceedings.neurips.cc
We provide statistical and computational analysis of sparse Principal Component Analysis
(PCA) in high dimensions. The sparse PCA problem is highly nonconvex in nature …

Subexponential-time algorithms for sparse PCA

Y Ding, D Kunisky, AS Wein, AS Bandeira - Foundations of Computational …, 2024 - Springer
We study the computational cost of recovering a unit-norm sparse principal component x∈
R n planted in a random matrix, in either the Wigner or Wishart spiked model (observing …