Tensors, sparse problems and conditional hardness

EM Persu - 2018 - dspace.mit.edu
In this thesis we study the interplay between theoretical computer science and machine
learning in three different directions. First, we make a connection between two ubiquitous …

Sparse PCA from sparse linear regression

G Bresler, SM Park, M Persu - Advances in Neural …, 2018 - proceedings.neurips.cc
Abstract Sparse Principal Component Analysis (SPCA) and Sparse Linear Regression
(SLR) have a wide range of applications and have attracted a tremendous amount of …

Optimal average-case reductions to sparse pca: From weak assumptions to strong hardness

M Brennan, G Bresler - Conference on Learning Theory, 2019 - proceedings.mlr.press
In the past decade, sparse principal component analysis has emerged as an archetypal
problem for illustrating statistical-computational tradeoffs. This trend has largely been driven …

On the power of preconditioning in sparse linear regression

JA Kelner, F Koehler, R Meka… - 2021 IEEE 62nd Annual …, 2022 - ieeexplore.ieee.org
Sparse linear regression is a fundamental problem in high-dimensional statistics, but
strikingly little is known about how to efficiently solve it without restrictive conditions on the …

Meta Sparse Principal Component Analysis

I Banerjee, J Honorio - arXiv preprint arXiv:2208.08938, 2022 - arxiv.org
We study the meta-learning for support (ie the set of non-zero entries) recovery in high-
dimensional Principal Component Analysis. We reduce the sufficient sample complexity in a …

Sparse principal component analysis: Algorithms and applications

Y Zhang - 2011 - escholarship.org
The Sparse Principal Component Analysis (Sparse PCA) problem is a variant of the
classical PCA problem. The goal of Sparse PCA is to achieve a trade-off between the …

Approximation algorithms for sparse principal component analysis

A Chowdhury, P Drineas, DP Woodruff… - arXiv preprint arXiv …, 2020 - arxiv.org
Principal component analysis (PCA) is a widely used dimension reduction technique in
machine learning and multivariate statistics. To improve the interpretability of PCA, various …

Lasso with Latents: Efficient Estimation, Covariate Rescaling, and Computational-Statistical Gaps

J Kelner, F Koehler, R Meka, D Rohatgi - arXiv preprint arXiv:2402.15409, 2024 - arxiv.org
It is well-known that the statistical performance of Lasso can suffer significantly when the
covariates of interest have strong correlations. In particular, the prediction error of Lasso …

Sparse PCA With Multiple Components

R Cory-Wright, J Pauphilet - arXiv preprint arXiv:2209.14790, 2022 - arxiv.org
Sparse Principal Component Analysis is a cardinal technique for obtaining combinations of
features, or principal components (PCs), that explain the variance of high-dimensional …

Sparse PCA via covariance thresholding

Y Deshp, A Montanari - Journal of Machine Learning Research, 2016 - jmlr.org
In sparse principal component analysis we are given noisy observations of a low-rank matrix
of dimension n× p and seek to reconstruct it under additional sparsity assumptions. In …