Efficient Euclidean projections in linear time

J Liu, J Ye - Proceedings of the 26th annual international …, 2009 - dl.acm.org
We consider the problem of computing the Euclidean projection of a vector of length n onto a
closed convex set including the l 1 ball and the specialized polyhedra employed in (Shalev …

Pathwise coordinate optimization for sparse learning: Algorithm and theory

T Zhao, H Liu, T Zhang - 2018 - projecteuclid.org
Supplement to “Pathwise coordinate optimization for sparse learning: Algorithm and theory”.
The supplementary materials contain the supplementary proofs of the theoretical lemmas in …

[PDF][PDF] Sparse convex optimization methods for machine learning

M Jaggi - 2011 - infoscience.epfl.ch
Convex optimization is at the core of many of today's analysis tools for large datasets, and in
particular machine learning methods. In this thesis we will study the general setting of …

Coordinate descent converges faster with the gauss-southwell rule than random selection

J Nutini, M Schmidt, I Laradji… - International …, 2015 - proceedings.mlr.press
There has been significant recent work on the theory and application of randomized
coordinate descent algorithms, beginning with the work of Nesterov [SIAM J. Optim., 22 (2) …

Sparse logistic regression learns all discrete pairwise graphical models

S Wu, S Sanghavi, AG Dimakis - Advances in Neural …, 2019 - proceedings.neurips.cc
We characterize the effectiveness of a classical algorithm for recovering the Markov graph of
a general discrete pairwise graphical model from iid samples. The algorithm is …

Learning sparse polynomial functions

A Andoni, R Panigrahy, G Valiant, L Zhang - … of the twenty-fifth annual ACM …, 2014 - SIAM
We study the question of learning a sparse multivariate polynomial over the real domain. In
particular, for some unknown polynomial f (x) of degree-d and k monomials, we show how to …

Multi-stage convex relaxation for learning with sparse regularization

T Zhang - Advances in neural information processing …, 2008 - proceedings.neurips.cc
We study learning formulations with non-convex regularizaton that are natural for sparse
linear models. There are two approaches to this problem:(1) Heuristic methods such as …

Fast, provably convergent irls algorithm for p-norm linear regression

D Adil, R Peng, S Sachdeva - Advances in Neural …, 2019 - proceedings.neurips.cc
Linear regression in Lp-norm is a canonical optimization problem that arises in several
applications, including sparse recovery, semi-supervised learning, and signal processing …

Adaptive forward-backward greedy algorithm for sparse learning with linear models

T Zhang - Advances in neural information processing …, 2008 - proceedings.neurips.cc
Consider linear prediction models where the target function is a sparse linear combination of
a set of basis functions. We are interested in the problem of identifying those basis functions …

Subspace learning with partial information

A Gonen, D Rosenbaum, YC Eldar… - Journal of Machine …, 2016 - jmlr.org
We study randomized sketching methods for approximately solving least-squares problem
with a general convex constraint. The quality of a least-squares approximation can be …