User-friendly introduction to PAC-Bayes bounds

P Alquier - Foundations and Trends® in Machine Learning, 2024 - nowpublishers.com
Aggregated predictors are obtained by making a set of basic predictors vote according to
some weights, that is, to some probability distribution. Randomized predictors are obtained …

Springer series in statistics

P Bickel, P Diggle, S Fienberg, U Gather, I Olkin… - Principles and Theory …, 2009 - Springer
The idea for this book came from the time the authors spent at the Statistics and Applied
Mathematical Sciences Institute (SAMSI) in Research Triangle Park in North Carolina …

High-dimensional graphs and variable selection with the lasso

N Meinshausen, P Bühlmann - 2006 - projecteuclid.org
The pattern of zero entries in the inverse covariance matrix of a multivariate normal
distribution corresponds to conditional independence restrictions between variables …

Simultaneous analysis of Lasso and Dantzig selector

PJ Bickel, Y Ritov, AB Tsybakov - 2009 - projecteuclid.org
We show that, under a sparsity scenario, the Lasso estimator and the Dantzig selector
exhibit similar behavior. For both methods, we derive, in parallel, oracle inequalities for the …

Sparse additive models

P Ravikumar, J Lafferty, H Liu… - Journal of the Royal …, 2009 - academic.oup.com
We present a new class of methods for high dimensional non-parametric regression and
classification called sparse additive models. Our methods combine ideas from sparse linear …

Sparse PCA: Optimal rates and adaptive estimation

TT Cai, Z Ma, Y Wu - 2013 - projecteuclid.org
Sparse PCA: Optimal rates and adaptive estimation Page 1 The Annals of Statistics 2013, Vol.
41, No. 6, 3074–3110 DOI: 10.1214/13-AOS1178 © Institute of Mathematical Statistics, 2013 …

[PDF][PDF] Consistency of the group lasso and multiple kernel learning.

FR Bach - Journal of Machine Learning Research, 2008 - jmlr.org
We consider the least-square regression problem with regularization by a block l1-norm, that
is, a sum of Euclidean norms over spaces of dimensions larger than one. This problem …

Jackknife model averaging

BE Hansen, JS Racine - Journal of Econometrics, 2012 - Elsevier
We consider the problem of obtaining appropriate weights for averaging M approximate
(misspecified) models for improved estimation of an unknown conditional mean in the face …

[图书][B] Principles and theory for data mining and machine learning

B Clarke, E Fokoue, HH Zhang - 2009 - books.google.com
The idea for this book came from the time the authors spent at the Statistics and Applied
Mathematical Sciences Institute (SAMSI) in Research Triangle Park in North Carolina …

Sparsity oracle inequalities for the Lasso

F Bunea, A Tsybakov, M Wegkamp - 2007 - projecteuclid.org
This paper studies oracle properties of ℓ 1-penalized least squares in nonparametric
regression setting with random design. We show that the penalized least squares estimator …