The group square-root lasso: Theoretical properties and fast algorithms

F Bunea, J Lederer, Y She - IEEE Transactions on Information …, 2013 - ieeexplore.ieee.org
IEEE Transactions on Information Theory, 2013ieeexplore.ieee.org
We introduce and study the group square-root lasso (GSRL) method for estimation in high
dimensional sparse regression models with group structure. The new estimator minimizes
the square root of the residual sum of squares plus a penalty term proportional to the sum of
the Euclidean norms of groups of the regression parameter vector. The net advantage of the
method over the existing group lasso-type procedures consists in the form of the
proportionality factor used in the penalty term, which for GSRL is independent of the …
We introduce and study the group square-root lasso (GSRL) method for estimation in high dimensional sparse regression models with group structure. The new estimator minimizes the square root of the residual sum of squares plus a penalty term proportional to the sum of the Euclidean norms of groups of the regression parameter vector. The net advantage of the method over the existing group lasso-type procedures consists in the form of the proportionality factor used in the penalty term, which for GSRL is independent of the variance of the error terms. This is of crucial importance in models with more parameters than the sample size, when estimating the variance of the noise becomes as difficult as the original problem. We show that the GSRL estimator adapts to the unknown sparsity of the regression vector, and has the same optimal estimation and prediction accuracy as the GL estimators, under the same minimal conditions on the model. This extends the results recently established for the square-root lasso, for sparse regression without group structure. Moreover, as a new type of result for square-root lasso methods, with or without groups, we study correct pattern recovery, and show that it can be achieved under conditions similar to those needed by the lasso or group-lasso-type methods, but with a simplified tuning strategy. We implement our method via a new algorithm, with proved convergence properties, which, unlike existing methods, scales well with the dimension of the problem. Our simulation studies support strongly our theoretical findings.
ieeexplore.ieee.org
以上显示的是最相近的搜索结果。 查看全部搜索结果

Google学术搜索按钮

example.edu/paper.pdf
搜索
获取 PDF 文件
引用
References