A survey of tuning parameter selection for high-dimensional regression

Y Wu, L Wang - Annual review of statistics and its application, 2020 - annualreviews.org
Penalized (or regularized) regression, as represented by lasso and its variants, has become
a standard technique for analyzing high-dimensional data when the number of variables …

On the prediction performance of the lasso

AS Dalalyan, M Hebiri, J Lederer - 2017 - projecteuclid.org
Although the Lasso has been extensively studied, the relationship between its prediction
performance and the correlations of the covariates is not fully understood. In this paper, we …

A tuning-free robust and efficient approach to high-dimensional regression

L Wang, B Peng, J Bradic, R Li, Y Wu - Journal of the American …, 2020 - Taylor & Francis
We introduce a novel approach for high-dimensional regression with theoretical guarantees.
The new procedure overcomes the challenge of tuning parameter selection of Lasso and …

New bounds for hyperparameter tuning of regression problems across instances

MFF Balcan, A Nguyen… - Advances in Neural …, 2024 - proceedings.neurips.cc
The task of tuning regularization coefficients in regularized regression models with provable
guarantees across problem instances still poses a significant challenge in the literature. This …

Rank-one convexification for sparse regression

A Atamturk, A Gomez - arXiv preprint arXiv:1901.10334, 2019 - arxiv.org
Sparse regression models are increasingly prevalent due to their ease of interpretability and
superior out-of-sample performance. However, the exact model of sparse regression with an …

[HTML][HTML] Estimation of high-dimensional graphical models using regularized score matching

L Lin, M Drton, A Shojaie - Electronic journal of statistics, 2016 - ncbi.nlm.nih.gov
Graphical models are widely used to model stochastic dependences among large
collections of variables. We introduce a new method of estimating undirected conditional …

Provably tuning the ElasticNet across instances

MFF Balcan, M Khodak, D Sharma… - Advances in Neural …, 2022 - proceedings.neurips.cc
An important unresolved challenge in the theory of regularization is to set the regularization
coefficients of popular techniques like the ElasticNet with general provable guarantees. We …

Multi-task learning with summary statistics

P Knight, R Duan - Advances in Neural Information …, 2024 - proceedings.neurips.cc
Multi-task learning has emerged as a powerful machine learning paradigm for integrating
data from multiple sources, leveraging similarities between tasks to improve overall model …

Inference for high-dimensional instrumental variables regression

D Gold, J Lederer, J Tao - Journal of Econometrics, 2020 - Elsevier
This paper concerns statistical inference for the components of a high-dimensional
regression parameter despite possible endogeneity of each regressor. Given a first-stage …

Non-invasive evaluation for benign and malignant subcentimeter pulmonary ground-glass nodules (≤ 1 cm) based on CT texture analysis

X Hu, W Ye, Z Li, C Chen, S Cheng, X Lv… - The British Journal of …, 2020 - academic.oup.com
Objectives: To investigate potential diagnostic model for predicting benign or malignant
status of subcentimeter pulmonary ground-glass nodules (SPGGNs)(≤ 1 cm) based on CT …