Learning models with uniform performance via distributionally robust optimization

JC Duchi, H Namkoong - The Annals of Statistics, 2021 - projecteuclid.org
Learning models with uniform performance via distributionally robust optimization Page 1 The
Annals of Statistics 2021, Vol. 49, No. 3, 1378–1406 https://doi.org/10.1214/20-AOS2004 © …

Distributionally robust learning

R Chen, IC Paschalidis - Foundations and Trends® in …, 2020 - nowpublishers.com
This monograph develops a comprehensive statistical learning framework that is robust to
(distributional) perturbations in the data using Distributionally Robust Optimization (DRO) …

Wasserstein distributionally robust optimization: Theory and applications in machine learning

D Kuhn, PM Esfahani, VA Nguyen… - … science in the age …, 2019 - pubsonline.informs.org
Many decision problems in science, engineering, and economics are affected by uncertain
parameters whose distribution is only indirectly observable through samples. The goal of …

Variance-based regularization with convex objectives

J Duchi, H Namkoong - Journal of Machine Learning Research, 2019 - jmlr.org
We develop an approach to risk minimization and stochastic optimization that provides a
convex surrogate for variance, allowing near-optimal and computationally efficient trading …

Regularization via mass transportation

S Shafieezadeh-Abadeh, D Kuhn… - Journal of Machine …, 2019 - jmlr.org
The goal of regression and classification methods in supervised learning is to minimize the
empirical risk, that is, the expectation of some loss function quantifying the prediction error …

Non-convex distributionally robust optimization: Non-asymptotic analysis

J Jin, B Zhang, H Wang, L Wang - Advances in Neural …, 2021 - proceedings.neurips.cc
Distributionally robust optimization (DRO) is a widely-used approach to learn models that
are robust against distribution shift. Compared with the standard optimization setting, the …

Distributionally robust logistic regression

S Shafieezadeh Abadeh… - Advances in neural …, 2015 - proceedings.neurips.cc
This paper proposes a distributionally robust approach to logistic regression. We use the
Wasserstein distance to construct a ball in the space of probability distributions centered at …

Robust linear regression: Optimal rates in polynomial time

A Bakshi, A Prasad - Proceedings of the 53rd Annual ACM SIGACT …, 2021 - dl.acm.org
We obtain robust and computationally efficient estimators for learning several linear models
that achieve statistically optimal convergence rate under minimal distributional assumptions …

Stochastic gradient methods for distributionally robust optimization with f-divergences

H Namkoong, JC Duchi - Advances in neural information …, 2016 - proceedings.neurips.cc
We develop efficient solution methods for a robust empirical risk minimization problem
designed to give calibrated confidence intervals on performance and provide optimal …

Universality of empirical risk minimization

A Montanari, BN Saeed - Conference on Learning Theory, 2022 - proceedings.mlr.press
Consider supervised learning from iid samples {(y_i, x_i)} _ {i≤ n} where x_i∈ R_p are
feature vectors and y_i∈ R are labels. We study empirical risk minimization over a class of …