Robustness implies privacy in statistical estimation

SB Hopkins, G Kamath, M Majid… - Proceedings of the 55th …, 2023 - dl.acm.org
We study the relationship between adversarial robustness and differential privacy in high-
dimensional algorithmic statistics. We give the first black-box reduction from privacy to …

Differential privacy and robust statistics in high dimensions

X Liu, W Kong, S Oh - Conference on Learning Theory, 2022 - proceedings.mlr.press
We introduce a universal framework for characterizing the statistical efficiency of a statistical
estimation problem with differential privacy guarantees. Our framework, which we call High …

Private robust estimation by stabilizing convex relaxations

P Kothari, P Manurangsi… - Conference on Learning …, 2022 - proceedings.mlr.press
We give the first polynomial time and sample (epsilon, delta)-differentially private (DP)
algorithm to estimate the mean, covariance and higher moments in the presence of a …

Private distribution learning with public data: The view from sample compression

S Ben-David, A Bie, CL Canonne… - Advances in …, 2023 - proceedings.neurips.cc
We study the problem of private distribution learning with access to public data. In this setup,
which we refer to as* public-private learning*, the learner is given public and private …

Private and polynomial time algorithms for learning Gaussians and beyond

H Ashtiani, C Liaw - Conference on Learning Theory, 2022 - proceedings.mlr.press
We present a fairly general framework for reducing $(\varepsilon,\delta) $-differentially
private (DP) statistical estimation to its non-private counterpart. As the main application of …

Private estimation algorithms for stochastic block models and mixture models

H Chen, V Cohen-Addad, T d'Orsi… - Advances in …, 2023 - proceedings.neurips.cc
We introduce general tools for designing efficient private estimation algorithms, in the high-
dimensional settings, whose statistical guarantees almost match those of the best known …

Privately estimating a Gaussian: Efficient, robust, and optimal

D Alabi, PK Kothari, P Tankala, P Venkat… - Proceedings of the 55th …, 2023 - dl.acm.org
In this work, we give efficient algorithms for privately estimating a Gaussian distribution in
both pure and approximate differential privacy (DP) models with optimal dependence on the …

Private estimation with public data

A Bie, G Kamath, V Singhal - Advances in neural …, 2022 - proceedings.neurips.cc
We initiate the study of differentially private (DP) estimation with access to a small amount of
public data. For private estimation of $ d $-dimensional Gaussians, we assume that the …

A private and computationally-efficient estimator for unbounded gaussians

G Kamath, A Mouzakis, V Singhal… - … on Learning Theory, 2022 - proceedings.mlr.press
We give the first polynomial-time, polynomial-sample, differentially private estimator for the
mean and covariance of an arbitrary Gaussian distribution $ N (\mu,\Sigma) $ in $\R^ d $. All …

From robustness to privacy and back

H Asi, J Ullman, L Zakynthinou - International Conference on …, 2023 - proceedings.mlr.press
We study the relationship between two desiderata of algorithms in statistical inference and
machine learning—differential privacy and robustness to adversarial data corruptions. Their …