Robustness implies privacy in statistical estimation

SB Hopkins, G Kamath, M Majid… - Proceedings of the 55th …, 2023 - dl.acm.org
We study the relationship between adversarial robustness and differential privacy in high-
dimensional algorithmic statistics. We give the first black-box reduction from privacy to …

Statistical indistinguishability of learning algorithms

A Kalavasis, A Karbasi, S Moran… - … on Machine Learning, 2023 - proceedings.mlr.press
When two different parties use the same learning rule on their own data, how can we test
whether the distributions of the two outcomes are similar? In this paper, we study the …

Learning with user-level privacy

D Levy, Z Sun, K Amin, S Kale… - Advances in …, 2021 - proceedings.neurips.cc
We propose and analyze algorithms to solve a range of learning tasks under user-level
differential privacy constraints. Rather than guaranteeing only the privacy of individual …

Learning to generate image embeddings with user-level differential privacy

Z Xu, M Collins, Y Wang, L Panait… - Proceedings of the …, 2023 - openaccess.thecvf.com
Small on-device models have been successfully trained with user-level differential privacy
(DP) for next word prediction and image classification tasks in the past. However, existing …

User-level differential privacy with few examples per user

B Ghazi, P Kamath, R Kumar… - Advances in …, 2024 - proceedings.neurips.cc
Previous work on user-level differential privacy (DP)[Ghazi et al. NeurIPS 2021, Bun et al.
STOC 2023] obtained generic algorithms that work for various learning tasks. However, their …

Federated linear contextual bandits with user-level differential privacy

R Huang, H Zhang, L Melis, M Shen… - International …, 2023 - proceedings.mlr.press
This paper studies federated linear contextual bandits under the notion of user-level
differential privacy (DP). We first introduce a unified federated bandits framework that can …

Distributed, private, sparse histograms in the two-server model

J Bell, A Gascon, B Ghazi, R Kumar… - Proceedings of the …, 2022 - dl.acm.org
We consider the computation of sparse,(ε, ϑ)-differentially private~(DP) histograms in the
two-server model of secure multi-party computation~(MPC), which has recently gained …

Reproducibility in learning

R Impagliazzo, R Lei, T Pitassi, J Sorrell - Proceedings of the 54th annual …, 2022 - dl.acm.org
We introduce the notion of a reproducible algorithm in the context of learning. A reproducible
learning algorithm is resilient to variations in its samples—with high probability, it returns the …

Private and online learnability are equivalent

N Alon, M Bun, R Livni, M Malliaris… - ACM Journal of the ACM …, 2022 - dl.acm.org
Let H be a binary-labeled concept class. We prove that H can be PAC learned by an
(approximate) differentially private algorithm if and only if it has a finite Littlestone dimension …

List and certificate complexities in replicable learning

P Dixon, A Pavan, J Vander Woude… - Advances in …, 2024 - proceedings.neurips.cc
We investigate replicable learning algorithms. Informally a learning algorithm is replicable if
the algorithm outputs the same canonical hypothesis over multiple runs with high probability …