Statistical indistinguishability of learning algorithms

A Kalavasis, A Karbasi, S Moran… - … on Machine Learning, 2023 - proceedings.mlr.press
When two different parties use the same learning rule on their own data, how can we test
whether the distributions of the two outcomes are similar? In this paper, we study the …

User-level differentially private learning via correlated sampling

B Ghazi, R Kumar… - Advances in Neural …, 2021 - proceedings.neurips.cc
Most works in learning with differential privacy (DP) have focused on the setting where each
user has a single sample. In this work, we consider the setting where each user holds $ m …

User-level differential privacy with few examples per user

B Ghazi, P Kamath, R Kumar… - Advances in …, 2024 - proceedings.neurips.cc
Previous work on user-level differential privacy (DP)[Ghazi et al. NeurIPS 2021, Bun et al.
STOC 2023] obtained generic algorithms that work for various learning tasks. However, their …

An equivalence between private classification and online prediction

M Bun, R Livni, S Moran - 2020 IEEE 61st Annual Symposium …, 2020 - ieeexplore.ieee.org
We prove that every concept class with finite Littlestone dimension can be learned by an
(approximate) differentially-private algorithm. This answers an open question of Alon et …

A theory of PAC learnability of partial concept classes

N Alon, S Hanneke, R Holzman… - 2021 IEEE 62nd Annual …, 2022 - ieeexplore.ieee.org
We extend the classical theory of PAC learning in a way which allows to model a rich variety
of practical learning tasks where the data satisfy special properties that ease the learning …

Private and online learnability are equivalent

N Alon, M Bun, R Livni, M Malliaris… - ACM Journal of the ACM …, 2022 - dl.acm.org
Let H be a binary-labeled concept class. We prove that H can be PAC learned by an
(approximate) differentially private algorithm if and only if it has a finite Littlestone dimension …

Local borsuk-ulam, stability, and replicability

Z Chase, B Chornomaz, S Moran… - Proceedings of the 56th …, 2024 - dl.acm.org
We use and adapt the Borsuk-Ulam Theorem from topology to derive limitations on list-
replicable and globally stable learning algorithms. We further demonstrate the applicability …

Private PAC learning may be harder than online learning

M Bun, A Cohen, R Desai - International Conference on …, 2024 - proceedings.mlr.press
We continue the study of the computational complexity of differentially private PAC learning
and how it is situated within the foundations of machine learning. A recent line of work …

Stability is stable: Connections between replicability, privacy, and adaptive generalization

M Bun, M Gaboardi, M Hopkins, R Impagliazzo… - Proceedings of the 55th …, 2023 - dl.acm.org
The notion of replicable algorithms was introduced by Impagliazzo, Lei, Pitassi, and Sorrell
(STOC'22) to describe randomized algorithms that are stable under the resampling of their …

Private learning implies quantum stability

Y Quek, S Arunachalam… - Advances in Neural …, 2021 - proceedings.neurips.cc
Learning an unknown n-qubit quantum state rho is a fundamental challenge in quantum
computing. Information-theoretically, it is known that tomography requires exponential in n …