Robust and differentially private mean estimation

X Liu, W Kong, S Kakade, S Oh - Advances in neural …, 2021 - proceedings.neurips.cc
In statistical learning and analysis from shared data, which is increasingly widely adopted in
platforms such as federated learning and meta-learning, there are two major concerns …

Sentence-level privacy for document embeddings

C Meehan, K Mrini, K Chaudhuri - arXiv preprint arXiv:2205.04605, 2022 - arxiv.org
User language data can contain highly sensitive personal content. As such, it is imperative
to offer users a strong and interpretable privacy guarantee when learning from their data. In …

Private and online learnability are equivalent

N Alon, M Bun, R Livni, M Malliaris… - ACM Journal of the ACM …, 2022 - dl.acm.org
Let H be a binary-labeled concept class. We prove that H can be PAC learned by an
(approximate) differentially private algorithm if and only if it has a finite Littlestone dimension …

Optimal differentially private learning of thresholds and quasi-concave optimization

E Cohen, X Lyu, J Nelson, T Sarlós… - Proceedings of the 55th …, 2023 - dl.acm.org
The problem of learning threshold functions is a fundamental one in machine learning.
Classical learning theory implies sample complexity of O (ξ− 1 log (1/β))(for generalization …

Replicable learning of large-margin halfspaces

A Kalavasis, A Karbasi, KG Larsen, G Velegkas… - arXiv preprint arXiv …, 2024 - arxiv.org
We provide efficient replicable algorithms for the problem of learning large-margin
halfspaces. Our results improve upon the algorithms provided by Impagliazzo, Lei, Pitassi …

Stability is stable: Connections between replicability, privacy, and adaptive generalization

M Bun, M Gaboardi, M Hopkins, R Impagliazzo… - Proceedings of the 55th …, 2023 - dl.acm.org
The notion of replicable algorithms was introduced by Impagliazzo, Lei, Pitassi, and Sorrell
(STOC'22) to describe randomized algorithms that are stable under the resampling of their …

Sample-efficient proper PAC learning with approximate differential privacy

B Ghazi, N Golowich, R Kumar… - Proceedings of the 53rd …, 2021 - dl.acm.org
In this paper we prove that the sample complexity of properly learning a class of Littlestone
dimension d with approximate differential privacy is Õ (d 6), ignoring privacy and accuracy …

Archimedes meets privacy: On privately estimating quantiles in high dimensions under minimal assumptions

O Ben-Eliezer, D Mikulincer… - Advances in Neural …, 2022 - proceedings.neurips.cc
The last few years have seen a surge of work on high dimensional statistics under privacy
constraints, mostly following two main lines of work: the" worst case" line, which does not …

Characterizing the sample complexity of pure private learners

A Beimel, K Nissim, U Stemmer - Journal of Machine Learning Research, 2019 - jmlr.org
Abstract Kasiviswanathan et al.(FOCS 2008) defined private learning as a combination of
PAC learning and differential privacy. Informally, a private learner is applied to a collection of …

Concentration of the exponential mechanism and differentially private multivariate medians

K Ramsay, A Jagannath, S Chenouri - arXiv preprint arXiv:2210.06459, 2022 - arxiv.org
We prove concentration inequalities for the output of the exponential mechanism about the
maximizer of the population objective function. This bound applies to objective functions that …