Private and online learnability are equivalent

N Alon, M Bun, R Livni, M Malliaris… - ACM Journal of the ACM …, 2022 - dl.acm.org
Let H be a binary-labeled concept class. We prove that H can be PAC learned by an
(approximate) differentially private algorithm if and only if it has a finite Littlestone dimension …

Optimal differentially private learning of thresholds and quasi-concave optimization

E Cohen, X Lyu, J Nelson, T Sarlós… - Proceedings of the 55th …, 2023 - dl.acm.org
The problem of learning threshold functions is a fundamental one in machine learning.
Classical learning theory implies sample complexity of O (ξ− 1 log (1/β))(for generalization …

Replicable learning of large-margin halfspaces

A Kalavasis, A Karbasi, KG Larsen, G Velegkas… - arXiv preprint arXiv …, 2024 - arxiv.org
We provide efficient replicable algorithms for the problem of learning large-margin
halfspaces. Our results improve upon the algorithms provided by Impagliazzo, Lei, Pitassi …

Sample-efficient proper PAC learning with approximate differential privacy

B Ghazi, N Golowich, R Kumar… - Proceedings of the 53rd …, 2021 - dl.acm.org
In this paper we prove that the sample complexity of properly learning a class of Littlestone
dimension d with approximate differential privacy is Õ (d 6), ignoring privacy and accuracy …

Archimedes meets privacy: On privately estimating quantiles in high dimensions under minimal assumptions

O Ben-Eliezer, D Mikulincer… - Advances in Neural …, 2022 - proceedings.neurips.cc
The last few years have seen a surge of work on high dimensional statistics under privacy
constraints, mostly following two main lines of work: the" worst case" line, which does not …

Robust and private learning of halfspaces

B Ghazi, R Kumar, P Manurangsi… - International …, 2021 - proceedings.mlr.press
In this work, we study the trade-off between differential privacy and adversarial robustness
under $ L_2 $-perturbations in the context of learning halfspaces. We prove nearly tight …

On the sample complexity of privately learning axis-aligned rectangles

M Sadigurschi, U Stemmer - Advances in Neural …, 2021 - proceedings.neurips.cc
We revisit the fundamental problem of learning Axis-Aligned-Rectangles over a finite grid $
X^ d\subseteq\mathbb {R}^ d $ with differential privacy. Existing results show that the sample …

Closure properties for private classification and online prediction

N Alon, A Beimel, S Moran… - Conference on Learning …, 2020 - proceedings.mlr.press
Let H be a class of boolean functions and consider a composed class H'that is derived from
H using some arbitrary aggregation rule (for example, H'may be the class of all 3-wise …

Littlestone classes are privately online learnable

N Golowich, R Livni - Advances in Neural Information …, 2021 - proceedings.neurips.cc
We consider the problem of online classification under a privacy constraint. In this setting a
learner observes sequentially a stream of labelled examples $(x_t, y_t) $, for $1\leq t\leq T …

Differentially private range query on shortest paths

C Deng, J Gao, J Upadhyay, C Wang - Algorithms and Data Structures …, 2023 - Springer
We consider range queries on a graph under the constraints of differential privacy and query
ranges are defined as the set of edges on the shortest path of the graph. Edges in the graph …