How to dp-fy ml: A practical guide to machine learning with differential privacy

N Ponomareva, H Hazimeh, A Kurakin, Z Xu… - Journal of Artificial …, 2023 - jair.org
Abstract Machine Learning (ML) models are ubiquitous in real-world applications and are a
constant focus of research. Modern ML models have become more complex, deeper, and …

A comprehensive survey of privacy-preserving federated learning: A taxonomy, review, and future directions

X Yin, Y Zhu, J Hu - ACM Computing Surveys (CSUR), 2021 - dl.acm.org
The past four years have witnessed the rapid development of federated learning (FL).
However, new privacy concerns have also emerged during the aggregation of the …

Advances and open problems in federated learning

P Kairouz, HB McMahan, B Avent… - … and trends® in …, 2021 - nowpublishers.com
Federated learning (FL) is a machine learning setting where many clients (eg, mobile
devices or whole organizations) collaboratively train a model under the orchestration of a …

Differentially private learning with adaptive clipping

G Andrew, O Thakkar, B McMahan… - Advances in Neural …, 2021 - proceedings.neurips.cc
Existing approaches for training neural networks with user-level differential privacy (eg, DP
Federated Averaging) in federated learning (FL) settings involve bounding the contribution …

Privacy-preserving federated learning with malicious clients and honest-but-curious servers

J Le, D Zhang, X Lei, L Jiao, K Zeng… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Federated learning (FL) enables multiple clients to jointly train a global learning model while
keeping their training data locally, thereby protecting clients' privacy. However, there still …

Differentially private sql with bounded user contribution

RJ Wilson, CY Zhang, W Lam, D Desfontaines… - arXiv preprint arXiv …, 2019 - arxiv.org
Differential privacy (DP) provides formal guarantees that the output of a database query
does not reveal too much information about any individual present in the database. While …

Differential privacy and robust statistics in high dimensions

X Liu, W Kong, S Oh - Conference on Learning Theory, 2022 - proceedings.mlr.press
We introduce a universal framework for characterizing the statistical efficiency of a statistical
estimation problem with differential privacy guarantees. Our framework, which we call High …

Learning with user-level privacy

D Levy, Z Sun, K Amin, S Kale… - Advances in …, 2021 - proceedings.neurips.cc
We propose and analyze algorithms to solve a range of learning tasks under user-level
differential privacy constraints. Rather than guaranteeing only the privacy of individual …

Learning to generate image embeddings with user-level differential privacy

Z Xu, M Collins, Y Wang, L Panait… - Proceedings of the …, 2023 - openaccess.thecvf.com
Small on-device models have been successfully trained with user-level differential privacy
(DP) for next word prediction and image classification tasks in the past. However, existing …

User-level differentially private learning via correlated sampling

B Ghazi, R Kumar… - Advances in Neural …, 2021 - proceedings.neurips.cc
Most works in learning with differential privacy (DP) have focused on the setting where each
user has a single sample. In this work, we consider the setting where each user holds $ m …