Why is public pretraining necessary for private model training?

A Ganesh, M Haghifam, M Nasr, S Oh… - International …, 2023 - proceedings.mlr.press
In the privacy-utility tradeoff of a model trained on benchmark language and vision tasks,
remarkable improvements have been widely reported when the model is pretrained on …

Differentially private latent diffusion models

S Lyu, MF Liu, M Vinaroz, M Park - arXiv preprint arXiv:2305.15759, 2023 - arxiv.org
Diffusion models (DMs) are widely used for generating high-quality high-dimensional
images in a non-differentially private manner. To address this challenge, recent papers …

Private gans, revisited

A Bie, G Kamath, G Zhang - arXiv preprint arXiv:2302.02936, 2023 - arxiv.org
We show that the canonical approach for training differentially private GANs--updating the
discriminator with differentially private stochastic gradient descent (DPSGD)--can yield …

A unified view of differentially private deep generative modeling

D Chen, R Kerkouche, M Fritz - arXiv preprint arXiv:2309.15696, 2023 - arxiv.org
The availability of rich and vast data sources has greatly advanced machine learning
applications in various domains. However, data with privacy concerns comes with stringent …

Meticulously selecting 1% of the dataset for pre-training! generating differentially private images data with semantics query

K Li, C Gong, Z Li, Y Zhao, X Hou, T Wang - arXiv preprint arXiv …, 2023 - arxiv.org
Differential Privacy (DP) image data synthesis, which leverages the DP technique to
generate synthetic data to replace the sensitive data, allowing organizations to share and …

Synthesizing High-Utility Tabular Data with Enhanced Privacy Via Split-and-Discard Pre-Training

L Luo, H Huang, B Zhang, Y Xie… - … 2023-2023 IEEE …, 2023 - ieeexplore.ieee.org
Data sharing has led to the emergence of the deep generative model (DGM) with differential
privacy for synthesizing tabular data. However, existing methods struggle to synthesize high …

Quantifying Sample Anonymity in Score-Based Generative Models with Adversarial Fingerprinting

M Dombrowski, B Kainz - arXiv preprint arXiv:2306.01363, 2023 - arxiv.org
Recent advances in score-based generative models have led to a huge spike in the
development of downstream applications using generative models ranging from data …

Towards privacy-preserving machine learning: generative modeling and discriminative analysis

D Chen - 2023 - publikationen.sulb.uni-saarland.de
The digital era is characterized by the widespread availability of rich data, which has fueled
the growth of machine learning applications across diverse fields such as computer vision …

PAC Privacy Preserving Diffusion Models

Q Xu - 2024 - search.proquest.com
Data privacy protection is garnering increased attention among researchers. Diffusion
models (DMs), particularly with strict differential privacy, can potentially produce images with …

Quantifying Anonymity in Score-Based Generators with Adversarial Fingerprinting

M Dombrowski, B Kainz - openreview.net
Recent advances in score-based generative models have led to a huge spike in the
development of downstream applications using generative models ranging from data …