Membership inference attacks on machine learning: A survey

H Hu, Z Salcic, L Sun, G Dobbie, PS Yu… - ACM Computing Surveys …, 2022 - dl.acm.org
Machine learning (ML) models have been widely applied to various applications, including
image classification, text generation, audio recognition, and graph data analysis. However …

Membership inference attacks from first principles

N Carlini, S Chien, M Nasr, S Song… - … IEEE Symposium on …, 2022 - ieeexplore.ieee.org
A membership inference attack allows an adversary to query a trained machine learning
model to predict whether or not a particular example was contained in the model's training …

Enhanced membership inference attacks against machine learning models

J Ye, A Maddi, SK Murakonda… - Proceedings of the …, 2022 - dl.acm.org
How much does a machine learning algorithm leak about its training data, and why?
Membership inference attacks are used as an auditing tool to quantify this leakage. In this …

Truth serum: Poisoning machine learning models to reveal their secrets

F Tramèr, R Shokri, A San Joaquin, H Le… - Proceedings of the …, 2022 - dl.acm.org
We introduce a new class of attacks on machine learning models. We show that an
adversary who can poison a training dataset can cause models trained on this dataset to …

Counterfactual memorization in neural language models

C Zhang, D Ippolito, K Lee… - Advances in …, 2023 - proceedings.neurips.cc
Modern neural language models that are widely used in various NLP tasks risk memorizing
sensitive information from their training data. Understanding this memorization is important …

Synthetic data–anonymisation groundhog day

T Stadler, B Oprisanu, C Troncoso - 31st USENIX Security Symposium …, 2022 - usenix.org
Synthetic data has been advertised as a silver-bullet solution to privacy-preserving data
publishing that addresses the shortcomings of traditional anonymisation techniques. The …

Unraveling Attacks to Machine Learning-Based IoT Systems: A Survey and the Open Libraries Behind Them

C Liu, B Chen, W Shao, C Zhang… - IEEE Internet of …, 2024 - ieeexplore.ieee.org
The advent of the Internet of Things (IoT) has brought forth an era of unprecedented
connectivity, with an estimated 80 billion smart devices expected to be in operation by the …

Measuring forgetting of memorized training examples

M Jagielski, O Thakkar, F Tramer, D Ippolito… - arXiv preprint arXiv …, 2022 - arxiv.org
Machine learning models exhibit two seemingly contradictory phenomena: training data
memorization, and various forms of forgetting. In memorization, models overfit specific …

Scalable membership inference attacks via quantile regression

M Bertran, S Tang, A Roth, M Kearns… - Advances in …, 2024 - proceedings.neurips.cc
Membership inference attacks are designed to determine, using black box access to trained
models, whether a particular example was used in training or not. Membership inference …

Privacy issues in large language models: A survey

S Neel, P Chang - arXiv preprint arXiv:2312.06717, 2023 - arxiv.org
This is the first survey of the active area of AI research that focuses on privacy issues in
Large Language Models (LLMs). Specifically, we focus on work that red-teams models to …