Mixmatch: A holistic approach to semi-supervised learning

D Berthelot, N Carlini, I Goodfellow… - Advances in neural …, 2019 - proceedings.neurips.cc
Semi-supervised learning has proven to be a powerful paradigm for leveraging unlabeled
data to mitigate the reliance on large labeled datasets. In this work, we unify the current …

Recent advances in deep learning theory

F He, D Tao - arXiv preprint arXiv:2012.10931, 2020 - arxiv.org
Deep learning is usually described as an experiment-driven field under continuous criticizes
of lacking theoretical foundations. This problem has been partially fixed by a large volume of …

Train faster, generalize better: Stability of stochastic gradient descent

M Hardt, B Recht, Y Singer - International conference on …, 2016 - proceedings.mlr.press
We show that parametric models trained by a stochastic gradient method (SGM) with few
iterations have vanishing generalization error. We prove our results by arguing that SGM is …

Differentially private data publishing and analysis: A survey

T Zhu, G Li, W Zhou, SY Philip - IEEE Transactions on …, 2017 - ieeexplore.ieee.org
Differential privacy is an essential and prevalent privacy model that has been widely
explored in recent decades. This survey provides a comprehensive and structured overview …

Algorithmic stability for adaptive data analysis

R Bassily, K Nissim, A Smith, T Steinke… - Proceedings of the forty …, 2016 - dl.acm.org
Adaptivity is an important feature of data analysis-the choice of questions to ask about a
dataset often depends on previous interactions with the same dataset. However, statistical …

Generalization in adaptive data analysis and holdout reuse

C Dwork, V Feldman, M Hardt… - Advances in neural …, 2015 - proceedings.neurips.cc
Overfitting is the bane of data analysts, even when data are plentiful. Formal approaches to
understanding this problem focus on statistical inference and generalization of individual …

Stability and generalization of learning algorithms that converge to global optima

Z Charles, D Papailiopoulos - International conference on …, 2018 - proceedings.mlr.press
We establish novel generalization bounds for learning algorithms that converge to global
minima. We derive black-box stability results that only depend on the convergence of a …

Chasing your long tails: Differentially private prediction in health care settings

VM Suriyakumar, N Papernot, A Goldenberg… - Proceedings of the …, 2021 - dl.acm.org
Machine learning models in health care are often deployed in settings where it is important
to protect patient privacy. In such settings, methods for differentially private (DP) learning …

Towards formalizing the GDPR's notion of singling out

A Cohen, K Nissim - … of the National Academy of Sciences, 2020 - National Acad Sciences
There is a significant conceptual gap between legal and mathematical thinking around data
privacy. The effect is uncertainty as to which technical offerings meet legal standards. This …

[图书][B] Model selection and error estimation in a nutshell

L Oneto - 2020 - Springer
How can we select the best performing data-driven model? How can we rigorously estimate
its generalization error? Statistical Learning Theory (SLT) answers these questions by …