Optimal learners for realizable regression: Pac learning and online learning

I Attias, S Hanneke, A Kalavasis… - Advances in …, 2023 - proceedings.neurips.cc
In this work, we aim to characterize the statistical complexity of realizable regression both in
the PAC learning setting and the online learning setting. Previous work had established the …

Fast rates for nonparametric online learning: from realizability to learning in games

C Daskalakis, N Golowich - Proceedings of the 54th Annual ACM …, 2022 - dl.acm.org
We study fast rates of convergence in the setting of nonparametric online regression, namely
where regret is defined with respect to an arbitrary function class which has bounded …

Adversarially robust pac learnability of real-valued functions

I Attias, S Hanneke - International Conference on Machine …, 2023 - proceedings.mlr.press
We study robustness to test-time adversarial attacks in the regression setting with $\ell_p $
losses and arbitrary perturbation sets. We address the question of which function classes …

Universal Rates for Regression: Separations between Cut-Off and Absolute Loss

I Attias, S Hanneke, A Kalavasis… - The Thirty Seventh …, 2024 - proceedings.mlr.press
In this work we initiate the study of regression in the universal rates framework of Bousquet
et al. Unlike the traditional uniform learning setting, we are interested in obtaining learning …

Optimal pac bounds without uniform convergence

I Aden-Ali, Y Cherapanamjeri, A Shetty… - 2023 IEEE 64th …, 2023 - ieeexplore.ieee.org
In statistical learning theory, determining the sample complexity of realizable binary
classification for VC classes was a long-standing open problem. The results of Simon [1] and …

[PDF][PDF] A Study of Privacy and Compression in Learning Theory

M Sadigurschi - 2023 - menisadi.github.io
Abstract Machine learning is a rapidly growing field of computer science that has the
potential to revolutionize various industries. With the ability to process vast amounts of data …

Agnostic Sample Compression Schemes for Regression

I Attias, S Hanneke, A Kontorovich… - Forty-first International …, 2018 - openreview.net
We obtain the first positive results for bounded sample compression in the agnostic
regression setting with the $\ell_p $ loss, where $ p\in [1,\infty] $. We construct a generic …