Optimal learners for realizable regression: Pac learning and online learning

I Attias, S Hanneke, A Kalavasis… - Advances in …, 2023 - proceedings.neurips.cc
In this work, we aim to characterize the statistical complexity of realizable regression both in
the PAC learning setting and the online learning setting. Previous work had established the …

A characterization of multiclass learnability

N Brukhim, D Carmon, I Dinur, S Moran… - 2022 IEEE 63rd …, 2022 - ieeexplore.ieee.org
A seminal result in learning theory characterizes the PAC learnability of binary classes
through the Vapnik-Chervonenkis dimension. Extending this characterization to the general …

Improved generalization bounds for robust learning

I Attias, A Kontorovich… - Algorithmic Learning …, 2019 - proceedings.mlr.press
We consider a model of robust learning in an adversarial environment. The learner gets
uncorrupted training data with access to possible corruptions that may be effected by the …

Adversarially robust learning: A generic minimax optimal learner and characterization

O Montasser, S Hanneke… - Advances in Neural …, 2022 - proceedings.neurips.cc
We present a minimax optimal learner for the problem of learning predictors robust to
adversarial examples at test-time. Interestingly, we find that this requires new algorithmic …

Realizable learning is all you need

M Hopkins, DM Kane, S Lovett… - … on Learning Theory, 2022 - proceedings.mlr.press
The equivalence of realizable and agnostic learnability is a fundamental phenomenon in
learning theory. With variants ranging from classical settings like PAC learning and …

Universal Rates for Regression: Separations between Cut-Off and Absolute Loss

I Attias, S Hanneke, A Kalavasis… - The Thirty Seventh …, 2024 - proceedings.mlr.press
In this work we initiate the study of regression in the universal rates framework of Bousquet
et al. Unlike the traditional uniform learning setting, we are interested in obtaining learning …

Stability is stable: Connections between replicability, privacy, and adaptive generalization

M Bun, M Gaboardi, M Hopkins, R Impagliazzo… - Proceedings of the 55th …, 2023 - dl.acm.org
The notion of replicable algorithms was introduced by Impagliazzo, Lei, Pitassi, and Sorrell
(STOC'22) to describe randomized algorithms that are stable under the resampling of their …

Improper multiclass boosting

N Brukhim, S Hanneke… - The Thirty Sixth Annual …, 2023 - proceedings.mlr.press
We study the setting of multiclass boosting with a possibly large number of classes. A recent
work by Brukhim, Hazan, Moran, and Schapire, 2021, proved a hardness result for a large …

List sample compression and uniform convergence

S Hanneke, S Moran, W Tom - The Thirty Seventh Annual …, 2024 - proceedings.mlr.press
List learning is a variant of supervised classification where the learner outputs multiple
plausible labels for each instance rather than just one. We investigate classical principles …

Regularization and optimal multiclass learning

J Asilis, S Devic, S Dughmi… - The Thirty Seventh …, 2024 - proceedings.mlr.press
The quintessential learning algorithm of empirical risk minimization (ERM) is known to fail in
various settings for which uniform convergence does not characterize learning. Relatedly …