On-demand sampling: Learning optimally from multiple distributions

N Haghtalab, M Jordan, E Zhao - Advances in Neural …, 2022 - proceedings.neurips.cc
Societal and real-world considerations such as robustness, fairness, social welfare and multi-
agent tradeoffs have given rise to multi-distribution learning paradigms, such as …

Optimal learners for realizable regression: Pac learning and online learning

I Attias, S Hanneke, A Kalavasis… - Advances in …, 2023 - proceedings.neurips.cc
In this work, we aim to characterize the statistical complexity of realizable regression both in
the PAC learning setting and the online learning setting. Previous work had established the …

A framework for adversarially robust streaming algorithms

O Ben-Eliezer, R Jayaram, DP Woodruff… - ACM Journal of the ACM …, 2022 - dl.acm.org
We investigate the adversarial robustness of streaming algorithms. In this context, an
algorithm is considered robust if its performance guarantees hold even if the stream is …

[PDF][PDF] From External to Swap Regret 2.0: An Efficient Reduction for Large Action Spaces

Y Dagan, C Daskalakis, M Fishelson… - Proceedings of the 56th …, 2024 - dl.acm.org
We provide a novel reduction from swap-regret minimization to external-regret minimization,
which improves upon the classical reductions of Blum-Mansour and Stoltz-Lugosi in that it …

Smoothed analysis with adaptive adversaries

N Haghtalab, T Roughgarden, A Shetty - Journal of the ACM, 2024 - dl.acm.org
We prove novel algorithmic guarantees for several online problems in the smoothed
analysis model. In this model, at each time step an adversary chooses an input distribution …

Dynamic algorithms against an adaptive adversary: generic constructions and lower bounds

A Beimel, H Kaplan, Y Mansour, K Nissim… - Proceedings of the 54th …, 2022 - dl.acm.org
Given an input that undergoes a sequence of updates, a dynamic algorithm maintains a
valid solution to some predefined problem at any point in time; the goal is to design an …

Online learning and solving infinite games with an erm oracle

A Assos, I Attias, Y Dagan… - The Thirty Sixth …, 2023 - proceedings.mlr.press
While ERM suffices to attain near-optimal generalization error in the stochastic learning
setting, this is not known to be the case in the online learning setting, where algorithms for …

Adversarial robustness of streaming algorithms through importance sampling

V Braverman, A Hassidim, Y Matias… - Advances in …, 2021 - proceedings.neurips.cc
Robustness against adversarial attacks has recently been at the forefront of algorithmic
design for machine learning tasks. In the adversarial streaming model, an adversary gives …

A theory of PAC learnability of partial concept classes

N Alon, S Hanneke, R Holzman… - 2021 IEEE 62nd Annual …, 2022 - ieeexplore.ieee.org
We extend the classical theory of PAC learning in a way which allows to model a rich variety
of practical learning tasks where the data satisfy special properties that ease the learning …

Realizable learning is all you need

M Hopkins, DM Kane, S Lovett… - … on Learning Theory, 2022 - proceedings.mlr.press
The equivalence of realizable and agnostic learnability is a fundamental phenomenon in
learning theory. With variants ranging from classical settings like PAC learning and …