Near-optimal cryptographic hardness of agnostically learning halfspaces and relu regression under gaussian marginals

I Diakonikolas, D Kane, L Ren - International Conference on …, 2023 - proceedings.mlr.press
We study the task of agnostically learning halfspaces under the Gaussian distribution.
Specifically, given labeled examples $(\\mathbf {x}, y) $ from an unknown distribution on …

The optimality of polynomial regression for agnostic learning under gaussian marginals in the SQ model

I Diakonikolas, DM Kane, T Pittas… - … on Learning Theory, 2021 - proceedings.mlr.press
We study the problem of agnostic learning under the Gaussian distribution in the Statistical
Query (SQ) model. We develop a method for finding hard families of examples for a wide …

Testing distributional assumptions of learning algorithms

R Rubinfeld, A Vasilyan - Proceedings of the 55th Annual ACM …, 2023 - dl.acm.org
There are many important high dimensional function classes that have fast agnostic learning
algorithms when strong assumptions on the distribution of examples can be made, such as …

A general characterization of the statistical query complexity

V Feldman - Conference on learning theory, 2017 - proceedings.mlr.press
Statistical query (SQ) algorithms are algorithms that have access to an\em SQ oracle for the
input distribution $ D $ instead of iid samples from $ D $. Given a query function $ φ: X\to [-1 …

Learning general halfspaces with general massart noise under the gaussian distribution

I Diakonikolas, DM Kane, V Kontonis… - Proceedings of the 54th …, 2022 - dl.acm.org
We study the problem of PAC learning halfspaces on ℝ d with Massart noise under the
Gaussian distribution. In the Massart model, an adversary is allowed to flip the label of each …

Near-optimal statistical query lower bounds for agnostically learning intersections of halfspaces with gaussian marginals

DJ Hsu, CH Sanford, R Servedio… - … on Learning Theory, 2022 - proceedings.mlr.press
We consider the well-studied problem of learning intersections of halfspaces under the
Gaussian distribution in the challenging\emph {agnostic learning} model. Recent work of …

Provable guarantees for decision tree induction: the agnostic setting

G Blanc, J Lange, LY Tan - International Conference on …, 2020 - proceedings.mlr.press
We give strengthened provable guarantees on the performance of widely employed and
empirically successful {\sl top-down decision tree learning heuristics}. While prior works …

Adaptivity helps for testing juntas

RA Servedio, LY Tan, J Wright - 30th Conference on …, 2015 - drops.dagstuhl.de
We give a new lower bound on the query complexity of any non-adaptive algorithm for
testing whether an unknown Boolean function is a k-junta versus epsilon-far from every k …

Statistical query complexity of manifold estimation

E Aamari, A Knop - Proceedings of the 53rd Annual ACM SIGACT …, 2021 - dl.acm.org
This paper studies the statistical query (SQ) complexity of estimating d-dimensional
submanifolds in ℝ n. We propose a purely geometric algorithm called Manifold Propagation …

Optimal SQ lower bounds for robustly learning discrete product distributions and Ising models

I Diakonikolas, DM Kane, Y Sun - Conference on Learning …, 2022 - proceedings.mlr.press
Abstract We establish optimal Statistical Query (SQ) lower bounds for robustly learning
certain families of discrete high-dimensional distributions. In particular, we show that no …