Optimal multi-distribution learning

Z Zhang, W Zhan, Y Chen, SS Du… - The Thirty Seventh …, 2024 - proceedings.mlr.press
Abstract Multi-distribution learning (MDL), which seeks to learn a shared model that
minimizes the worst-case risk across $ k $ distinct data distributions, has emerged as a …

The sample complexity of multi-distribution learning

B Peng - The Thirty Seventh Annual Conference on Learning …, 2024 - proceedings.mlr.press
Multi-distribution learning generalizes the classic PAC learning to handle data coming from
multiple distributions. Given a set of $ k $ data distributions and a hypothesis class of VC …

Platforms for Efficient and Incentive-Aware Collaboration

N Haghtalab, M Qiao, K Yang - Proceedings of the 2025 Annual ACM-SIAM …, 2025 - SIAM
Collaboration is crucial for reaching collective goals. However, its potential for effectiveness
is often undermined by the strategic behavior of individual agents—a fact that is captured by …

Derandomizing Multi-Distribution Learning

KG Larsen, O Montasser, N Zhivotovskiy - arXiv preprint arXiv:2409.17567, 2024 - arxiv.org
Multi-distribution or collaborative learning involves learning a single predictor that works
well across multiple data distributions, using samples from each during training. Recent …

Gradient-Based Multi-Objective Deep Learning: Algorithms, Theories, Applications, and Beyond

W Chen, X Zhang, B Lin, X Lin, H Zhao… - arXiv preprint arXiv …, 2025 - arxiv.org
Multi-objective optimization (MOO) in deep learning aims to simultaneously optimize
multiple conflicting objectives, a challenge frequently encountered in areas like multi-task …

Minimax Regret Estimation for Generalizing Heterogeneous Treatment Effects with Multisite Data

Y Zhang, M Huang, K Imai - arXiv preprint arXiv:2412.11136, 2024 - arxiv.org
To test scientific theories and develop individualized treatment rules, researchers often wish
to learn heterogeneous treatment effects that can be consistently found across diverse …

Functional linear regression of cumulative distribution functions

Q Zhang, A Makur, K Azizzadenesheli - arXiv preprint arXiv:2205.14545, 2022 - arxiv.org
The estimation of cumulative distribution functions (CDFs) is an important learning task with
a great variety of downstream applications, such as risk assessments in predictions and …

Distribution-Dependent Rates for Multi-Distribution Learning

R Hanashiro, P Jaillet - arXiv preprint arXiv:2312.13130, 2023 - arxiv.org
To address the needs of modeling uncertainty in sensitive machine learning applications,
the setup of distributionally robust optimization (DRO) seeks good performance uniformly …

Beyond Minimax Rates in Group Distributionally Robust Optimization via a Novel Notion of Sparsity

Q Nguyen, NA Mehta, C Guzmán - arXiv preprint arXiv:2410.00690, 2024 - arxiv.org
The minimax sample complexity of group distributionally robust optimization (GDRO) has
been determined up to a $\log (K) $ factor, for $ K $ the number of groups. In this work, we …