Fednest: Federated bilevel, minimax, and compositional optimization

DA Tarzanagh, M Li… - … on Machine Learning, 2022 - proceedings.mlr.press
Standard federated optimization methods successfully apply to stochastic problems with
single-level structure. However, many contemporary ML problems-including adversarial …

Solving a class of non-convex minimax optimization in federated learning

X Wu, J Sun, Z Hu, A Zhang… - Advances in Neural …, 2024 - proceedings.neurips.cc
The minimax problems arise throughout machine learning applications, ranging from
adversarial training and policy evaluation in reinforcement learning to AUROC …

Federated minimax optimization: Improved convergence analyses and algorithms

P Sharma, R Panda, G Joshi… - … on Machine Learning, 2022 - proceedings.mlr.press
In this paper, we consider nonconvex minimax optimization, which is gaining prominence in
many modern machine learning applications, such as GANs. Large-scale edge-based …

Decentralized local stochastic extra-gradient for variational inequalities

A Beznosikov, P Dvurechenskii… - Advances in …, 2022 - proceedings.neurips.cc
We consider distributed stochastic variational inequalities (VIs) on unbounded domains with
the problem data that is heterogeneous (non-IID) and distributed across many devices. We …

Federated minimax optimization with client heterogeneity

P Sharma, R Panda, G Joshi - arXiv preprint arXiv:2302.04249, 2023 - arxiv.org
Minimax optimization has seen a surge in interest with the advent of modern applications
such as GANs, and it is inherently more challenging than simple minimization. The difficulty …

Scaff-PD: Communication Efficient Fair and Robust Federated Learning

Y Yu, SP Karimireddy, Y Ma, MI Jordan - arXiv preprint arXiv:2307.13381, 2023 - arxiv.org
We present Scaff-PD, a fast and communication-efficient algorithm for distributionally robust
federated learning. Our approach improves fairness by optimizing a family of distributionally …

Distributed methods with compressed communication for solving variational inequalities, with theoretical guarantees

A Beznosikov, P Richtárik, M Diskin… - Advances in …, 2022 - proceedings.neurips.cc
Variational inequalities in general and saddle point problems in particular are increasingly
relevant in machine learning applications, including adversarial learning, GANs, transport …

Distributed saddle-point problems: Lower bounds, near-optimal and robust algorithms

A Beznosikov, V Samokhin, A Gasnikov - arXiv preprint arXiv:2010.13112, 2020 - arxiv.org
This paper focuses on the distributed optimization of stochastic saddle point problems. The
first part of the paper is devoted to lower bounds for the cenralized and decentralized …

Similarity, compression and local steps: three pillars of efficient communications for distributed variational inequalities

A Beznosikov, M Takác… - Advances in Neural …, 2024 - proceedings.neurips.cc
Variational inequalities are a broad and flexible class of problems that includes
minimization, saddle point, and fixed point problems as special cases. Therefore, variational …

Fair federated learning via bounded group loss

S Hu, ZS Wu, V Smith - 2024 IEEE Conference on Secure and …, 2024 - ieeexplore.ieee.org
Fair prediction across protected groups is an important consideration in federated learning
applications. In this work we propose a general framework for provably fair federated …