FedDA: Faster Framework of Local Adaptive Gradient Methods via Restarted Dual Averaging

J Li, F Huang, H Huang - arXiv preprint arXiv:2302.06103, 2023 - arxiv.org
Federated learning (FL) is an emerging learning paradigm to tackle massively distributed
data. In Federated Learning, a set of clients jointly perform a machine learning task under …

FedDA: Faster Adaptive Gradient Methods for Federated Constrained Optimization

J Li, F Huang, H Huang - The Twelfth International Conference on Learning … - openreview.net
Federated learning (FL) is an emerging learning paradigm where a set of distributed clients
learns a task under the coordination of a server. The FedAvg algorithm is one of the most …

Locally Adaptive Federated Learning

S Mukherjee, N Loizou, SU Stich - openreview.net
Federated learning is a paradigm of distributed machine learning in which multiple clients
coordinate with a central server to learn a model, without sharing their own training data …

Faster adaptive federated learning

X Wu, F Huang, Z Hu, H Huang - … of the AAAI conference on artificial …, 2023 - ojs.aaai.org
Federated learning has attracted increasing attention with the emergence of distributed data.
While extensive federated learning algorithms have been proposed for the non-convex …

Achieving Linear Speedup in Asynchronous Federated Learning with Heterogeneous Clients

X Wang, Z Li, S Jin, J Zhang - arXiv preprint arXiv:2402.11198, 2024 - arxiv.org
Federated learning (FL) is an emerging distributed training paradigm that aims to learn a
common global model without exchanging or transferring the data that are stored locally at …

Scaffold: Stochastic controlled averaging for federated learning

S Praneeth Karimireddy, S Kale, M Mohri… - arXiv e …, 2019 - ui.adsabs.harvard.edu
Abstract Federated Averaging (FedAvg) has emerged as the algorithm of choice for
federated learning due to its simplicity and low communication cost. However, in spite of …

FedLALR: Client-Specific Adaptive Learning Rates Achieve Linear Speedup for Non-IID Data

H Sun, L Shen, S Chen, J Sun, J Li, G Sun… - arXiv preprint arXiv …, 2023 - arxiv.org
Federated learning is an emerging distributed machine learning method, enables a large
number of clients to train a model without exchanging their local data. The time cost of …

Local adaptivity in federated learning: Convergence and consistency

J Wang, Z Xu, Z Garrett, Z Charles, L Liu… - arXiv preprint arXiv …, 2021 - arxiv.org
The federated learning (FL) framework trains a machine learning model using decentralized
data stored at edge client devices by periodically aggregating locally trained models …

Adaptive federated optimization

S Reddi, Z Charles, M Zaheer, Z Garrett, K Rush… - arXiv preprint arXiv …, 2020 - arxiv.org
Federated learning is a distributed machine learning paradigm in which a large number of
clients coordinate with a central server to learn a model without sharing their own training …

FedPAGE: A fast local stochastic gradient method for communication-efficient federated learning

H Zhao, Z Li, P Richtárik - arXiv preprint arXiv:2108.04755, 2021 - arxiv.org
Federated Averaging (FedAvg, also known as Local-SGD)(McMahan et al., 2017) is a
classical federated learning algorithm in which clients run multiple local SGD steps before …