Scaffold: Stochastic controlled averaging for federated learning

SP Karimireddy, S Kale, M Mohri… - International …, 2020 - proceedings.mlr.press
Federated learning is a key scenario in modern large-scale machine learning where the
data remains distributed over a large number of clients and the task is to learn a centralized …

A general theory for federated optimization with asynchronous and heterogeneous clients updates

Y Fraboni, R Vidal, L Kameni, M Lorenzi - Journal of Machine Learning …, 2023 - jmlr.org
We propose a novel framework to study asynchronous federated learning optimization with
delays in gradient updates. Our theoretical framework extends the standard FedAvg …

Mime: Mimicking centralized stochastic algorithms in federated learning

SP Karimireddy, M Jaggi, S Kale, M Mohri… - arXiv preprint arXiv …, 2020 - arxiv.org
Federated learning (FL) is a challenging setting for optimization due to the heterogeneity of
the data across different clients which gives rise to the client drift phenomenon. In fact …

Fedpd: A federated learning framework with adaptivity to non-iid data

X Zhang, M Hong, S Dhople, W Yin… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Federated Learning (FL) is popular for communication-efficient learning from distributed
data. To utilize data at different clients without moving them to the cloud, algorithms such as …

Federated learning under arbitrary communication patterns

D Avdiukhin… - … Conference on Machine …, 2021 - proceedings.mlr.press
Federated Learning is a distributed learning setting where the goal is to train a centralized
model with training data distributed over a large number of heterogeneous clients, each with …

A performance evaluation of federated learning algorithms

A Nilsson, S Smith, G Ulm, E Gustavsson… - Proceedings of the …, 2018 - dl.acm.org
Federated learning is an approach to distributed machine learning where a global model is
learned by aggregating models that have been trained locally on data-generating clients …

Agnostic federated learning

M Mohri, G Sivek, AT Suresh - International conference on …, 2019 - proceedings.mlr.press
A key learning scenario in large-scale applications is that of federated learning, where a
centralized model is trained based on data originating from a large number of clients. We …

Adaptive federated optimization

S Reddi, Z Charles, M Zaheer, Z Garrett, K Rush… - arXiv preprint arXiv …, 2020 - arxiv.org
Federated learning is a distributed machine learning paradigm in which a large number of
clients coordinate with a central server to learn a model without sharing their own training …

Optimal client sampling for federated learning

W Chen, S Horvath, P Richtarik - arXiv preprint arXiv:2010.13723, 2020 - arxiv.org
It is well understood that client-master communication can be a primary bottleneck in
Federated Learning. In this work, we address this issue with a novel client subsampling …

Local adaptivity in federated learning: Convergence and consistency

J Wang, Z Xu, Z Garrett, Z Charles, L Liu… - arXiv preprint arXiv …, 2021 - arxiv.org
The federated learning (FL) framework trains a machine learning model using decentralized
data stored at edge client devices by periodically aggregating locally trained models …