An improved analysis of gradient tracking for decentralized machine learning

A Koloskova, T Lin, SU Stich - Advances in Neural …, 2021 - proceedings.neurips.cc
We consider decentralized machine learning over a network where the training data is
distributed across $ n $ agents, each of which can compute stochastic model updates on …

Improving the model consistency of decentralized federated learning

Y Shi, L Shen, K Wei, Y Sun, B Yuan… - International …, 2023 - proceedings.mlr.press
To mitigate the privacy leakages and communication burdens of Federated Learning (FL),
decentralized FL (DFL) discards the central server and each client only communicates with …

A general framework for decentralized optimization with first-order methods

R Xin, S Pu, A Nedić, UA Khan - Proceedings of the IEEE, 2020 - ieeexplore.ieee.org
Decentralized optimization to minimize a finite sum of functions, distributed over a network of
nodes, has been a significant area within control and signal-processing research due to its …

SoteriaFL: A unified framework for private federated learning with communication compression

Z Li, H Zhao, B Li, Y Chi - Advances in Neural Information …, 2022 - proceedings.neurips.cc
To enable large-scale machine learning in bandwidth-hungry environments such as
wireless networks, significant progress has been made recently in designing communication …

Decentralized stochastic optimization and machine learning: A unified variance-reduction framework for robust performance and fast convergence

R Xin, S Kar, UA Khan - IEEE Signal Processing Magazine, 2020 - ieeexplore.ieee.org
Decentralized methods to solve finite-sum minimization problems are important in many
signal processing and machine learning tasks where the data samples are distributed …

Survey of distributed algorithms for resource allocation over multi-agent systems

M Doostmohammadian, A Aghasi, M Pirani… - Annual Reviews in …, 2025 - Elsevier
Resource allocation and scheduling in multi-agent systems present challenges due to
complex interactions and decentralization. This survey paper provides a comprehensive …

Variance-reduced decentralized stochastic optimization with accelerated convergence

R Xin, UA Khan, S Kar - IEEE Transactions on Signal …, 2020 - ieeexplore.ieee.org
This paper describes a novel algorithmic framework to minimize a finite-sum of functions
available over a network of nodes. The proposed framework, that we call GT-VR, is …

Decentralized gradient tracking with local steps

Y Liu, T Lin, A Koloskova, SU Stich - Optimization Methods and …, 2024 - Taylor & Francis
Gradient tracking (GT) is an algorithm designed for solving decentralized optimization
problems over a network (such as training a machine learning model). A key feature of GT is …

Improving the sample and communication complexity for decentralized non-convex optimization: Joint gradient estimation and tracking

H Sun, S Lu, M Hong - International conference on machine …, 2020 - proceedings.mlr.press
Many modern large-scale machine learning problems benefit from decentralized and
stochastic optimization. Recent works have shown that utilizing both decentralized …

Distributed saddle-point problems under data similarity

A Beznosikov, G Scutari, A Rogozin… - Advances in Neural …, 2021 - proceedings.neurips.cc
We study solution methods for (strongly-) convex-(strongly)-concave Saddle-Point Problems
(SPPs) over networks of two type--master/workers (thus centralized) architectures and mesh …