A unified theory of decentralized sgd with changing topology and local updates

A Koloskova, N Loizou, S Boreiri… - International …, 2020 - proceedings.mlr.press
Decentralized stochastic optimization methods have gained a lot of attention recently, mainly
because of their cheap per iteration cost, data locality, and their communication-efficiency. In …

An improved analysis of gradient tracking for decentralized machine learning

A Koloskova, T Lin, SU Stich - Advances in Neural …, 2021 - proceedings.neurips.cc
We consider decentralized machine learning over a network where the training data is
distributed across $ n $ agents, each of which can compute stochastic model updates on …

A decentralized proximal-gradient method with network independent step-sizes and separated convergence rates

Z Li, W Shi, M Yan - IEEE Transactions on Signal Processing, 2019 - ieeexplore.ieee.org
This paper proposes a novel proximal-gradient algorithm for a decentralized optimization
problem with a composite objective containing smooth and nonsmooth terms. Specifically …

A linearly convergent algorithm for decentralized optimization: Sending less bits for free!

D Kovalev, A Koloskova, M Jaggi… - International …, 2021 - proceedings.mlr.press
Decentralized optimization methods enable on-device training of machine learning models
without a central coordinator. In many scenarios communication between devices is energy …

Decentralized gradient tracking with local steps

Y Liu, T Lin, A Koloskova, SU Stich - Optimization Methods and …, 2024 - Taylor & Francis
Gradient tracking (GT) is an algorithm designed for solving decentralized optimization
problems over a network (such as training a machine learning model). A key feature of GT is …

Fully distributed algorithms for constrained nonsmooth optimization problems of general linear multi-agent systems and their application

Z Deng, J Luo - IEEE Transactions on Automatic Control, 2023 - ieeexplore.ieee.org
This article investigates the constrained nonsmooth distributed optimization problems
(DOPs) of general linear multiagent systems. Our problem involves the general linear …

Data-heterogeneity-aware mixing for decentralized learning

Y Dandi, A Koloskova, M Jaggi, SU Stich - arXiv preprint arXiv:2204.06477, 2022 - arxiv.org
Decentralized learning provides an effective framework to train machine learning models
with data distributed over arbitrary communication graphs. However, most existing …

Privacy-preserving peer-to-peer energy trading via hybrid secure computations

J Liu, Q Long, RP Liu, W Liu, X Cui… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
The massive integration of uncertain distributed renewable energy resources into power
systems raises power imbalance concerns. Peer-to-peer (P2P) energy trading provides a …

Finite-time convergent primal–dual gradient dynamics with applications to distributed optimization

X Shi, X Xu, J Cao, X Yu - IEEE Transactions on Cybernetics, 2022 - ieeexplore.ieee.org
This article studies the finite-time (FT) convergence of a fast primal–dual gradient dynamics
(PDGD), called FT-PDGD, for solving constrained optimization with general constraints and …

Local exact-diffusion for decentralized optimization and learning

SA Alghunaim - IEEE Transactions on Automatic Control, 2024 - ieeexplore.ieee.org
Distributed optimization methods with local updates have recently attracted a lot of attention
due to their potential to reduce the communication cost of distributed methods. In these …