Improving the model consistency of decentralized federated learning

Y Shi, L Shen, K Wei, Y Sun, B Yuan… - International …, 2023 - proceedings.mlr.press
To mitigate the privacy leakages and communication burdens of Federated Learning (FL),
decentralized FL (DFL) discards the central server and each client only communicates with …

Multi-consensus decentralized accelerated gradient descent

H Ye, L Luo, Z Zhou, T Zhang - Journal of Machine Learning Research, 2023 - jmlr.org
This paper considers the decentralized convex optimization problem, which has a wide
range of applications in large-scale machine learning, sensor networks, and control theory …

Optimal gradient tracking for decentralized optimization

Z Song, L Shi, S Pu, M Yan - Mathematical Programming, 2024 - Springer
In this paper, we focus on solving the decentralized optimization problem of minimizing the
sum of n objective functions over a multi-agent network. The agents are embedded in an …

Recent theoretical advances in decentralized distributed convex optimization

E Gorbunov, A Rogozin, A Beznosikov… - … and Probability: With a …, 2022 - Springer
In the last few years, the theory of decentralized distributed convex optimization has made
significant progress. The lower bounds on communications rounds and oracle calls have …

Accelerated gradient tracking over time-varying graphs for decentralized optimization

H Li, Z Lin - Journal of Machine Learning Research, 2024 - jmlr.org
Decentralized optimization over time-varying graphs has been increasingly common in
modern machine learning with massive data stored on millions of mobile devices, such as in …

Proximal stochastic recursive momentum methods for nonconvex composite decentralized optimization

G Mancino-Ball, S Miao, Y Xu, J Chen - Proceedings of the AAAI …, 2023 - ojs.aaai.org
Consider a network of N decentralized computing agents collaboratively solving a
nonconvex stochastic composite problem. In this work, we propose a single-loop algorithm …

Acceleration in distributed optimization under similarity

Y Tian, G Scutari, T Cao… - … Conference on Artificial …, 2022 - proceedings.mlr.press
We study distributed (strongly convex) optimization problems over a network of agents, with
no centralized nodes. The loss functions of the agents are assumed to be similar, due to …

DESTRESS: Computation-optimal and communication-efficient decentralized nonconvex finite-sum optimization

B Li, Z Li, Y Chi - SIAM Journal on Mathematics of Data Science, 2022 - SIAM
Emerging applications in multiagent environments such as internet-of-things, networked
sensing, autonomous systems, and federated learning, call for decentralized algorithms for …

Towards more suitable personalization in federated learning via decentralized partial model training

Y Shi, Y Liu, Y Sun, Z Lin, L Shen, X Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
Personalized federated learning (PFL) aims to produce the greatest personalized model for
each client to face an insurmountable problem--data heterogeneity in real FL systems …

Decentralized Directed Collaboration for Personalized Federated Learning

Y Liu, Y Shi, Q Li, B Wu, X Wang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract Personalized Federated Learning (PFL) is proposed to find the greatest
personalized models for each client. To avoid the central failure and communication …