On graphs with finite-time consensus and their use in gradient tracking

EDH Nguyen, X Jiang, B Ying, CA Uribe - arXiv preprint arXiv:2311.01317, 2023 - arxiv.org
This paper studies sequences of graphs satisfying the finite-time consensus property (ie,
iterating through such a finite sequence is equivalent to performing global or exact …

Achieving Linear Speedup with Network-Independent Learning Rates in Decentralized Stochastic Optimization

H Yuan, SA Alghunaim, K Yuan - 2023 62nd IEEE Conference …, 2023 - ieeexplore.ieee.org
Decentralized stochastic optimization has become a crucial tool for addressing large-scale
machine learning and control problems. In decentralized algorithms, all computing nodes …

Distributed random reshuffling methods with improved convergence

K Huang, L Zhou, S Pu - arXiv preprint arXiv:2306.12037, 2023 - arxiv.org
This paper proposes two distributed random reshuffling methods, namely Gradient Tracking
with Random Reshuffling (GT-RR) and Exact Diffusion with Random Reshuffling (ED-RR), to …

[PDF][PDF] Variance reduction for faster decentralized general convex optimization

R Xin, S Das, S Kar, UA Khan - css.paperplaza.net
This paper studies decentralized stochastic empirical risk minimization over a network of
nodes, where each node has access to a finite collection of risk functions. While this …

Multi-Objective Network Resource Allocation Method Based on Fractional Pid Control

X Ni, Y Wei, S Zhou, M Tao - Available at SSRN 4732955 - papers.ssrn.com
In this paper, a fractional proportional-integral-derivative (PID) distributed optimization
algorithm is proposed to solve the network resource allocation problem. The algorithm …