Revisiting randomized gossip algorithms: General framework, convergence rates and novel block and accelerated protocols

N Loizou, P Richtárik - IEEE Transactions on Information …, 2021 - ieeexplore.ieee.org
In this work we present a new framework for the analysis and design of randomized gossip
algorithms for solving the average consensus problem. We show how classical randomized …

Characterizing limits and opportunities in speeding up Markov chain mixing

S Apers, A Sarlette, F Ticozzi - Stochastic Processes and their Applications, 2021 - Elsevier
A variety of paradigms have been proposed to speed up Markov chain mixing, ranging from
non-backtracking random walks to simulated annealing and lifted Metropolis–Hastings. We …

Accelerated methods for distributed optimization

H Hendrikx - 2021 - theses.hal.science
In order to make meaningful predictions, modern machine learning models require huge
amounts of data, and are generally trained in a distributed way, ie, using many computing …

A convergence-accelerated distributed time synchronization algorithm for energy-harvesting wireless sensor networks

Q Yang, R Zheng, J Guo, T Chen - IEEE Access, 2021 - ieeexplore.ieee.org
Time synchronization is an essential problem for energy-harvesting wireless sensor
networks (EH-WSNs), which is closely related to efficient resource schedules, energy …

First-order distributed optimization methods for machine learning with linear speed-up

A Spiridonoff - 2021 - search.proquest.com
This thesis considers the problem of average consensus, distributed centralized and
decentralized Stochastic Gradient Descent (SGD) and their communication requirements …

Fast Convergent Consensus of High-order Continuous-time Multi-agent Systems

XL Feng - … on Computational Intelligence and Security (CIS), 2021 - ieeexplore.ieee.org
In this paper, we consider two kinds of fast convergent consensus protocols of high-order
multi-agent systems under general case and introducing outdated agents states case …

An Accelerated Gossip-Based Distributed Gradient Method

X Ren, D Li, Y Xi, H Shao - 2021 40th Chinese Control …, 2021 - ieeexplore.ieee.org
This paper studies distributed optimization over the multi-agent network. We develop and
analyze a novel accelerated distributed gradient descent method, termed as G-DGDlm, for …

Asynchrony and Acceleration in Gossip Algorithms

H Hendrikx, L Massoulié, M Even - 2021 - hal.science
This paper considers the minimization of a sum of smooth and strongly convex functions
dispatched over the nodes of a communication network. Previous works on the subject …