A survey of distributed optimization

T Yang, X Yi, J Wu, Y Yuan, D Wu, Z Meng… - Annual Reviews in …, 2019 - Elsevier
In distributed optimization of multi-agent systems, agents cooperate to minimize a global
function which is a sum of local objective functions. Motivated by applications including …

Distributed optimization for control

A Nedić, J Liu - Annual Review of Control, Robotics, and …, 2018 - annualreviews.org
Advances in wired and wireless technology have necessitated the development of theory,
models, and tools to cope with the new challenges posed by large-scale control and …

Network topology and communication-computation tradeoffs in decentralized optimization

A Nedić, A Olshevsky, MG Rabbat - Proceedings of the IEEE, 2018 - ieeexplore.ieee.org
In decentralized optimization, nodes cooperate to minimize an overall objective function that
is the sum (or average) of per-node private objective functions. Algorithms interleave local …

Achieving geometric convergence for distributed optimization over time-varying graphs

A Nedic, A Olshevsky, W Shi - SIAM Journal on Optimization, 2017 - SIAM
This paper considers the problem of distributed optimization over time-varying graphs. For
the case of undirected graphs, we introduce a distributed algorithm, referred to as DIGing …

Push–pull gradient methods for distributed optimization in networks

S Pu, W Shi, J Xu, A Nedić - IEEE Transactions on Automatic …, 2020 - ieeexplore.ieee.org
In this article, we focus on solving a distributed convex optimization problem in a network,
where each agent has its own convex cost function and the goal is to minimize the sum of …

Extra: An exact first-order algorithm for decentralized consensus optimization

W Shi, Q Ling, G Wu, W Yin - SIAM Journal on Optimization, 2015 - SIAM
Recently, there has been growing interest in solving consensus optimization problems in a
multiagent network. In this paper, we develop a decentralized algorithm for the consensus …

Adaptation, learning, and optimization over networks

AH Sayed - Foundations and Trends® in Machine Learning, 2014 - nowpublishers.com
This work deals with the topic of information processing over graphs. The presentation is
largely self-contained and covers results that relate to the analysis and design of multi-agent …

Diffusion strategies for adaptation and learning over networks: an examination of distributed strategies and network behavior

AH Sayed, SY Tu, J Chen, X Zhao… - IEEE Signal Processing …, 2013 - ieeexplore.ieee.org
Nature provides splendid examples of real-time learning and adaptation behavior that
emerges from highly localized interactions among agents of limited capabilities. For …

Diffusion strategies outperform consensus strategies for distributed estimation over adaptive networks

SY Tu, AH Sayed - IEEE Transactions on Signal Processing, 2012 - ieeexplore.ieee.org
Adaptive networks consist of a collection of nodes with adaptation and learning abilities. The
nodes interact with each other on a local level and diffuse information across the network to …

Adaptive networks

AH Sayed - Proceedings of the IEEE, 2014 - ieeexplore.ieee.org
This paper surveys recent advances related to adaptation, learning, and optimization over
networks. Various distributed strategies are discussed that enable a collection of networked …