A survey of distributed optimization

T Yang, X Yi, J Wu, Y Yuan, D Wu, Z Meng… - Annual Reviews in …, 2019 - Elsevier
In distributed optimization of multi-agent systems, agents cooperate to minimize a global
function which is a sum of local objective functions. Motivated by applications including …

Distributed optimization for control

A Nedić, J Liu - Annual Review of Control, Robotics, and …, 2018 - annualreviews.org
Advances in wired and wireless technology have necessitated the development of theory,
models, and tools to cope with the new challenges posed by large-scale control and …

Network topology and communication-computation tradeoffs in decentralized optimization

A Nedić, A Olshevsky, MG Rabbat - Proceedings of the IEEE, 2018 - ieeexplore.ieee.org
In decentralized optimization, nodes cooperate to minimize an overall objective function that
is the sum (or average) of per-node private objective functions. Algorithms interleave local …

Push–pull gradient methods for distributed optimization in networks

S Pu, W Shi, J Xu, A Nedić - IEEE Transactions on Automatic …, 2020 - ieeexplore.ieee.org
In this article, we focus on solving a distributed convex optimization problem in a network,
where each agent has its own convex cost function and the goal is to minimize the sum of …

Next: In-network nonconvex optimization

P Di Lorenzo, G Scutari - IEEE Transactions on Signal and …, 2016 - ieeexplore.ieee.org
We study nonconvex distributed optimization in multiagent networks with time-varying
(nonsymmetric) connectivity. We introduce the first algorithmic framework for the distributed …

Adaptation, learning, and optimization over networks

AH Sayed - Foundations and Trends® in Machine Learning, 2014 - nowpublishers.com
This work deals with the topic of information processing over graphs. The presentation is
largely self-contained and covers results that relate to the analysis and design of multi-agent …

Distributed gradient methods for convex machine learning problems in networks: Distributed optimization

A Nedic - IEEE Signal Processing Magazine, 2020 - ieeexplore.ieee.org
This article provides an overview of distributed gradient methods for solving convex machine
learning problems of the form minxRn (1/m) ΣR i= 1 fi (x) in a system consisting of mm …

Distributed optimization over time-varying directed graphs

A Nedić, A Olshevsky - IEEE Transactions on Automatic Control, 2014 - ieeexplore.ieee.org
We consider distributed optimization by a collection of nodes, each having access to its own
convex function, whose collective goal is to minimize the sum of the functions. The …

On the linear convergence of the ADMM in decentralized consensus optimization

W Shi, Q Ling, K Yuan, G Wu… - IEEE Transactions on …, 2014 - ieeexplore.ieee.org
In decentralized consensus optimization, a connected network of agents collaboratively
minimize the sum of their local objective functions over a common decision variable, where …

A linear algorithm for optimization over directed graphs with geometric convergence

R Xin, UA Khan - IEEE Control Systems Letters, 2018 - ieeexplore.ieee.org
In this letter, we study distributed optimization, where a network of agents, abstracted as a
directed graph, collaborates to minimize the average of locally known convex functions …