Global convergence of localized policy iteration in networked multi-agent reinforcement learning

Y Zhang, G Qu, P Xu, Y Lin, Z Chen… - Proceedings of the ACM …, 2023 - dl.acm.org
We study a multi-agent reinforcement learning (MARL) problem where the agents interact
over a given network. The goal of the agents is to cooperatively maximize the average of …

Scalable primal-dual actor-critic method for safe multi-agent rl with general utilities

D Ying, Y Zhang, Y Ding, A Koppel… - Advances in Neural …, 2024 - proceedings.neurips.cc
We investigate safe multi-agent reinforcement learning, where agents seek to collectively
maximize an aggregate sum of local objectives while satisfying their own safety constraints …

On the optimal control of network LQR with spatially-exponential decaying structure

RC Zhang, W Li, N Li - 2023 American Control Conference …, 2023 - ieeexplore.ieee.org
This paper studies network LQR problems with system matrices being spatially-exponential
decaying (SED) between nodes in the network. The major objective is to study whether the …

Towards Model-Free LQR Control over Rate-Limited Channels

A Mitra, L Ye, V Gupta - arXiv preprint arXiv:2401.01258, 2024 - arxiv.org
Given the success of model-free methods for control design in many problem settings, it is
natural to ask how things will change if realistic communication channels are utilized for the …

Global performance guarantees for localized model predictive control

JS Li, CA Alonso - IEEE Open Journal of Control Systems, 2023 - ieeexplore.ieee.org
Recent advances in model predictive control (MPC) leverage local communication
constraints to produce localized MPC algorithms whose complexities scale independently of …

Distributed Policy Gradient for Linear Quadratic Networked Control with Limited Communication Range

Y Yan, Y Shen - IEEE Transactions on Signal Processing, 2024 - ieeexplore.ieee.org
This paper proposes a scalable distributed policy gradient method and proves its
convergence to near-optimal solution in multi-agent linear quadratic networked systems …

Separable approximations of optimal value functions under a decaying sensitivity assumption

M Sperl, L Saluzzi, L Grüne… - 2023 62nd IEEE …, 2023 - ieeexplore.ieee.org
An efficient approach for the construction of separable approximations of optimal value
functions from interconnected optimal control problems is presented. The approach is based …

Natural Policy Gradient Preserves Spatial Decay Properties for Control of Networked Dynamical Systems

E Xu, G Qu - 2023 62nd IEEE Conference on Decision and …, 2023 - ieeexplore.ieee.org
We consider the distributed control of networked linear time-invariant systems. Previous
work has established the spatial decay property of the centralized controller, which allows …

Scalable Reinforcement Learning for Linear-Quadratic Control of Networks

J Olsson, R Zhang, E Tegling, N Li - arXiv preprint arXiv:2401.16183, 2024 - arxiv.org
Distributed optimal control is known to be challenging and can become intractable even for
linear-quadratic regulator problems. In this work, we study a special class of such problems …

Stability and Regret bounds on Distributed Truncated Predictive Control for Networked Dynamical Systems

E Xu, G Qu - arXiv preprint arXiv:2310.06194, 2023 - arxiv.org
This work is primarily concerned about the distributed control of networked linear
timeinvariant (LTI) systems. In particular, we propose a truncated predictive control algorithm …