Toward a theoretical foundation of policy optimization for learning control policies

B Hu, K Zhang, N Li, M Mesbahi… - Annual Review of …, 2023 - annualreviews.org
Gradient-based methods have been widely used for system design and optimization in
diverse application domains. Recently, there has been a renewed interest in studying …

Placement and implementation of grid-forming and grid-following virtual inertia and fast frequency response

BK Poolla, D Groß, F Dörfler - IEEE Transactions on Power …, 2019 - ieeexplore.ieee.org
The electric power system is witnessing a shift in the technology of generation. Conventional
thermal generation based on synchronous machines is gradually being replaced by power …

Global optimality guarantees for policy gradient methods

J Bhandari, D Russo - Operations Research, 2024 - pubsonline.informs.org
Policy gradients methods apply to complex, poorly understood, control problems by
performing stochastic gradient descent over a parameterized class of polices. Unfortunately …

Wind tunnel system for active flutter suppression research: Overview and insights

S Ricci, F Toffol, A De Gaspari, L Marchetti, F Fonte… - AIAA Journal, 2022 - arc.aiaa.org
This paper describes the development of a new state-of-the-art large wind tunnel model for
active flutter suppression studies as well as the supporting techniques used in tests focused …

Design of optimal sparse feedback gains via the alternating direction method of multipliers

F Lin, M Fardad, MR Jovanović - IEEE Transactions on …, 2013 - ieeexplore.ieee.org
We design sparse and block sparse feedback gains that minimize the variance amplification
(ie, the H 2 norm) of distributed systems. Our approach consists of two steps. First, we …

Convergence and sample complexity of gradient methods for the model-free linear–quadratic regulator problem

H Mohammadi, A Zare, M Soltanolkotabi… - … on Automatic Control, 2021 - ieeexplore.ieee.org
Model-free reinforcement learning attempts to find an optimal control action for an unknown
dynamical system by directly searching over the parameter space of controllers. The …

Policy Optimization for Linear Control with Robustness Guarantee: Implicit Regularization and Global Convergence

K Zhang, B Hu, T Basar - Learning for Dynamics and Control, 2020 - proceedings.mlr.press
Policy optimization (PO) is a key ingredient for modern reinforcement learning (RL). For
control design, certain constraints are usually enforced on the policies to optimize …

Optimizing static linear feedback: Gradient method

I Fatkhullin, B Polyak - SIAM Journal on Control and Optimization, 2021 - SIAM
The linear quadratic regulator is the fundamental problem of optimal control. Its state
feedback version was set and solved in the early 1960s. However, the static output feedback …

Augmented Lagrangian approach to design of structured optimal state feedback gains

F Lin, M Fardad, MR Jovanovic - IEEE Transactions on …, 2011 - ieeexplore.ieee.org
We consider the design of optimal state feedback gains subject to structural constraints on
the distributed controllers. These constraints are in the form of sparsity requirements for the …

Complexity of Derivative-Free Policy Optimization for Structured Control

X Guo, D Keivan, G Dullerud… - Advances in Neural …, 2024 - proceedings.neurips.cc
The applications of direct policy search in reinforcement learning and continuous control
have received increasing attention. In this work, we present novel theoretical results on the …