Adaptive dynamic programming for control: A survey and recent advances

D Liu, S Xue, B Zhao, B Luo… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
This article reviews the recent development of adaptive dynamic programming (ADP) with
applications in control. First, its applications in optimal regulation are introduced, and some …

Optimal and autonomous control using reinforcement learning: A survey

B Kiumarsi, KG Vamvoudakis… - IEEE transactions on …, 2017 - ieeexplore.ieee.org
This paper reviews the current state of the art on reinforcement learning (RL)-based
feedback control solutions to optimal regulation and tracking of single and multiagent …

Discounted iterative adaptive critic designs with novel stability analysis for tracking control

M Ha, D Wang, D Liu - IEEE/CAA Journal of Automatica Sinica, 2022 - ieeexplore.ieee.org
The core task of tracking control is to make the controlled plant track a desired trajectory. The
traditional performance index used in previous studies cannot eliminate completely the …

Data-enabled predictive control: In the shallows of the DeePC

J Coulson, J Lygeros, F Dörfler - 2019 18th European Control …, 2019 - ieeexplore.ieee.org
We consider the problem of optimal trajectory tracking for unknown systems. A novel data-
enabled predictive control (DeePC) algorithm is presented that computes optimal and safe …

Value iteration and adaptive optimal output regulation with assured convergence rate

Y Jiang, W Gao, J Na, D Zhang, TT Hämäläinen… - Control Engineering …, 2022 - Elsevier
In this paper, we investigate the learning-based adaptive optimal output regulation problem
with convergence rate requirement for disturbed linear continuous-time systems. An …

Tracking Control of Completely Unknown Continuous-Time Systems via Off-Policy Reinforcement Learning

H Modares, FL Lewis, ZP Jiang - IEEE transactions on neural …, 2015 - ieeexplore.ieee.org
This paper deals with the design of an H∞ tracking controller for nonlinear continuous-time
systems with completely unknown dynamics. A general bounded L 2-gain tracking problem …

Advanced value iteration for discrete-time intelligent critic control: A survey

M Zhao, D Wang, J Qiao, M Ha, J Ren - Artificial Intelligence Review, 2023 - Springer
Optimal control problems are ubiquitous in practical engineering applications and social life
with the idea of cost or resource conservation. Based on the critic learning scheme, adaptive …

Optimal tracking control of nonlinear partially-unknown constrained-input systems using integral reinforcement learning

H Modares, FL Lewis - Automatica, 2014 - Elsevier
In this paper, a new formulation for the optimal tracking control problem (OTCP) of
continuous-time nonlinear systems is presented. This formulation extends the integral …

A novel adaptive dynamic programming based on tracking error for nonlinear discrete-time systems

C Li, J Ding, FL Lewis, T Chai - Automatica, 2021 - Elsevier
In this paper, to eliminate the tracking error by using adaptive dynamic programming (ADP)
algorithms, a novel formulation of the value function is presented for the optimal tracking …

Model-free optimal tracking control via critic-only Q-learning

B Luo, D Liu, T Huang, D Wang - IEEE transactions on neural …, 2016 - ieeexplore.ieee.org
Model-free control is an important and promising topic in control fields, which has attracted
extensive attention in the past few years. In this paper, we aim to solve the model-free …