Advanced value iteration for discrete-time intelligent critic control: A survey

M Zhao, D Wang, J Qiao, M Ha, J Ren - Artificial Intelligence Review, 2023 - Springer
Optimal control problems are ubiquitous in practical engineering applications and social life
with the idea of cost or resource conservation. Based on the critic learning scheme, adaptive …

Reinforcement learning and adaptive optimal control for continuous-time nonlinear systems: A value iteration approach

T Bian, ZP Jiang - IEEE transactions on neural networks and …, 2021 - ieeexplore.ieee.org
This article studies the adaptive optimal control problem for continuous-time nonlinear
systems described by differential equations. A key strategy is to exploit the value iteration …

The intelligent critic framework for advanced optimal control

D Wang, M Ha, M Zhao - Artificial Intelligence Review, 2022 - Springer
The idea of optimization can be regarded as an important basis of many disciplines and
hence is extremely useful for a large number of research fields, particularly for artificial …

Recent progress in reinforcement learning and adaptive dynamic programming for advanced control applications

D Wang, N Gao, D Liu, J Li… - IEEE/CAA Journal of …, 2023 - ieeexplore.ieee.org
Reinforcement learning (RL) has roots in dynamic programming and it is called
adaptive/approximate dynamic programming (ADP) within the control community. This paper …

Multi-step heuristic dynamic programming for optimal control of nonlinear discrete-time systems

B Luo, D Liu, T Huang, X Yang, H Ma - Information Sciences, 2017 - Elsevier
Policy iteration and value iteration are two main iterative adaptive dynamic programming
frameworks for solving optimal control problems. Policy iteration converges fast while …

Stability and admissibility analysis for zero-sum games under general value iteration formulation

D Wang, M Zhao, M Ha, J Qiao - IEEE Transactions on Neural …, 2022 - ieeexplore.ieee.org
In this article, the general value iteration (GVI) algorithm for discrete-time zero-sum games is
investigated. The theoretical analysis focuses on stability properties of the systems and also …

Adaptive optimal control of continuous-time nonlinear affine systems via hybrid iteration

O Qasem, W Gao, KG Vamvoudakis - Automatica, 2023 - Elsevier
In this paper, a novel successive approximation framework, named hybrid iteration (HI), is
proposed to fill up the performance gap between two well-known dynamic programming …

Adaptive multi-step evaluation design with stability guarantee for discrete-time optimal learning control

D Wang, J Wang, M Zhao, P Xin… - IEEE/CAA Journal of …, 2023 - ieeexplore.ieee.org
This paper is concerned with a novel integrated multi-step heuristic dynamic programming
(MsHDP) algorithm for solving optimal control problems. It is shown that, initialized by the …

Adaptive constrained optimal control design for data-based nonlinear discrete-time systems with critic-only structure

B Luo, D Liu, HN Wu - IEEE Transactions on Neural Networks …, 2017 - ieeexplore.ieee.org
Reinforcement learning has proved to be a powerful tool to solve optimal control problems
over the past few years. However, the data-based constrained optimal control problem of …

Balancing value iteration and policy iteration for discrete-time control

B Luo, Y Yang, HN Wu, T Huang - IEEE Transactions on …, 2019 - ieeexplore.ieee.org
The optimal control problem of discrete-time nonlinear systems depends on the solution of
the Bellman equation. In this paper, an adaptive reinforcement learning (RL) method is …