作者
Bo Xiao, Hak-Keung Lam, Xiaojie Su, Ziwei Wang, Frank P-W Lo, Shihong Chen, Eric Yeatman
发表日期
2023/2/1
期刊
Journal of Automation and Intelligence
卷号
2
期号
1
页码范围
20-30
出版商
Elsevier
简介
Reinforcement Learning (RL) based control algorithms can learn the control strategies for nonlinear and uncertain environment during interacting with it. Guided by the rewards generated by environment, a RL agent can learn the control strategy directly in a model-free way instead of investigating the dynamic model of the environment. In the paper, we propose the sampled-data RL control strategy to reduce the computational demand. In the sampled-data control strategy, the whole control system is of a hybrid structure, in which the plant is of continuous structure while the controller (RL agent) adopts a discrete structure. Given that the continuous states of the plant will be the input of the agent, the state–action value function is approximated by the fully connected feed-forward neural networks (FCFFNN). Instead of learning the controller at every step during the interaction with the environment, the learning and …
引用总数
学术搜索中的文章
B Xiao, HK Lam, X Su, Z Wang, FPW Lo, S Chen… - Journal of Automation and Intelligence, 2023