Joint differentiable optimization and verification for certified reinforcement learning

Y Wang, S Zhan, Z Wang, C Huang, Z Wang… - Proceedings of the …, 2023 - dl.acm.org
Model-based reinforcement learning has been widely studied for controller synthesis in
cyber-physical systems (CPSs). In particular, for safety-critical CPSs, it is important to …

Scalable synthesis of verified controllers in deep reinforcement learning

Z Xiong, S Jagannathan - arXiv preprint arXiv:2104.10219, 2021 - arxiv.org
There has been significant recent interest in devising verification techniques for learning-
enabled controllers (LECs) that manage safety-critical systems. Given the opacity and lack of …

Formally Verifying Deep Reinforcement Learning Controllers with Lyapunov Barrier Certificates

U Mandal, G Amir, H Wu, I Daukantas… - arXiv preprint arXiv …, 2024 - arxiv.org
Deep reinforcement learning (DRL) is a powerful machine learning paradigm for generating
agents that control autonomous systems. However, the" black box" nature of DRL agents …

Verification in the loop: Correct-by-construction control learning with reach-avoid guarantees

Y Wang, C Huang, Z Wang, Z Wang, Q Zhu - arXiv preprint arXiv …, 2021 - arxiv.org
In the current control design of safety-critical autonomous systems, formal verification
techniques are typically applied after the controller is designed to evaluate whether the …

End-to-end safe reinforcement learning through barrier functions for safety-critical continuous control tasks

R Cheng, G Orosz, RM Murray, JW Burdick - Proceedings of the AAAI …, 2019 - aaai.org
Reinforcement Learning (RL) algorithms have found limited success beyond simulated
applications, and one main reason is the absence of safety guarantees during the learning …

Trainify: A CEGAR-Driven Training and Verification Framework for Safe Deep Reinforcement Learning

P Jin, J Tian, D Zhi, X Wen, M Zhang - International Conference on …, 2022 - Springer
Abstract Deep Reinforcement Learning (DRL) has demonstrated its strength in developing
intelligent systems. These systems shall be formally guaranteed to be trustworthy when …

From self-tuning regulators to reinforcement learning and back again

N Matni, A Proutiere, A Rantzer… - 2019 IEEE 58th …, 2019 - ieeexplore.ieee.org
Machine and reinforcement learning (RL) are increasingly being applied to plan and control
the behavior of autonomous systems interacting with the physical world. Examples include …

Learning deep neural network controllers for dynamical systems with safety guarantees

JV Deshmukh, JP Kapinski… - 2019 IEEE/ACM …, 2019 - ieeexplore.ieee.org
There is recent interest in using deep neural networks (DNNs) for controlling autonomous
cyber-physical systems (CPSs). One challenge with this approach is that many autonomous …

Wasserstein auto-encoded MDPs: Formal verification of efficiently distilled RL policies with many-sided guarantees

F Delgrange, A Nowe, GA Pérez - arXiv preprint arXiv:2303.12558, 2023 - arxiv.org
Although deep reinforcement learning (DRL) has many success stories, the large-scale
deployment of policies learned through these advanced techniques in safety-critical …

FISAR: Forward invariant safe reinforcement learning with a deep neural network-based optimizer

C Sun, DK Kim, JP How - 2021 IEEE International Conference …, 2021 - ieeexplore.ieee.org
This paper investigates reinforcement learning with constraints, which are indispensable in
safety-critical environments. To drive the constraint violation to decrease monotonically, we …