Verification-guided programmatic controller synthesis

Y Wang, H Zhu - International Conference on Tools and Algorithms for …, 2023 - Springer
We present a verification-based learning framework VEL that synthesizes safe programmatic
controllers for environments with continuous state and action spaces. The key idea is the …

An inductive synthesis framework for verifiable reinforcement learning

H Zhu, Z Xiong, S Magill, S Jagannathan - Proceedings of the 40th ACM …, 2019 - dl.acm.org
Despite the tremendous advances that have been made in the last decade on developing
useful machine-learning applications, their wider adoption has been hindered by the lack of …

Reinforcement learning and formal requirements

F Somenzi, A Trivedi - … : 12th International Workshop, NSV 2019, New York …, 2019 - Springer
Reinforcement learning is an approach to controller synthesis where agents rely on reward
signals to choose actions in order to satisfy the requirements implicit in reward signals …

Safe reinforcement learning via formal methods: Toward safe control through proof and learning

N Fulton, A Platzer - Proceedings of the AAAI Conference on Artificial …, 2018 - ojs.aaai.org
Formal verification provides a high degree of confidence in safe system operation, but only if
reality matches the verified model. Although a good model will be accurate most of the time …

Combining runtime monitoring and machine learning with human feedback

A Lukina - Proceedings of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
State-of-the-art machine-learned controllers for autonomous systems demonstrate
unbeatable performance in scenarios known from training. However, in evolving …

Verifiably safe off-model reinforcement learning

N Fulton, A Platzer - International Conference on Tools and Algorithms for …, 2019 - Springer
The desire to use reinforcement learning in safety-critical settings has inspired a recent
interest in formal methods for learning algorithms. Existing formal methods for learning and …

Parameterized synthesis with safety properties

O Markgraf, CD Hong, AW Lin, M Najib… - … Languages and Systems …, 2020 - Springer
Parameterized synthesis offers a solution to the problem of constructing correct and verified
controllers for parameterized systems. Such systems occur naturally in practice (eg, in the …

Run-time optimization for learned controllers through quantitative games

G Avni, R Bloem, K Chatterjee, TA Henzinger… - … Aided Verification: 31st …, 2019 - Springer
A controller is a device that interacts with a plant. At each time point, it reads the plant's state
and issues commands with the goal that the plant operates optimally. Constructing optimal …

Verification in the loop: Correct-by-construction control learning with reach-avoid guarantees

Y Wang, C Huang, Z Wang, Z Wang, Q Zhu - arXiv preprint arXiv …, 2021 - arxiv.org
In the current control design of safety-critical autonomous systems, formal verification
techniques are typically applied after the controller is designed to evaluate whether the …

Verifiable and interpretable reinforcement learning through program synthesis

A Verma - Proceedings of the AAAI Conference on Artificial …, 2019 - ojs.aaai.org
We study the problem of generating interpretable and verifiable policies for Reinforcement
Learning (RL). Unlike the popular Deep Reinforcement Learning (DRL) paradigm, in which …