A survey on explainable reinforcement learning: Concepts, algorithms, challenges

Y Qing, S Liu, J Song, H Wang, M Song - arXiv preprint arXiv:2211.06665, 2022 - arxiv.org
Reinforcement Learning (RL) is a popular machine learning paradigm where intelligent
agents interact with the environment to fulfill a long-term goal. Driven by the resurgence of …

[HTML][HTML] Verifying learning-based robotic navigation systems

G Amir, D Corsi, R Yerushalmi, L Marzari… - … Conference on Tools …, 2023 - Springer
Deep reinforcement learning (DRL) has become a dominant deep-learning paradigm for
tasks where complex policies are learned within reactive systems. Unfortunately, these …

Boosting verification of deep reinforcement learning via piece-wise linear decision neural networks

J Tian, D Zhi, S Liu, P Wang… - Advances in Neural …, 2023 - proceedings.neurips.cc
Formally verifying deep reinforcement learning (DRL) systems suffers from both inaccurate
verification results and limited scalability. The major obstacle lies in the large overestimation …

veriFIRE: verifying an industrial, learning-based wildfire detection system

G Amir, Z Freund, G Katz, E Mandelbaum… - … Symposium on Formal …, 2023 - Springer
In this short paper, we present our ongoing work on the veriFIRE project—a collaboration
between industry and academia, aimed at using verification for increasing the reliability of a …

COOL-MC: a comprehensive tool for reinforcement learning and model checking

D Gross, N Jansen, S Junges, GA Pérez - International Symposium on …, 2022 - Springer
This paper presents COOL-MC, a tool that integrates state-of-the-art reinforcement learning
(RL) and model checking. Specifically, the tool builds upon the OpenAI gym and the …

Boosting Verified Training for Robust Image Classifications via Abstraction

Z Zhang, Z Xue, Y Chen, S Liu… - Proceedings of the …, 2023 - openaccess.thecvf.com
This paper proposes a novel, abstraction-based, certified training method for robust image
classifiers. Via abstraction, all perturbed images are mapped into intervals before feeding …

[HTML][HTML] Verification-guided programmatic controller synthesis

Y Wang, H Zhu - International Conference on Tools and Algorithms for …, 2023 - Springer
We present a verification-based learning framework VEL that synthesizes safe programmatic
controllers for environments with continuous state and action spaces. The key idea is the …

RAVEN: Reinforcement learning for generating verifiable run-time requirement enforcers for MPSoCs

K Esper, J Spieck, PL Sixdenier… - Fourth Workshop on …, 2023 - drops.dagstuhl.de
In embedded systems, applications frequently have to meet non-functional requirements
regarding, eg, real-time or energy consumption constraints, when executing on a given …

Using Deep Reinforcement Learning And Formal Verification in Safety Critical Systems: Strategies and Challenges

S Sharma, MABU Rahim, S Hussain… - 2023 IEEE 23rd …, 2023 - ieeexplore.ieee.org
Deep Reinforcement Learning (DRL) is critical in modern Artificial Intelligence (AI), powering
innovations from gaming to autonomous vehicles. As DRL continues its rapid ascent …

Unifying qualitative and quantitative safety verification of dnn-controlled systems

D Zhi, P Wang, S Liu, L Ong, M Zhang - arXiv preprint arXiv:2404.01769, 2024 - arxiv.org
The rapid advance of deep reinforcement learning techniques enables the oversight of
safety-critical systems through the utilization of Deep Neural Networks (DNNs). This …