A review of safe reinforcement learning: Methods, theory and applications

S Gu, L Yang, Y Du, G Chen, F Walter, J Wang… - arXiv preprint arXiv …, 2022 - arxiv.org
Reinforcement Learning (RL) has achieved tremendous success in many complex decision-
making tasks. However, safety concerns are raised during deploying RL in real-world …

Neurosymbolic programming

S Chaudhuri, K Ellis, O Polozov, R Singh… - … and Trends® in …, 2021 - nowpublishers.com
We survey recent work on neurosymbolic programming, an emerging area that bridges the
areas of deep learning and program synthesis. Like in classic machine learning, the goal …

NNV: the neural network verification tool for deep neural networks and learning-enabled cyber-physical systems

HD Tran, X Yang, D Manzanas Lopez, P Musau… - … on Computer Aided …, 2020 - Springer
This paper presents the Neural Network Verification (NNV) software tool, a set-based
verification framework for deep neural networks (DNNs) and learning-enabled cyber …

A survey on interpretable reinforcement learning

C Glanois, P Weng, M Zimmer, D Li, T Yang, J Hao… - Machine Learning, 2024 - Springer
Although deep reinforcement learning has become a promising machine learning approach
for sequential decision-making problems, it is still not mature enough for high-stake domains …

A survey on artificial intelligence assurance

FA Batarseh, L Freeman, CH Huang - Journal of Big Data, 2021 - Springer
Artificial Intelligence (AI) algorithms are increasingly providing decision making and
operational support across multiple domains. AI includes a wide (and growing) library of …

Safe reinforcement learning using probabilistic shields

N Jansen, B Könighofer, S Junges… - 31st International …, 2020 - drops.dagstuhl.de
This paper concerns the efficient construction of a safety shield for reinforcement learning.
We specifically target scenarios that incorporate uncertainty and use Markov decision …

Learning to synthesize programs as interpretable and generalizable policies

D Trivedi, J Zhang, SH Sun… - Advances in neural …, 2021 - proceedings.neurips.cc
Recently, deep reinforcement learning (DRL) methods have achieved impressive
performance on tasks in a variety of domains. However, neural network policies produced …

Deep reinforcement learning verification: a survey

M Landers, A Doryab - ACM Computing Surveys, 2023 - dl.acm.org
Deep reinforcement learning (DRL) has proven capable of superhuman performance on
many complex tasks. To achieve this success, DRL algorithms train a decision-making agent …

Neurosymbolic reinforcement learning with formally verified exploration

G Anderson, A Verma, I Dillig… - Advances in neural …, 2020 - proceedings.neurips.cc
We present REVEL, a partially neural reinforcement learning (RL) framework for provably
safe exploration in continuous state and action spaces. A key challenge for provably safe …

Introduction to neural network verification

A Albarghouthi - Foundations and Trends® in Programming …, 2021 - nowpublishers.com
Deep learning has transformed the way we think of software and what it can do. But deep
neural networks are fragile and their behaviors are often surprising. In many settings, we …