[PDF][PDF] Formally Explaining Neural Networks within Reactive Systems

S Bassan, G Amir, D Corsi, I Refaeli… - 2023 Formal Methods in …, 2023 - library.oapen.org
Deep neural networks (DNNs) are increasingly being used as controllers in reactive
systems. However, DNNs are highly opaque, which renders it difficult to explain and justify …

Analyzing Adversarial Inputs in Deep Reinforcement Learning

D Corsi, G Amir, G Katz, A Farinelli - arXiv preprint arXiv:2402.05284, 2024 - arxiv.org
In recent years, Deep Reinforcement Learning (DRL) has become a popular paradigm in
machine learning due to its successful applications to real-world and complex systems …

Safe deep reinforcement learning by verifying task-level properties

E Marchesini, L Marzari, A Farinelli, C Amato - arXiv preprint arXiv …, 2023 - arxiv.org
Cost functions are commonly employed in Safe Deep Reinforcement Learning (DRL).
However, the cost is typically encoded as an indicator function due to the difficulty of …

Online safety property collection and refinement for safe deep reinforcement learning in mapless navigation

L Marzari, E Marchesini… - 2023 IEEE International …, 2023 - ieeexplore.ieee.org
Safety is essential for deploying Deep Reinforcement Learning (DRL) algorithms in real-
world scenarios. Recently, verification approaches have been proposed to allow quantifying …

Enumerating safe regions in deep neural networks with provable probabilistic guarantees

L Marzari, D Corsi, E Marchesini, A Farinelli… - Proceedings of the …, 2024 - ojs.aaai.org
Identifying safe areas is a key point to guarantee trust for systems that are based on Deep
Neural Networks (DNNs). To this end, we introduce the AllDNN-Verification problem: given a …

Shield Synthesis for LTL Modulo Theories

A Rodriguez, G Amir, D Corsi, C Sanchez… - arXiv preprint arXiv …, 2024 - arxiv.org
In recent years, Machine Learning (ML) models have achieved remarkable success in
various domains. However, these models also tend to demonstrate unsafe behaviors …

Constrained reinforcement learning and formal verification for safe colonoscopy navigation

D Corsi, L Marzari, A Pore, A Farinelli… - 2023 IEEE/RSJ …, 2023 - ieeexplore.ieee.org
The field of robotic Flexible Endoscopes (FEs) has progressed significantly, offering a
promising solution to reduce patient discomfort. However, the limited autonomy of most …

Scaling# DNN-Verification Tools with Efficient Bound Propagation and Parallel Computing

L Marzari, G Roncolato, A Farinelli - arXiv preprint arXiv:2312.05890, 2023 - arxiv.org
Deep Neural Networks (DNNs) are powerful tools that have shown extraordinary results in
many scenarios, ranging from pattern recognition to complex robotic problems. However …

ModelVerification. jl: a Comprehensive Toolbox for Formally Verifying Deep Neural Networks

T Wei, L Marzari, KS Yun, H Hu, P Niu, X Luo… - arXiv preprint arXiv …, 2024 - arxiv.org
Deep Neural Networks (DNN) are crucial in approximating nonlinear functions across
diverse applications, ranging from image classification to control. Verifying specific input …

Probabilistic Verification of Neural Networks using Branch and Bound

D Boetius, S Leue, T Sutter - arXiv preprint arXiv:2405.17556, 2024 - arxiv.org
Probabilistic verification of neural networks is concerned with formally analysing the output
distribution of a neural network under a probability distribution of the inputs. Examples of …