The safety filter: A unified view of safety-critical control in autonomous systems

KC Hsu, H Hu, JF Fisac - Annual Review of Control, Robotics …, 2023 - annualreviews.org
Recent years have seen significant progress in the realm of robot autonomy, accompanied
by the expanding reach of robotic technologies. However, the emergence of new …

[HTML][HTML] NNV: the neural network verification tool for deep neural networks and learning-enabled cyber-physical systems

HD Tran, X Yang, D Manzanas Lopez, P Musau… - … on Computer Aided …, 2020 - Springer
This paper presents the Neural Network Verification (NNV) software tool, a set-based
verification framework for deep neural networks (DNNs) and learning-enabled cyber …

Risk-averse autonomous systems: A brief history and recent developments from the perspective of optimal control

Y Wang, MP Chapman - Artificial Intelligence, 2022 - Elsevier
We present an historical overview about the connections between the analysis of risk and
the control of autonomous systems. We offer two main contributions. Our first contribution is …

Testing deep neural networks

Y Sun, X Huang, D Kroening, J Sharp, M Hill… - arXiv preprint arXiv …, 2018 - arxiv.org
Deep neural networks (DNNs) have a wide range of applications, and software employing
them must be thoroughly tested, especially in safety-critical domains. However, traditional …

Reachnn: Reachability analysis of neural-network controlled systems

C Huang, J Fan, W Li, X Chen, Q Zhu - ACM Transactions on Embedded …, 2019 - dl.acm.org
Applying neural networks as controllers in dynamical systems has shown great promises.
However, it is critical yet challenging to verify the safety of such control systems with neural …

[HTML][HTML] Verification of deep convolutional neural networks using imagestars

HD Tran, S Bak, W Xiang, TT Johnson - International conference on …, 2020 - Springer
Abstract Convolutional Neural Networks (CNN) have redefined state-of-the-art in many real-
world applications, such as facial recognition, image classification, human pose estimation …

Stability analysis using quadratic constraints for systems with neural network controllers

H Yin, P Seiler, M Arcak - IEEE Transactions on Automatic …, 2021 - ieeexplore.ieee.org
A method is presented to analyze the stability of feedback systems with neural network
controllers. Two stability theorems are given to prove asymptotic stability and to compute an …

Reachable set estimation for neural network control systems: A simulation-guided approach

W Xiang, HD Tran, X Yang… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
The vulnerability of artificial intelligence (AI) and machine learning (ML) against adversarial
disturbances and attacks significantly restricts their applicability in safety-critical systems …

Safety verification of cyber-physical systems with reinforcement learning control

HD Tran, F Cai, ML Diego, P Musau… - ACM Transactions on …, 2019 - dl.acm.org
This paper proposes a new forward reachability analysis approach to verify safety of cyber-
physical systems (CPS) with reinforcement learning controllers. The foundation of our …

Structural test coverage criteria for deep neural networks

Y Sun, X Huang, D Kroening, J Sharp, M Hill… - ACM Transactions on …, 2019 - dl.acm.org
Deep neural networks (DNNs) have a wide range of applications, and software employing
them must be thoroughly tested, especially in safety-critical domains. However, traditional …