A survey of safety and trustworthiness of deep neural networks: Verification, testing, adversarial attack and defence, and interpretability

X Huang, D Kroening, W Ruan, J Sharp, Y Sun… - Computer Science …, 2020 - Elsevier
In the past few years, significant progress has been made on deep neural networks (DNNs)
in achieving human-level performance on several long-standing tasks. With the broader …

Algorithms for verifying deep neural networks

C Liu, T Arnon, C Lazarus, C Strong… - … and Trends® in …, 2021 - nowpublishers.com
Deep neural networks are widely used for nonlinear function approximation, with
applications ranging from computer vision to control. Although these networks involve the …

General cutting planes for bound-propagation-based neural network verification

H Zhang, S Wang, K Xu, L Li, B Li… - Advances in neural …, 2022 - proceedings.neurips.cc
Bound propagation methods, when combined with branch and bound, are among the most
effective methods to formally verify properties of deep neural networks such as correctness …

Beta-crown: Efficient bound propagation with per-neuron split constraints for neural network robustness verification

S Wang, H Zhang, K Xu, X Lin, S Jana… - Advances in …, 2021 - proceedings.neurips.cc
Bound propagation based incomplete neural network verifiers such as CROWN are very
efficient and can significantly accelerate branch-and-bound (BaB) based complete …

The marabou framework for verification and analysis of deep neural networks

G Katz, DA Huang, D Ibeling, K Julian… - … Aided Verification: 31st …, 2019 - Springer
Deep neural networks are revolutionizing the way complex systems are designed.
Consequently, there is a pressing need for tools and techniques for network analysis and …

Software engineering for AI-based systems: a survey

S Martínez-Fernández, J Bogner, X Franch… - ACM Transactions on …, 2022 - dl.acm.org
AI-based systems are software systems with functionalities enabled by at least one AI
component (eg, for image-, speech-recognition, and autonomous driving). AI-based systems …

An abstract domain for certifying neural networks

G Singh, T Gehr, M Püschel, M Vechev - Proceedings of the ACM on …, 2019 - dl.acm.org
We present a novel method for scalable and precise certification of deep neural networks.
The key technical insight behind our approach is a new abstract domain which combines …

Are formal methods applicable to machine learning and artificial intelligence?

M Krichen, A Mihoub, MY Alzahrani… - … Conference of Smart …, 2022 - ieeexplore.ieee.org
Formal approaches can provide strict correctness guarantees for the development of both
hardware and software systems. In this work, we examine state-of-the-art formal methods for …

Fast and effective robustness certification

G Singh, T Gehr, M Mirman… - Advances in neural …, 2018 - proceedings.neurips.cc
We present a new method and system, called DeepZ, for certifying neural network
robustness based on abstract interpretation. Compared to state-of-the-art automated …

Certified robustness to adversarial examples with differential privacy

M Lecuyer, V Atlidakis, R Geambasu… - … IEEE symposium on …, 2019 - ieeexplore.ieee.org
Adversarial examples that fool machine learning models, particularly deep neural networks,
have been a topic of intense research interest, with attacks and defenses being developed …