Testing deep neural networks

Y Sun, X Huang, D Kroening, J Sharp, M Hill… - arXiv preprint arXiv …, 2018 - arxiv.org
Deep neural networks (DNNs) have a wide range of applications, and software employing
them must be thoroughly tested, especially in safety-critical domains. However, traditional …

Structural test coverage criteria for deep neural networks

Y Sun, X Huang, D Kroening, J Sharp, M Hill… - ACM Transactions on …, 2019 - dl.acm.org
Deep neural networks (DNNs) have a wide range of applications, and software employing
them must be thoroughly tested, especially in safety-critical domains. However, traditional …

Black-box testing of deep neural networks through test case diversity

Z Aghababaeyan, M Abdellatif, L Briand… - IEEE Transactions …, 2023 - ieeexplore.ieee.org
Deep Neural Networks (DNNs) have been extensively used in many areas including image
processing, medical diagnostics and autonomous driving. However, DNNs can exhibit …

Structural coverage criteria for neural networks could be misleading

Z Li, X Ma, C Xu, C Cao - 2019 IEEE/ACM 41st International …, 2019 - ieeexplore.ieee.org
There is a dramatically increasing interest in the quality assurance for DNN-based systems
in the software engineering community. An emerging hot topic in this direction is structural …

Distribution-aware testing of neural networks using generative models

S Dola, MB Dwyer, ML Soffa - 2021 IEEE/ACM 43rd …, 2021 - ieeexplore.ieee.org
The reliability of software that has a Deep Neural Network (DNN) as a component is urgently
important today given the increasing number of critical applications being deployed with …

Deepgini: prioritizing massive tests to enhance the robustness of deep neural networks

Y Feng, Q Shi, X Gao, J Wan, C Fang… - Proceedings of the 29th …, 2020 - dl.acm.org
Deep neural networks (DNN) have been deployed in many software systems to assist in
various classification tasks. In company with the fantastic effectiveness in classification …

Towards improved testing for deep learning

J Sekhon, C Fleming - … New Ideas and Emerging Results (ICSE …, 2019 - ieeexplore.ieee.org
The growing use of deep neural networks in safety-critical applications makes it necessary
to carry out adequate testing to detect and correct any incorrect behavior for corner case …

Combinatorial testing for deep learning systems

L Ma, F Zhang, M Xue, B Li, Y Liu, J Zhao… - arXiv preprint arXiv …, 2018 - arxiv.org
Deep learning (DL) has achieved remarkable progress over the past decade and been
widely applied to many safety-critical applications. However, the robustness of DL systems …

Prioritizing test inputs for deep neural networks via mutation analysis

Z Wang, H You, J Chen, Y Zhang… - 2021 IEEE/ACM 43rd …, 2021 - ieeexplore.ieee.org
Deep Neural Network (DNN) testing is one of the most widely-used ways to guarantee the
quality of DNNs. However, labeling test inputs to check the correctness of DNN prediction is …

Practical accuracy estimation for efficient deep neural network testing

J Chen, Z Wu, Z Wang, H You, L Zhang… - ACM Transactions on …, 2020 - dl.acm.org
Deep neural network (DNN) has become increasingly popular and DNN testing is very
critical to guarantee the correctness of DNN, ie, the accuracy of DNN in this work. However …