Practical accuracy estimation for efficient deep neural network testing

J Chen, Z Wu, Z Wang, H You, L Zhang… - ACM Transactions on …, 2020 - dl.acm.org
Deep neural network (DNN) has become increasingly popular and DNN testing is very
critical to guarantee the correctness of DNN, ie, the accuracy of DNN in this work. However …

Input prioritization for testing neural networks

T Byun, V Sharma, A Vijayakumar… - 2019 IEEE …, 2019 - ieeexplore.ieee.org
Deep neural networks (DNNs) are increasingly being adopted for sensing and control
functions in a variety of safety and mission-critical systems such as self-driving cars …

Adaptive test selection for deep neural networks

X Gao, Y Feng, Y Yin, Z Liu, Z Chen, B Xu - Proceedings of the 44th …, 2022 - dl.acm.org
Deep neural networks (DNN) have achieved tremendous development in the past decade.
While many DNN-driven software applications have been deployed to solve various tasks …

Deepgini: prioritizing massive tests to enhance the robustness of deep neural networks

Y Feng, Q Shi, X Gao, J Wan, C Fang… - Proceedings of the 29th …, 2020 - dl.acm.org
Deep neural networks (DNN) have been deployed in many software systems to assist in
various classification tasks. In company with the fantastic effectiveness in classification …

Testing deep neural networks

Y Sun, X Huang, D Kroening, J Sharp, M Hill… - arXiv preprint arXiv …, 2018 - arxiv.org
Deep neural networks (DNNs) have a wide range of applications, and software employing
them must be thoroughly tested, especially in safety-critical domains. However, traditional …

Comparing offline and online testing of deep neural networks: An autonomous car case study

FU Haq, D Shin, S Nejati… - 2020 IEEE 13th …, 2020 - ieeexplore.ieee.org
There is a growing body of research on developing testing techniques for Deep Neural
Networks (DNNs). We distinguish two general modes of testing for DNNs: Offline testing …

BET: black-box efficient testing for convolutional neural networks

J Wang, H Qiu, Y Rong, H Ye, Q Li, Z Li… - Proceedings of the 31st …, 2022 - dl.acm.org
It is important to test convolutional neural networks (CNNs) to identify defects (eg error-
inducing inputs) before deploying them in security-sensitive scenarios. Although existing …

Boosting operational dnn testing efficiency through conditioning

Z Li, X Ma, C Xu, C Cao, J Xu, J Lü - Proceedings of the 2019 27th ACM …, 2019 - dl.acm.org
With the increasing adoption of Deep Neural Network (DNN) models as integral parts of
software systems, efficient operational testing of DNNs is much in demand to ensure these …

Prioritizing test inputs for deep neural networks via mutation analysis

Z Wang, H You, J Chen, Y Zhang… - 2021 IEEE/ACM 43rd …, 2021 - ieeexplore.ieee.org
Deep Neural Network (DNN) testing is one of the most widely-used ways to guarantee the
quality of DNNs. However, labeling test inputs to check the correctness of DNN prediction is …

Input distribution coverage: Measuring feature interaction adequacy in neural network testing

S Dola, MB Dwyer, ML Soffa - ACM Transactions on Software …, 2023 - dl.acm.org
Testing deep neural networks (DNNs) has garnered great interest in the recent years due to
their use in many applications. Black-box test adequacy measures are useful for guiding the …