Towards characterizing adversarial defects of deep learning software from the lens of uncertainty

X Zhang, X Xie, L Ma, X Du, Q Hu, Y Liu… - Proceedings of the …, 2020 - dl.acm.org
… deep neuron networks, ie, DeepHunter [55] and TensorFuzz [38], both of which adopt
coverage-based fuzzing … MODE: automated neural network model debugging via state differential …

Umlaut: Debugging deep learning programs using program structure and model behavior

E Schoop, F Huang, B Hartmann - … of the 2021 CHI conference on …, 2021 - dl.acm.org
… Taking steps towards debugging these issues, TensorFuzz adapts coverage-based fuzzing
debugging and providing explanations of neural network output during the training process. …

Semantic image fuzzing of AI perception systems

T Woodlief, S Elbaum, K Sullivan - Proceedings of the 44th International …, 2022 - dl.acm.org
… Following standard software fuzzing, we will examine how to use SUT performance to
guide mutation type and parameter selection to more quickly find inconsistencies. We will also …

Distribution Aware Testing Framework for Deep Neural Networks

D Demir, AB Can, E Surer - IEEE Access, 2023 - ieeexplore.ieee.org
… using an 8-layer convolutional neural network. Their study was to examine the effectiveness
of visual posthoc model explanations in diagnosing model errors and debugging. The bugs …

[PDF][PDF] An empirical study on correlation between coverage and robustness for deep neural networks.(2020)

Y DONG, P ZHANG, J WANG, S LIU, J SUN… - 2020 25th IEEE … - ink.library.smu.edu.sg
Deep neural networks (DNN) are increasingly applied in safety-critical systems, eg, for face
recognition, autonomous car control and malware detection. It is also shown that DNNs are …

[PDF][PDF] Evolutionary grammar-based fuzzing

T Kehrer - martineberlein.github.io
… testing, file format testing or testing neural networks [7], [8]. … Coverage guided fuzzing
tools (CFG) usually consist of an input mutation generator, feedback guidance, and a fuzzing

Can Coverage Criteria Guide Failure Discovery for Image Classifiers? An Empirical Study

Z Wang, S Xu, L Fan, X Cai, L Li, Z Liu - ACM Transactions on Software … - dl.acm.org
Neural Network (DNN)-based software, such as metamorphic testing [75, 97], mutation testing
[57], and fuzzing [… Based on these criteria, some studies apply coverage-guided fuzzing on …

One fuzzing strategy to rule them all

M Wu, L Jiang, J Xiang, Y Huang, H Cui… - Proceedings of the 44th …, 2022 - dl.acm.org
… seeds, such coverageguided fuzzers usually develop strategies … Notably, a number of recent
coverage-guided fuzzers (eg, AFL [… further use neural networks to guide the fuzzing process. …

EAGLE: creating equivalent graphs to test deep learning libraries

J Wang, T Lutellier, S Qian, HV Pham… - Proceedings of the 44th …, 2022 - dl.acm.org
… Here DL software includes infrastructure code that performs core neural network computations
and … Deephunter: a coverage-guided fuzz testing framework for deep neural networks. In …

Cats are not fish: Deep learning testing calls for out-of-distribution awareness

D Berend, X Xie, L Ma, L Zhou, Y Liu, C Xu… - Proceedings of the 35th …, 2020 - dl.acm.org
… the architecture of the deep neural network (DNN), and … To test the data-driven deep
neural networks, a common way … Coverageguided testing is a representative and widely used …