Free lunch for testing: Fuzzing deep-learning libraries from open source

A Wei, Y Deng, C Yang, L Zhang - Proceedings of the 44th International …, 2022 - dl.acm.org
Deep learning (DL) systems can make our life much easier, and thus are gaining more and
more attention from both academia and industry. Meanwhile, bugs in DL systems can be …

Robot: Robustness-oriented testing for deep learning systems

J Wang, J Chen, Y Sun, X Ma, D Wang… - 2021 IEEE/ACM …, 2021 - ieeexplore.ieee.org
Recently, there has been a significant growth of interest in applying software engineering
techniques for the quality assurance of deep learning (DL) systems. One popular direction is …

Npc: N euron p ath c overage via characterizing decision logic of deep neural networks

X Xie, T Li, J Wang, L Ma, Q Guo, F Juefei-Xu… - ACM Transactions on …, 2022 - dl.acm.org
Deep learning has recently been widely applied to many applications across different
domains, eg, image classification and audio recognition. However, the quality of Deep …

Correlations between deep neural network model coverage criteria and model quality

S Yan, G Tao, X Liu, J Zhai, S Ma, L Xu… - Proceedings of the 28th …, 2020 - dl.acm.org
Inspired by the great success of using code coverage as guidance in software testing, a lot
of neural network coverage criteria have been proposed to guide testing of neural network …

Revisiting neuron coverage metrics and quality of deep neural networks

Z Yang, J Shi, MH Asyrofi, D Lo - 2022 IEEE International …, 2022 - ieeexplore.ieee.org
Deep neural networks (DNN) have been widely applied in modern life, including critical
domains like autonomous driving, making it essential to ensure the reliability and robustness …

Deepgd: A multi-objective black-box test selection approach for deep neural networks

Z Aghababaeyan, M Abdellatif, M Dadkhah… - ACM Transactions on …, 2024 - dl.acm.org
Deep neural networks (DNNs) are widely used in various application domains such as
image processing, speech recognition, and natural language processing. However, testing …

Is neuron coverage a meaningful measure for testing deep neural networks?

F Harel-Canada, L Wang, MA Gulzar, Q Gu… - Proceedings of the 28th …, 2020 - dl.acm.org
Recent effort to test deep learning systems has produced an intuitive and compelling test
criterion called neuron coverage (NC), which resembles the notion of traditional code …

Black-box testing of deep neural networks through test case diversity

Z Aghababaeyan, M Abdellatif, L Briand… - IEEE Transactions …, 2023 - ieeexplore.ieee.org
Deep Neural Networks (DNNs) have been extensively used in many areas including image
processing, medical diagnostics and autonomous driving. However, DNNs can exhibit …

A review and refinement of surprise adequacy

M Weiss, R Chakraborty… - 2021 IEEE/ACM Third …, 2021 - ieeexplore.ieee.org
Surprise Adequacy (SA) is one of the emerging and most promising adequacy criteria for
Deep Learning (DL) testing. As an adequacy criterion, it has been used to assess the …

Towards fair machine learning software: Understanding and addressing model bias through counterfactual thinking

Z Wang, Y Zhou, M Qiu, I Haque, L Brown, Y He… - arXiv preprint arXiv …, 2023 - arxiv.org
The increasing use of Machine Learning (ML) software can lead to unfair and unethical
decisions, thus fairness bugs in software are becoming a growing concern. Addressing …