Deepct: Tomographic combinatorial testing for deep learning systems

L Ma, F Juefei-Xu, M Xue, B Li, L Li… - 2019 IEEE 26th …, 2019 - ieeexplore.ieee.org
Deep learning (DL) has achieved remarkable progress over the past decade and has been
widely applied to many industry domains. However, the robustness of DL systems recently …

Combinatorial testing for deep learning systems

L Ma, F Zhang, M Xue, B Li, Y Liu, J Zhao… - arXiv preprint arXiv …, 2018 - arxiv.org
Deep learning (DL) has achieved remarkable progress over the past decade and been
widely applied to many safety-critical applications. However, the robustness of DL systems …

Deepmutation: Mutation testing of deep learning systems

L Ma, F Zhang, J Sun, M Xue, B Li… - 2018 IEEE 29th …, 2018 - ieeexplore.ieee.org
Deep learning (DL) defines a new data-driven programming paradigm where the internal
system logic is largely shaped by the training data. The standard way of evaluating DL …

Audee: Automated testing for deep learning frameworks

Q Guo, X Xie, Y Li, X Zhang, Y Liu, X Li… - Proceedings of the 35th …, 2020 - dl.acm.org
Deep learning (DL) has been applied widely, and the quality of DL system becomes crucial,
especially for safety-critical applications. Existing work mainly focuses on the quality …

Deepgauge: Multi-granularity testing criteria for deep learning systems

L Ma, F Juefei-Xu, F Zhang, J Sun, M Xue, B Li… - Proceedings of the 33rd …, 2018 - dl.acm.org
Deep learning (DL) defines a new data-driven programming paradigm that constructs the
internal system logic of a crafted neuron network through a set of training data. We have …

Deepmetis: Augmenting a deep learning test set to increase its mutation score

V Riccio, N Humbatova, G Jahangirova… - 2021 36th IEEE/ACM …, 2021 - ieeexplore.ieee.org
Deep Learning (DL) components are routinely integrated into software systems that need to
perform complex tasks such as image or natural language processing. The adequacy of the …

Black-box testing of deep neural networks through test case diversity

Z Aghababaeyan, M Abdellatif, L Briand… - IEEE Transactions …, 2023 - ieeexplore.ieee.org
Deep Neural Networks (DNNs) have been extensively used in many areas including image
processing, medical diagnostics and autonomous driving. However, DNNs can exhibit …

Model-based exploration of the frontier of behaviours for deep learning system testing

V Riccio, P Tonella - Proceedings of the 28th ACM Joint Meeting on …, 2020 - dl.acm.org
With the increasing adoption of Deep Learning (DL) for critical tasks, such as autonomous
driving, the evaluation of the quality of systems that rely on DL has become crucial. Once …

Prioritizing test inputs for deep neural networks via mutation analysis

Z Wang, H You, J Chen, Y Zhang… - 2021 IEEE/ACM 43rd …, 2021 - ieeexplore.ieee.org
Deep Neural Network (DNN) testing is one of the most widely-used ways to guarantee the
quality of DNNs. However, labeling test inputs to check the correctness of DNN prediction is …

Cats are not fish: Deep learning testing calls for out-of-distribution awareness

D Berend, X Xie, L Ma, L Zhou, Y Liu, C Xu… - Proceedings of the 35th …, 2020 - dl.acm.org
As Deep Learning (DL) is continuously adopted in many industrial applications, its quality
and reliability start to raise concerns. Similar to the traditional software development …