Robot: Robustness-oriented testing for deep learning systems

J Wang, J Chen, Y Sun, X Ma, D Wang… - 2021 IEEE/ACM …, 2021 - ieeexplore.ieee.org
Recently, there has been a significant growth of interest in applying software engineering
techniques for the quality assurance of deep learning (DL) systems. One popular direction is …

Remos: Reducing defect inheritance in transfer learning via relevant model slicing

Z Zhang, Y Li, J Wang, B Liu, D Li, Y Guo… - Proceedings of the 44th …, 2022 - dl.acm.org
Transfer learning is a popular software reuse technique in the deep learning community that
enables developers to build custom models (students) based on sophisticated pretrained …

A Survey on an Emerging Safety Challenge for Autonomous Vehicles: Safety of the Intended Functionality

H Wang, W Shao, C Sun, K Yang, D Cao, J Li - Engineering, 2024 - Elsevier
As the complexity of autonomous vehicles (AVs) continues to increase and artificial
intelligence algorithms are becoming increasingly ubiquitous, a novel safety concern known …

Are machine learning cloud apis used correctly?

C Wan, S Liu, H Hoffmann, M Maire… - 2021 IEEE/ACM 43rd …, 2021 - ieeexplore.ieee.org
Machine learning (ML) cloud APIs enable developers to easily incorporate learning
solutions into software systems. Unfortunately, ML APIs are challenging to use correctly and …

Automated testing of software that uses machine learning apis

C Wan, S Liu, S Xie, Y Liu, H Hoffmann… - Proceedings of the 44th …, 2022 - dl.acm.org
An increasing number of software applications incorporate machine learning (ML) solutions
for cognitive tasks that statistically mimic human behaviors. To test such software …

An overview of structural coverage metrics for testing neural networks

M Usman, Y Sun, D Gopinath, R Dange… - International Journal on …, 2023 - Springer
Deep neural network (DNN) models, including those used in safety-critical domains, need to
be thoroughly tested to ensure that they can reliably perform well in different scenarios. In …

Deepmetis: Augmenting a deep learning test set to increase its mutation score

V Riccio, N Humbatova, G Jahangirova… - 2021 36th IEEE/ACM …, 2021 - ieeexplore.ieee.org
Deep Learning (DL) components are routinely integrated into software systems that need to
perform complex tasks such as image or natural language processing. The adequacy of the …

BET: black-box efficient testing for convolutional neural networks

J Wang, H Qiu, Y Rong, H Ye, Q Li, Z Li… - Proceedings of the 31st …, 2022 - dl.acm.org
It is important to test convolutional neural networks (CNNs) to identify defects (eg error-
inducing inputs) before deploying them in security-sensitive scenarios. Although existing …

Black-box safety analysis and retraining of DNNs based on feature extraction and clustering

M Attaoui, H Fahmy, F Pastore, L Briand - ACM Transactions on Software …, 2023 - dl.acm.org
Deep neural networks (DNNs) have demonstrated superior performance over classical
machine learning to support many features in safety-critical systems. Although DNNs are …

Multilayered review of safety approaches for machine learning-based systems in the days of AI

S Dey, SW Lee - Journal of Systems and Software, 2021 - Elsevier
The unprecedented advancement of artificial intelligence (AI) in recent years has altered our
perspectives on software engineering and systems engineering as a whole. Nowadays …