Testing machine learning based systems: a systematic mapping

V Riccio, G Jahangirova, A Stocco… - Empirical Software …, 2020 - Springer
Abstract Context: A Machine Learning based System (MLS) is a software system including
one or more components that learn how to perform a task from a given data set. The …

Finding critical scenarios for automated driving systems: A systematic mapping study

X Zhang, J Tao, K Tan, M Törngren… - IEEE Transactions …, 2022 - ieeexplore.ieee.org
Scenario-based approaches have been receiving a huge amount of attention in research
and engineering of automated driving systems. Due to the complexity and uncertainty of the …

Machine learning testing: Survey, landscapes and horizons

JM Zhang, M Harman, L Ma… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
This paper provides a comprehensive survey of techniques for testing machine learning
systems; Machine Learning Testing (ML testing) research. It covers 144 papers on testing …

Software engineering for AI-based systems: a survey

S Martínez-Fernández, J Bogner, X Franch… - ACM Transactions on …, 2022 - dl.acm.org
AI-based systems are software systems with functionalities enabled by at least one AI
component (eg, for image-, speech-recognition, and autonomous driving). AI-based systems …

Av-fuzzer: Finding safety violations in autonomous driving systems

G Li, Y Li, S Jha, T Tsai, M Sullivan… - 2020 IEEE 31st …, 2020 - ieeexplore.ieee.org
This paper proposes AV-FUZZER, a testing framework, to find the safety violations of an
autonomous vehicle (AV) in the presence of an evolving traffic environment. We perturb the …

Automatically testing self-driving cars with search-based procedural content generation

A Gambi, M Mueller, G Fraser - Proceedings of the 28th ACM SIGSOFT …, 2019 - dl.acm.org
Self-driving cars rely on software which needs to be thoroughly tested. Testing self-driving
car software in real traffic is not only expensive but also dangerous, and has already caused …

Model-based exploration of the frontier of behaviours for deep learning system testing

V Riccio, P Tonella - Proceedings of the 28th ACM Joint Meeting on …, 2020 - dl.acm.org
With the increasing adoption of Deep Learning (DL) for critical tasks, such as autonomous
driving, the evaluation of the quality of systems that rely on DL has become crucial. Once …

Misbehaviour prediction for autonomous driving systems

A Stocco, M Weiss, M Calzana, P Tonella - Proceedings of the ACM …, 2020 - dl.acm.org
Deep Neural Networks (DNNs) are the core component of modern autonomous driving
systems. To date, it is still unrealistic that a DNN will generalize correctly to all driving …

Efficient online testing for DNN-enabled systems using surrogate-assisted and many-objective optimization

FU Haq, D Shin, L Briand - … of the 44th international conference on …, 2022 - dl.acm.org
With the recent advances of Deep Neural Networks (DNNs) in real-world applications, such
as Automated Driving Systems (ADS) for self-driving cars, ensuring the reliability and safety …

Testing autonomous cars for feature interaction failures using many-objective search

RB Abdessalem, A Panichella, S Nejati… - Proceedings of the 33rd …, 2018 - dl.acm.org
Complex systems such as autonomous cars are typically built as a composition of features
that are independent units of functionality. Features tend to interact and impact one another's …