Testing machine learning based systems: a systematic mapping

V Riccio, G Jahangirova, A Stocco… - Empirical Software …, 2020 - Springer
Abstract Context: A Machine Learning based System (MLS) is a software system including
one or more components that learn how to perform a task from a given data set. The …

Verification and validation methods for decision-making and planning of automated vehicles: A review

Y Ma, C Sun, J Chen, D Cao… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Verification and validation (V&V) hold a significant position in the research and development
of automated vehicles (AVs). Current literature indicates that different V&V techniques have …

Machine learning testing: Survey, landscapes and horizons

JM Zhang, M Harman, L Ma… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
This paper provides a comprehensive survey of techniques for testing machine learning
systems; Machine Learning Testing (ML testing) research. It covers 144 papers on testing …

Model-based exploration of the frontier of behaviours for deep learning system testing

V Riccio, P Tonella - Proceedings of the 28th ACM Joint Meeting on …, 2020 - dl.acm.org
With the increasing adoption of Deep Learning (DL) for critical tasks, such as autonomous
driving, the evaluation of the quality of systems that rely on DL has become crucial. Once …

Misbehaviour prediction for autonomous driving systems

A Stocco, M Weiss, M Calzana, P Tonella - Proceedings of the ACM …, 2020 - dl.acm.org
Deep Neural Networks (DNNs) are the core component of modern autonomous driving
systems. To date, it is still unrealistic that a DNN will generalize correctly to all driving …

Efficient online testing for DNN-enabled systems using surrogate-assisted and many-objective optimization

FU Haq, D Shin, L Briand - … of the 44th international conference on …, 2022 - dl.acm.org
With the recent advances of Deep Neural Networks (DNNs) in real-world applications, such
as Automated Driving Systems (ADS) for self-driving cars, ensuring the reliability and safety …

Software verification and validation of safe autonomous cars: A systematic literature review

N Rajabli, F Flammini, R Nardone, V Vittorini - IEEE Access, 2020 - ieeexplore.ieee.org
Autonomous, or self-driving, cars are emerging as the solution to several problems primarily
caused by humans on roads, such as accidents and traffic congestion. However, those …

A survey on automated driving system testing: Landscapes and trends

S Tang, Z Zhang, Y Zhang, J Zhou, Y Guo… - ACM Transactions on …, 2023 - dl.acm.org
Automated Driving Systems (ADS) have made great achievements in recent years thanks to
the efforts from both academia and industry. A typical ADS is composed of multiple modules …

Safebench: A benchmarking platform for safety evaluation of autonomous vehicles

C Xu, W Ding, W Lyu, Z Liu, S Wang… - Advances in …, 2022 - proceedings.neurips.cc
As shown by recent studies, machine intelligence-enabled systems are vulnerable to test
cases resulting from either adversarial manipulation or natural distribution shifts. This has …

A survey on scenario-based testing for automated driving systems in high-fidelity simulation

Z Zhong, Y Tang, Y Zhou, VO Neves, Y Liu… - arXiv preprint arXiv …, 2021 - arxiv.org
Automated Driving Systems (ADSs) have seen rapid progress in recent years. To ensure the
safety and reliability of these systems, extensive testings are being conducted before their …