Testing machine learning based systems: a systematic mapping

V Riccio, G Jahangirova, A Stocco… - Empirical Software …, 2020 - Springer
Abstract Context: A Machine Learning based System (MLS) is a software system including
one or more components that learn how to perform a task from a given data set. The …

Sampling in software engineering research: A critical review and guidelines

S Baltes, P Ralph - Empirical Software Engineering, 2022 - Springer
Representative sampling appears rare in empirical software engineering research. Not all
studies need representative samples, but a general lack of representative sampling …

Collaboration challenges in building ml-enabled systems: Communication, documentation, engineering, and process

N Nahar, S Zhou, G Lewis, C Kästner - Proceedings of the 44th …, 2022 - dl.acm.org
The introduction of machine learning (ML) components in software projects has created the
need for software engineers to collaborate with data scientists and other specialists. While …

A software engineering perspective on engineering machine learning systems: State of the art and challenges

G Giray - Journal of Systems and Software, 2021 - Elsevier
Context: Advancements in machine learning (ML) lead to a shift from the traditional view of
software development, where algorithms are hard-coded by humans, to ML systems …

Bug characterization in machine learning-based systems

MM Morovati, A Nikanjam, F Tambon, F Khomh… - Empirical Software …, 2024 - Springer
The rapid growth of applying Machine Learning (ML) in different domains, especially in
safety-critical areas, increases the need for reliable ML components, ie, a software …

A comprehensive study of deep learning compiler bugs

Q Shen, H Ma, J Chen, Y Tian, SC Cheung… - Proceedings of the 29th …, 2021 - dl.acm.org
There are increasing uses of deep learning (DL) compilers to generate optimized code,
boosting the runtime performance of DL models on specific hardware. Like their traditional …

Mind the gap! A study on the transferability of virtual versus physical-world testing of autonomous driving systems

A Stocco, B Pulfer, P Tonella - IEEE Transactions on Software …, 2022 - ieeexplore.ieee.org
Safe deployment of self-driving cars (SDC) necessitates thorough simulated and in-field
testing. Most testing techniques consider virtualized SDCs within a simulation environment …

Deepcrime: mutation testing of deep learning systems based on real faults

N Humbatova, G Jahangirova, P Tonella - Proceedings of the 30th ACM …, 2021 - dl.acm.org
Deep Learning (DL) solutions are increasingly adopted, but how to test them remains a
major open research problem. Existing and new testing techniques have been proposed for …

Rise of the planet of serverless computing: A systematic review

J Wen, Z Chen, X Jin, X Liu - ACM Transactions on Software …, 2023 - dl.acm.org
Serverless computing is an emerging cloud computing paradigm, being adopted to develop
a wide range of software applications. It allows developers to focus on the application logic …

A systematic literature review on the use of deep learning in software engineering research

C Watson, N Cooper, DN Palacio, K Moran… - ACM Transactions on …, 2022 - dl.acm.org
An increasingly popular set of techniques adopted by software engineering (SE)
researchers to automate development tasks are those rooted in the concept of Deep …