Testing machine learning based systems: a systematic mapping

V Riccio, G Jahangirova, A Stocco… - Empirical Software …, 2020 - Springer
Abstract Context: A Machine Learning based System (MLS) is a software system including
one or more components that learn how to perform a task from a given data set. The …

Assuring the machine learning lifecycle: Desiderata, methods, and challenges

R Ashmore, R Calinescu, C Paterson - ACM Computing Surveys (CSUR), 2021 - dl.acm.org
Machine learning has evolved into an enabling technology for a wide range of highly
successful applications. The potential for this success to continue and accelerate has placed …

Machine learning testing: Survey, landscapes and horizons

JM Zhang, M Harman, L Ma… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
This paper provides a comprehensive survey of techniques for testing machine learning
systems; Machine Learning Testing (ML testing) research. It covers 144 papers on testing …

Deephunter: a coverage-guided fuzz testing framework for deep neural networks

X Xie, L Ma, F Juefei-Xu, M Xue, H Chen, Y Liu… - Proceedings of the 28th …, 2019 - dl.acm.org
The past decade has seen the great potential of applying deep neural network (DNN) based
software to safety-critical scenarios, such as autonomous driving. Similar to traditional …

Fakespotter: A simple yet robust baseline for spotting ai-synthesized fake faces

R Wang, F Juefei-Xu, L Ma, X Xie, Y Huang… - arXiv preprint arXiv …, 2019 - arxiv.org
In recent years, generative adversarial networks (GANs) and its variants have achieved
unprecedented success in image synthesis. They are widely adopted in synthesizing facial …

A software engineering perspective on engineering machine learning systems: State of the art and challenges

G Giray - Journal of Systems and Software, 2021 - Elsevier
Context: Advancements in machine learning (ML) lead to a shift from the traditional view of
software development, where algorithms are hard-coded by humans, to ML systems …

Deeprhythm: Exposing deepfakes with attentional visual heartbeat rhythms

H Qi, Q Guo, F Juefei-Xu, X Xie, L Ma, W Feng… - Proceedings of the 28th …, 2020 - dl.acm.org
As the GAN-based face image and video generation techniques, widely known as
DeepFakes, have become more and more matured and realistic, there comes a pressing …

Deepstellar: Model-based quantitative analysis of stateful deep learning systems

X Du, X Xie, Y Li, L Ma, Y Liu, J Zhao - … of the 2019 27th ACM Joint …, 2019 - dl.acm.org
Deep Learning (DL) has achieved tremendous success in many cutting-edge applications.
However, the state-of-the-art DL systems still suffer from quality issues. While some recent …

An empirical study of common challenges in developing deep learning applications

T Zhang, C Gao, L Ma, M Lyu… - 2019 IEEE 30th …, 2019 - ieeexplore.ieee.org
Recent advances in deep learning promote the innovation of many intelligent systems and
applications such as autonomous driving and image recognition. Despite enormous efforts …

Efficientderain: Learning pixel-wise dilation filtering for high-efficiency single-image deraining

Q Guo, J Sun, F Juefei-Xu, L Ma, X Xie… - Proceedings of the …, 2021 - ojs.aaai.org
Single-image deraining is rather challenging due to the unknown rain model. Existing
methods often make specific assumptions of the rain model, which can hardly cover many …