A survey of safety and trustworthiness of deep neural networks: Verification, testing, adversarial attack and defence, and interpretability

X Huang, D Kroening, W Ruan, J Sharp, Y Sun… - Computer Science …, 2020 - Elsevier
In the past few years, significant progress has been made on deep neural networks (DNNs)
in achieving human-level performance on several long-standing tasks. With the broader …

[HTML][HTML] Testing machine learning based systems: a systematic mapping

V Riccio, G Jahangirova, A Stocco… - Empirical Software …, 2020 - Springer
Abstract Context: A Machine Learning based System (MLS) is a software system including
one or more components that learn how to perform a task from a given data set. The …

Machine learning testing: Survey, landscapes and horizons

JM Zhang, M Harman, L Ma… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
This paper provides a comprehensive survey of techniques for testing machine learning
systems; Machine Learning Testing (ML testing) research. It covers 144 papers on testing …

Software engineering for AI-based systems: a survey

S Martínez-Fernández, J Bogner, X Franch… - ACM Transactions on …, 2022 - dl.acm.org
AI-based systems are software systems with functionalities enabled by at least one AI
component (eg, for image-, speech-recognition, and autonomous driving). AI-based systems …

Bias in machine learning software: Why? how? what to do?

J Chakraborty, S Majumder, T Menzies - … of the 29th ACM joint meeting …, 2021 - dl.acm.org
Increasingly, software is making autonomous decisions in case of criminal sentencing,
approving credit cards, hiring employees, and so on. Some of these decisions show bias …

A software engineering perspective on engineering machine learning systems: State of the art and challenges

G Giray - Journal of Systems and Software, 2021 - Elsevier
Context: Advancements in machine learning (ML) lead to a shift from the traditional view of
software development, where algorithms are hard-coded by humans, to ML systems …

Testing deep neural networks

Y Sun, X Huang, D Kroening, J Sharp, M Hill… - arXiv preprint arXiv …, 2018 - arxiv.org
Deep neural networks (DNNs) have a wide range of applications, and software employing
them must be thoroughly tested, especially in safety-critical domains. However, traditional …

Black box fairness testing of machine learning models

A Aggarwal, P Lohia, S Nagar, K Dey… - … of the 2019 27th ACM joint …, 2019 - dl.acm.org
Any given AI system cannot be accepted unless its trustworthiness is proven. An important
characteristic of a trustworthy AI system is the absence of algorithmic bias.'Individual …

Fair preprocessing: towards understanding compositional fairness of data transformers in machine learning pipeline

S Biswas, H Rajan - Proceedings of the 29th ACM Joint Meeting on …, 2021 - dl.acm.org
In recent years, many incidents have been reported where machine learning models
exhibited discrimination among people based on race, sex, age, etc. Research has been …

Generate your counterfactuals: Towards controlled counterfactual generation for text

N Madaan, I Padhi, N Panwar, D Saha - Proceedings of the AAAI …, 2021 - ojs.aaai.org
Abstract Machine Learning has seen tremendous growth recently, which has led to a larger
adaptation of ML systems for educational assessments, credit risk, healthcare, employment …