Machine learning testing: Survey, landscapes and horizons

JM Zhang, M Harman, L Ma… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
This paper provides a comprehensive survey of techniques for testing machine learning
systems; Machine Learning Testing (ML testing) research. It covers 144 papers on testing …

What are people doing about XAI user experience? A survey on AI explainability research and practice

JJ Ferreira, MS Monteiro - Design, User Experience, and Usability. Design …, 2020 - Springer
Explainability is a hot topic nowadays for artificial intelligent (AI) systems. The role of
machine learning (ML) models on influencing human decisions shed light on the back-box …

Data management for machine learning: A survey

C Chai, J Wang, Y Luo, Z Niu… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Machine learning (ML) has widespread applications and has revolutionized many
industries, but suffers from several challenges. First, sufficient high-quality training data is …

Autoablation: Automated parallel ablation studies for deep learning

S Sheikholeslami, M Meister, T Wang… - Proceedings of the 1st …, 2021 - dl.acm.org
Ablation studies provide insights into the relative contribution of different architectural and
regularization components to machine learning models' performance. In this paper, we …

Complaint-driven training data debugging for query 2.0

W Wu, L Flokas, E Wu, J Wang - Proceedings of the 2020 ACM SIGMOD …, 2020 - dl.acm.org
As the need for machine learning (ML) increases rapidly across all industry sectors, there is
a significant interest among commercial database providers to support" Query 2.0", which …

How much is the black box? The value of explainability in machine learning models

J Wanner, LV Herm, C Janiesch - 2020 - aisel.aisnet.org
Abstract Machine learning enables computers to learn from data and fuels artificial
intelligence systems with capabilities to make even super-human decisions. Yet, despite …

How a minimal learning agent can infer the existence of unobserved variables in a complex environment

B Eva, K Ried, T Müller, HJ Briegel - Minds and Machines, 2023 - Springer
According to a mainstream position in contemporary cognitive science and philosophy, the
use of abstract compositional concepts is amongst the most characteristic indicators of …

Quantitative evaluations on saliency methods: An experimental study

XH Li, Y Shi, H Li, W Bai, Y Song, CC Cao… - arXiv preprint arXiv …, 2020 - arxiv.org
It has been long debated that eXplainable AI (XAI) is an important topic, but it lacks rigorous
definition and fair metrics. In this paper, we briefly summarize the status quo of the metrics …

MaskSearch: Querying Image Masks at Scale

D He, J Zhang, M Daum, A Ratner… - arXiv preprint arXiv …, 2023 - arxiv.org
Machine learning tasks over image databases often generate masks that annotate image
content (eg, saliency maps, segmentation maps, depth maps) and enable a variety of …

Deep learning: Systems and responsibility

A Wasay, S Chatterjee, S Idreos - Proceedings of the 2021 International …, 2021 - dl.acm.org
Deep learning enables numerous applications across diverse areas. Data systems
researchers are also increasingly experimenting with deep learning to enhance data …