Unsolved problems in ml safety

D Hendrycks, N Carlini, J Schulman… - arXiv preprint arXiv …, 2021 - arxiv.org
Machine learning (ML) systems are rapidly increasing in size, are acquiring new
capabilities, and are increasingly deployed in high-stakes settings. As with other powerful …

Taxonomy of machine learning safety: A survey and primer

S Mohseni, H Wang, C Xiao, Z Yu, Z Wang… - ACM Computing …, 2022 - dl.acm.org
The open-world deployment of Machine Learning (ML) algorithms in safety-critical
applications such as autonomous vehicles needs to address a variety of ML vulnerabilities …

Guidance on the assurance of machine learning in autonomous systems (AMLAS)

R Hawkins, C Paterson, C Picardi, Y Jia… - arXiv preprint arXiv …, 2021 - arxiv.org
Machine Learning (ML) is now used in a range of systems with results that are reported to
exceed, under certain conditions, human performance. Many of these systems, in domains …

On the safety of machine learning: Cyber-physical systems, decision sciences, and data products

KR Varshney, H Alemzadeh - Big data, 2017 - liebertpub.com
Abstract Machine learning algorithms increasingly influence our decisions and interact with
us in all parts of our daily lives. Therefore, just as we consider the safety of power plants …

A marauder's map of security and privacy in machine learning

N Papernot - arXiv preprint arXiv:1811.01134, 2018 - arxiv.org
There is growing recognition that machine learning (ML) exposes new security and privacy
vulnerabilities in software systems, yet the technical community's understanding of the …

Assuring the machine learning lifecycle: Desiderata, methods, and challenges

R Ashmore, R Calinescu, C Paterson - ACM Computing Surveys (CSUR), 2021 - dl.acm.org
Machine learning has evolved into an enabling technology for a wide range of highly
successful applications. The potential for this success to continue and accelerate has placed …

Robust machine learning systems: Challenges, current trends, perspectives, and the road ahead

M Shafique, M Naseer, T Theocharides… - IEEE Design & …, 2020 - ieeexplore.ieee.org
Currently, machine learning (ML) techniques are at the heart of smart cyber-physical
systems (CPSs) and Internet-of-Things (loT). This article discusses various challenges and …

Concrete problems in AI safety

D Amodei, C Olah, J Steinhardt, P Christiano… - arXiv preprint arXiv …, 2016 - arxiv.org
Rapid progress in machine learning and artificial intelligence (AI) has brought increasing
attention to the potential impacts of AI technologies on society. In this paper we discuss one …

Towards the science of security and privacy in machine learning

N Papernot, P McDaniel, A Sinha… - arXiv preprint arXiv …, 2016 - arxiv.org
Advances in machine learning (ML) in recent years have enabled a dizzying array of
applications such as data analytics, autonomous systems, and security diagnostics. ML is …

How to certify machine learning based safety-critical systems? A systematic literature review

F Tambon, G Laberge, L An, A Nikanjam… - Automated Software …, 2022 - Springer
Abstract Context Machine Learning (ML) has been at the heart of many innovations over the
past years. However, including it in so-called “safety-critical” systems such as automotive or …