Model assertions for monitoring and improving ML models

D Kang, D Raghavan, P Bailis… - … of Machine Learning …, 2020 - proceedings.mlsys.org
Abstract Machine learning models are increasingly deployed in mission-critical settings such
as vehicles, but unfortunately, these models can fail in complex ways. To prevent errors, ML …

Automated testing of software that uses machine learning apis

C Wan, S Liu, S Xie, Y Liu, H Hoffmann… - Proceedings of the 44th …, 2022 - dl.acm.org
An increasing number of software applications incorporate machine learning (ML) solutions
for cognitive tasks that statistically mimic human behaviors. To test such software …

Distribution-aware testing of neural networks using generative models

S Dola, MB Dwyer, ML Soffa - 2021 IEEE/ACM 43rd …, 2021 - ieeexplore.ieee.org
The reliability of software that has a Deep Neural Network (DNN) as a component is urgently
important today given the increasing number of critical applications being deployed with …

Differential Testing of Cross Deep Learning Framework {APIs}: Revealing Inconsistencies and Vulnerabilities

Z Deng, G Meng, K Chen, T Liu, L Xiang… - 32nd USENIX Security …, 2023 - usenix.org
With the increasing adoption of deep learning (DL) in various applications, developers often
reuse models by, for example, performing model conversion among frameworks to raise …

Input prioritization for testing neural networks

T Byun, V Sharma, A Vijayakumar… - 2019 IEEE …, 2019 - ieeexplore.ieee.org
Deep neural networks (DNNs) are increasingly being adopted for sensing and control
functions in a variety of safety and mission-critical systems such as self-driving cars …

[HTML][HTML] Addressing uncertainty in the safety assurance of machine-learning

S Burton, B Herd - Frontiers in Computer Science, 2023 - frontiersin.org
There is increasing interest in the application of machine learning (ML) technologies to
safety-critical cyber-physical systems, with the promise of increased levels of autonomy due …

Testing dnn-based autonomous driving systems under critical environmental conditions

Z Li, M Pan, T Zhang, X Li - International Conference on …, 2021 - proceedings.mlr.press
Due to the increasing usage of Deep Neural Network (DNN) based autonomous driving
systems (ADS) where erroneous or unexpected behaviours can lead to catastrophic …

Deepfault: Fault localization for deep neural networks

HF Eniser, S Gerasimou, A Sen - International Conference on …, 2019 - Springer
Abstract Deep Neural Networks (DNNs) are increasingly deployed in safety-critical
applications including autonomous vehicles and medical diagnostics. To reduce the …

Are machine learning cloud apis used correctly?

C Wan, S Liu, H Hoffmann, M Maire… - 2021 IEEE/ACM 43rd …, 2021 - ieeexplore.ieee.org
Machine learning (ML) cloud APIs enable developers to easily incorporate learning
solutions into software systems. Unfortunately, ML APIs are challenging to use correctly and …

Qatest: A uniform fuzzing framework for question answering systems

Z Liu, Y Feng, Y Yin, J Sun, Z Chen, B Xu - Proceedings of the 37th IEEE …, 2022 - dl.acm.org
The tremendous advancements in deep learning techniques have empowered question
answering (QA) systems with the capability of dealing with various tasks. Many commercial …