What, indeed, is an achievable provable guarantee for learning-enabled safety-critical systems

S Bensalem, CH Cheng, W Huang, X Huang… - … Conference on Bridging …, 2023 - Springer
Abstract Machine learning has made remarkable advancements, but confidently utilising
learning-enabled components in safety-critical domains still poses challenges. Among the …

Deceiving humans and machines alike: Search-based test input generation for dnns using variational autoencoders

S Kang, R Feldt, S Yoo - ACM Transactions on Software Engineering …, 2024 - dl.acm.org
Due to the rapid adoption of Deep Neural Networks (DNNs) into larger software systems,
testing of DNN-based systems has received much attention recently. While many different …

Hierarchical distribution-aware testing of deep learning

W Huang, X Zhao, A Banks, V Cox… - ACM Transactions on …, 2023 - dl.acm.org
With its growing use in safety/security-critical applications, Deep Learning (DL) has raised
increasing concerns regarding its dependability. In particular, DL has a notorious problem of …

Black-box testing of deep neural networks

T Byun, S Rayadurgam… - 2021 IEEE 32nd …, 2021 - ieeexplore.ieee.org
Several test adequacy criteria have been developed for quantifying the the coverage of
deep neural networks (DNNs) achieved by a test suite. Being dependent on the structure of …

Distribution models for falsification and verification of dnns

F Toledo, D Shriver, S Elbaum… - 2021 36th IEEE/ACM …, 2021 - ieeexplore.ieee.org
DNN validation and verification approaches that are input distribution agnostic waste effort
on irrelevant inputs and report false property violations. Drawing on the large body of work …

Unintended behavior in learning-enabled systems: Detecting the unknown unknowns

D Cofer - 2021 IEEE/AIAA 40th Digital Avionics Systems …, 2021 - ieeexplore.ieee.org
One of the important certification objectives for airborne software is demonstrating the
absence of unintended behavior. In current software development processes, unintended …

Test Selection for Deep Neural Networks using Meta-Models with Uncertainty Metrics

D Demir, A Betin Can, E Surer - Proceedings of the 33rd ACM SIGSOFT …, 2024 - dl.acm.org
With the use of Deep Learning (DL) in safety-critical domains, the systematic testing of these
systems has become a critical issue for human life. Due to the data-driven nature of Deep …

Distribution Aware Testing Framework for Deep Neural Networks

D Demir, AB Can, E Surer - IEEE Access, 2023 - ieeexplore.ieee.org
The increasing use of deep learning (DL) in safety-critical applications highlights the critical
need for systematic and effective testing to ensure system reliability and quality. In this …

CIT4DNN: Generating Diverse and Rare Inputs for Neural Networks Using Latent Space Combinatorial Testing

S Dola, R McDaniel, MB Dwyer, ML Soffa - Proceedings of the IEEE …, 2024 - dl.acm.org
Deep neural networks (DNN) are being used in a wide range of applications including safety-
critical systems. Several DNN test generation approaches have been proposed to generate …

Provably valid and diverse mutations of real-world media data for dnn testing

Y Yuan, Q Pang, S Wang - IEEE Transactions on Software …, 2024 - ieeexplore.ieee.org
Deep neural networks (DNNs) often accept high-dimensional media data (eg, photos, text,
and audio) and understand their perceptual content (eg, a cat). To test DNNs, diverse inputs …