Software testing of generative ai systems: Challenges and opportunities

A Aleti - 2023 IEEE/ACM International Conference on Software …, 2023 - ieeexplore.ieee.org
Software Testing is a well-established area in software engineering, encompassing various
techniques and methodologies to ensure the quality of software systems. However, with the …

From Collision to Verdict: Responsibility Attribution for Autonomous Driving Systems Testing

J Zhou, S Tang, Y Guo, YF Li… - 2023 IEEE 34th …, 2023 - ieeexplore.ieee.org
Autonomous driving systems (ADS) are safety-critical systems that require thorough testing
to ensure their safety. Current testing methods for ADS primarily focus on finding crash …

Towards reliable ai: Adequacy metrics for ensuring the quality of system-level testing of autonomous vehicles

N Neelofar, A Aleti - Proceedings of the 46th IEEE/ACM International …, 2024 - dl.acm.org
AI-powered systems have gained widespread popularity in various domains, including
Autonomous Vehicles (AVs). However, ensuring their reliability and safety is challenging …

Tree-based scenario classification: a formal framework for coverage analysis on test drives of autonomous vehicles

T Schallau, S Naujokat, F Kullmann… - arXiv preprint arXiv …, 2023 - arxiv.org
Scenario-based testing is envisioned as a key approach for the safety assurance of
autonomous vehicles. In scenario-based testing, relevant (driving) scenarios are the basis of …

Feature-sensitive coverage for conformance testing of programming language implementations

J Park, D Youn, K Lee, S Ryu - … of the ACM on Programming Languages, 2023 - dl.acm.org
The conformance testing of programming language implementations is crucial to support
correct and consistent execution environments. Because manually maintaining conformance …

Test case generation for drivability requirements of an automotive cruise controller: An experience with an industrial simulator

F Formica, N Petrunti, L Bruck, V Pantelic… - Proceedings of the 31st …, 2023 - dl.acm.org
Automotive software development requires engineers to test their systems to detect
violations of both functional and drivability requirements. Functional requirements define the …

Bayesian Fault Injection Safety Testing for Highly Automated Vehicles with Uncertainty

Y Mei, T Nie, J Sun, Y Tian - IEEE Transactions on Intelligent …, 2024 - ieeexplore.ieee.org
Highly Automated Vehicles (HAVs) are exposed to numerous unexpected faults that
threaten the functionality of the Autonomous Driving System (ADS) in HAVs, and even minor …

Validating behavioral requirements, conditions, and rules of autonomous systems with scenario-based testing

T Schallau, S Naujokat - Electronic Communications of the EASST, 2023 - eceasst.org
Assuring the safety of autonomous vehicles is more and more approached by using
scenario-based testing. Relevant driving situations are utilized here to fuel the argument that …

Industry Practices for Challenging Autonomous Driving Systems with Critical Scenarios

Q Song, E Engström, P Runeson - ACM Transactions on Software …, 2024 - dl.acm.org
Testing autonomous driving systems for safety and reliability is essential, yet complex. A
primary challenge is identifying relevant test scenarios, especially the critical ones that may …

Reality Bites: Assessing the Realism of Driving Scenarios with Large Language Models

J Wu, C Lu, A Arrieta, T Yue, S Ali - Proceedings of the 2024 IEEE/ACM …, 2024 - dl.acm.org
Large Language Models (LLMs) are demonstrating outstanding potential for tasks such as
text generation, summarization, and classification. Given that such models are trained on a …