Non-deterministically behaving test cases cause developers to lose trust in their regression
test suites and to eventually ignore failures. Detecting flaky tests is therefore a crucial task in …

Simulators are widely used to test Autonomous Driving Systems (ADS), but their potential
flakiness can lead to inconsistent test results. We investigate test flakiness in simulation …

Regression testing is an important part of the development process but suffers from the
presence of flaky tests. Flaky tests nondeterministically pass or fail when run on the same …

Abstract Spectrum-based Fault Localization (SFL) approaches aim to efficiently localize
faulty components from examining program behavior. This is done by collecting the …

We recently proposed inline tests for validating individual program statements; they allow
developers to provide test inputs, expected outputs, and test oracles immediately after a …

In continuous testing, developers execute automated test cases once or even several times
per day to ensure the quality of the integrated code. Although continuous testing helps …

Several strategies have supported test quality measurement and analysis. For example,
code coverage, a widely used one, enables verification of the test case to cover as many …

Misuse of cryptographic (crypto) APIs is a noteworthy cause of security vulnerabilities. For
this reason, static analyzers were recently proposed for detecting crypto API misuses. They …

A test fails and despite an investigation by a developer there is no fault found (NFF). Large
software systems are often released with known failing and flaky tests. In this work, we …

Flaky tests cause significant problems as they can interrupt automated build processes that
rely on all tests succeeding and undermine the trustworthiness of tests. Numerous causes of …