Much research on software testing makes an implicit assumption that test failures are
deterministic such that they always witness the presence of the same defects. However, this …

Much research on software testing makes an implicit assumption that test failures are
deterministic such that they always witness the presence of the same defects. However, this …

Software developers often rely on regression testing to ensure that recent changes made to
the source code do not introduce bugs. Flaky tests, which non-deterministically pass or fail …

Tests that fail inconsistently, without changes to the code under test, are described as flaky.
Flaky tests do not give a clear indication of the presence of software bugs and thus limit the …

Flaky tests are software tests that exhibit a seemingly random outcome (pass or fail) despite
exercising unchanged code. In this work, we examine the perceptions of software …

Regression testing is the activity performed by developers to check whether new
modifications have not introduced bugs. A crucial requirement to make regression testing …

Test cases that pass and fail without changes to the code under test are known as flaky. The
past decade has seen increasing research interest in flaky tests, though little attention has …

Mutation testing is widely used in research as a metric for evaluating the quality of test
suites. Mutation testing runs the test suite on generated mutants (variants of the code under …

Flaky tests are defined as tests that manifest non-deterministic behaviour by passing and
failing intermittently for the same version of the code. These tests cripple continuous …

Test flakiness forms a major testing concern. Flaky tests manifest non-deterministic
outcomes that cripple continu-ous integration and lead developers to investigate false alerts …