A survey of flaky tests
O Parry, GM Kapfhammer, M Hilton… - ACM Transactions on …, 2021 - dl.acm.org
Tests that fail inconsistently, without changes to the code under test, are described as flaky.
Flaky tests do not give a clear indication of the presence of software bugs and thus limit the …
Flaky tests do not give a clear indication of the presence of software bugs and thus limit the …
An empirical study of flaky tests in python
Tests that cause spurious failures without any code changes, ie, flaky tests, hamper
regression testing, increase maintenance costs, may shadow real bugs, and decrease trust …
regression testing, increase maintenance costs, may shadow real bugs, and decrease trust …
Flakify: A black-box, language model-based predictor for flaky tests
Software testing assures that code changes do not adversely affect existing functionality.
However, a test case can be flaky, ie, passing and failing across executions, even for the …
However, a test case can be flaky, ie, passing and failing across executions, even for the …
Research progress of flaky tests
A flaky test is a test that both passes and fails periodically without any code changes, and its
uncontrolled uncertainty will destroy the value of the test suites and even cause developers …
uncontrolled uncertainty will destroy the value of the test suites and even cause developers …
A survey on how test flakiness affects developers and what support they need to address it
Non-deterministically passing and failing test cases, so-called flaky tests, have recently
become a focus area of software engineering research. While this research focus has been …
become a focus area of software engineering research. While this research focus has been …
Know you neighbor: Fast static prediction of test flakiness
Context: Flaky tests plague regression testing in Continuous Integration environments by
slowing down change releases and wasting testing time and effort. Despite the growing …
slowing down change releases and wasting testing time and effort. Despite the growing …
Continuous integration and delivery practices for cyber-physical systems: An interview-based study
Continuous Integration and Delivery (CI/CD) practices have shown several benefits for
software development and operations, such as faster release cycles and early discovery of …
software development and operations, such as faster release cycles and early discovery of …
A co-evolutionary genetic algorithms approach to detect video game bugs
A Albaghajati, M Ahmed - Journal of Systems and Software, 2022 - Elsevier
Video games systems are known for their complexity, concurrency and non-determinism,
which makes them prone to challenging tacit bugs. Video games development is costly and …
which makes them prone to challenging tacit bugs. Video games development is costly and …
Predicting flaky tests categories using few-shot learning
Flaky tests are tests that yield different outcomes when run on the same version of a
program. This non-deterministic behaviour plagues continuous integration with false signals …
program. This non-deterministic behaviour plagues continuous integration with false signals …
FlakyCat: Predicting flaky tests categories using few-shot learning
Flaky tests are tests that yield different outcomes when run on the same version of a
program. This non-deterministic behaviour plagues continuous integration with false signals …
program. This non-deterministic behaviour plagues continuous integration with false signals …