Understanding and Mitigating Flaky Software Test Cases

O Parry - 2023 - etheses.whiterose.ac.uk
A flaky test is a test case that can pass or fail without changes to the test case code or the
code under test. They are a wide-spread problem with serious consequences for developers …

A survey of flaky tests

O Parry, GM Kapfhammer, M Hilton… - ACM Transactions on …, 2021 - dl.acm.org
Tests that fail inconsistently, without changes to the code under test, are described as flaky.
Flaky tests do not give a clear indication of the presence of software bugs and thus limit the …

Flakiness Goes Live: Insights from Running Flaky Tests into the Field

M Barboni, A Bertolino, G De Angelis - Available at SSRN 4095579 - papers.ssrn.com
Test flakiness is a topmost concern in software test automation. While conducting pre-
deployment testing, those tests that are flagged as flaky are put aside for being either …

Surveying the developer experience of flaky tests

O Parry, GM Kapfhammer, M Hilton… - Proceedings of the 44th …, 2022 - dl.acm.org
Test cases that pass and fail without changes to the code under test are known as flaky. The
past decade has seen increasing research interest in flaky tests, though little attention has …

A Large-Scale Empirical Investigation into Cross-Project Flaky Test Prediction

A Afeltra, A Cannavale, F Pecorelli, V Pontillo… - IEEE …, 2024 - ieeexplore.ieee.org
Test flakiness arises when a test case exhibits inconsistent behavior by alternating between
passing and failing states when executed against the same code. Previous research …

What made this test flake? pinpointing classes responsible for test flakiness

S Habchi, G Haben, J Sohn, A Franci… - 2022 IEEE …, 2022 - ieeexplore.ieee.org
Flaky tests are defined as tests that manifest non-deterministic behaviour by passing and
failing intermittently for the same version of the code. These tests cripple continuous …

Flakime: laboratory-controlled test flakiness impact assessment

M Cordy, R Rwemalika, A Franci, M Papadakis… - Proceedings of the 44th …, 2022 - dl.acm.org
Much research on software testing makes an implicit assumption that test failures are
deterministic such that they always witness the presence of the same defects. However, this …

Understanding flaky tests: The developer's perspective

M Eck, F Palomba, M Castelluccio… - Proceedings of the 2019 …, 2019 - dl.acm.org
Flaky tests are software tests that exhibit a seemingly random outcome (pass or fail) despite
exercising unchanged code. In this work, we examine the perceptions of software …

[PDF][PDF] FlakiMe: Laboratory-controlled test flakiness impact assessment. A case study on mutation testing and automated program repair

M Cordy, M Papadakis, R Rwemalika, M Harman - 2019 - academia.edu
Much research on software testing makes an implicit assumption that test failures are
deterministic such that they always witness the presence of the same defects. However, this …

Toward static test flakiness prediction: A feasibility study

V Pontillo, F Palomba, F Ferrucci - … of the 5th International Workshop on …, 2021 - dl.acm.org
Flaky tests are tests that exhibit both a passing and failing behavior when run against the
same code. While the research community has attempted to define automated approaches …