Practical flaky test prediction using common code evolution and test history data

M Gruber, M Heine, N Oster… - … IEEE Conference on …, 2023 - ieeexplore.ieee.org
Non-deterministically behaving test cases cause developers to lose trust in their regression
test suites and to eventually ignore failures. Detecting flaky tests is therefore a crucial task in …

Static test flakiness prediction

V Pontillo - Proceedings of the ACM/IEEE 44th International …, 2022 - dl.acm.org
The problem of flakiness occurs when a test case is non-deterministic and exhibits both a
passing and failing behavior when run against the same code. Over the last years, the …

A survey on how test flakiness affects developers and what support they need to address it

M Gruber, G Fraser - 2022 IEEE Conference on Software …, 2022 - ieeexplore.ieee.org
Non-deterministically passing and failing test cases, so-called flaky tests, have recently
become a focus area of software engineering research. While this research focus has been …

Toward static test flakiness prediction: A feasibility study

V Pontillo, F Palomba, F Ferrucci - … of the 5th International Workshop on …, 2021 - dl.acm.org
Flaky tests are tests that exhibit both a passing and failing behavior when run against the
same code. While the research community has attempted to define automated approaches …

Peeler: Learning to effectively predict flakiness without running tests

Y Qin, S Wang, K Liu, B Lin, H Wu, L Li… - 2022 IEEE …, 2022 - ieeexplore.ieee.org
Regression testing is a widely adopted approach to expose change-induced bugs as well as
to verify the correctness/robustness of code in modern software development settings …

Static test flakiness prediction: How far can we go?

V Pontillo, F Palomba, F Ferrucci - Empirical Software Engineering, 2022 - Springer
Test flakiness is a phenomenon occurring when a test case is non-deterministic and exhibits
both a passing and failing behavior when run against the same code. Over the last years …

A qualitative study on the sources, impacts, and mitigation strategies of flaky tests

S Habchi, G Haben, M Papadakis… - … IEEE Conference on …, 2022 - ieeexplore.ieee.org
Test flakiness forms a major testing concern. Flaky tests manifest non-deterministic
outcomes that cripple continu-ous integration and lead developers to investigate false alerts …

A Large-Scale Empirical Investigation into Cross-Project Flaky Test Prediction

A Afeltra, A Cannavale, F Pecorelli, V Pontillo… - IEEE …, 2024 - ieeexplore.ieee.org
Test flakiness arises when a test case exhibits inconsistent behavior by alternating between
passing and failing states when executed against the same code. Previous research …

Evaluating features for machine learning detection of order-and non-order-dependent flaky tests

O Parry, GM Kapfhammer, M Hilton… - 2022 IEEE Conference …, 2022 - ieeexplore.ieee.org
Flaky tests are test cases that can pass or fail without code changes. They often waste the
time of software developers and obstruct the use of continuous integration. Previous work …

The importance of discerning flaky from fault-triggering test failures: A case study on the chromium ci

G Haben, S Habchi, M Papadakis, M Cordy… - arXiv preprint arXiv …, 2023 - arxiv.org
Flaky tests are tests that pass and fail on different executions of the same version of a
program under test. They waste valuable developer time by making developers investigate …