Know you neighbor: Fast static prediction of test flakiness

R Verdecchia, E Cruciani, B Miranda… - IEEE Access, 2021 - ieeexplore.ieee.org
Context: Flaky tests plague regression testing in Continuous Integration environments by
slowing down change releases and wasting testing time and effort. Despite the growing …

The importance of discerning flaky from fault-triggering test failures: a case study on the Chromium CI

G Haben, S Habchi, M Papadakis, M Cordy… - arXiv preprint arXiv …, 2023 - arxiv.org
Flaky tests are tests that pass and fail on different executions of the same version of a
program under test. They waste valuable developer time by making developers investigate …

Peeler: Learning to effectively predict flakiness without running tests

Y Qin, S Wang, K Liu, B Lin, H Wu, L Li… - 2022 IEEE …, 2022 - ieeexplore.ieee.org
Regression testing is a widely adopted approach to expose change-induced bugs as well as
to verify the correctness/robustness of code in modern software development settings …

A qualitative study on the sources, impacts, and mitigation strategies of flaky tests

S Habchi, G Haben, M Papadakis… - … IEEE Conference on …, 2022 - ieeexplore.ieee.org
Test flakiness forms a major testing concern. Flaky tests manifest non-deterministic
outcomes that cripple continu-ous integration and lead developers to investigate false alerts …

[HTML][HTML] Static test flakiness prediction: How far can we go?

V Pontillo, F Palomba, F Ferrucci - Empirical Software Engineering, 2022 - Springer
Test flakiness is a phenomenon occurring when a test case is non-deterministic and exhibits
both a passing and failing behavior when run against the same code. Over the last years …

iDFlakies: A framework for detecting and partially classifying flaky tests

W Lam, R Oei, A Shi, D Marinov… - 2019 12th ieee …, 2019 - ieeexplore.ieee.org
Regression testing is increasingly important with the wide use of continuous integration. A
desirable requirement for regression testing is that a test failure reliably indicates a problem …

Research progress of flaky tests

W Zheng, G Liu, M Zhang, X Chen… - 2021 IEEE International …, 2021 - ieeexplore.ieee.org
A flaky test is a test that both passes and fails periodically without any code changes, and its
uncontrolled uncertainty will destroy the value of the test suites and even cause developers …

What is the vocabulary of flaky tests? an extended replication

BHP Camara, MAG Silva, AT Endo… - 2021 IEEE/ACM 29th …, 2021 - ieeexplore.ieee.org
Software systems have been continuously evolved and delivered with high quality due to the
widespread adoption of automated tests. A recurring issue hurting this scenario is the …

Root causing, detecting, and fixing flaky tests: State of the art and future roadmap

B Zolfaghari, RM Parizi, G Srivastava… - Software: Practice …, 2021 - Wiley Online Library
A flaky test is a test that may lead to different results in different runs on a single code under
test without any change in the test code. Test flakiness is a noxious phenomenon that slows …

Evaluating features for machine learning detection of order-and non-order-dependent flaky tests

O Parry, GM Kapfhammer, M Hilton… - 2022 IEEE Conference …, 2022 - ieeexplore.ieee.org
Flaky tests are test cases that can pass or fail without code changes. They often waste the
time of software developers and obstruct the use of continuous integration. Previous work …