Root causing, detecting, and fixing flaky tests: State of the art and future roadmap

B Zolfaghari, RM Parizi, G Srivastava… - Software: Practice …, 2021 - Wiley Online Library
A flaky test is a test that may lead to different results in different runs on a single code under
test without any change in the test code. Test flakiness is a noxious phenomenon that slows …

Static test flakiness prediction: How far can we go?

V Pontillo, F Palomba, F Ferrucci - Empirical Software Engineering, 2022 - Springer
Test flakiness is a phenomenon occurring when a test case is non-deterministic and exhibits
both a passing and failing behavior when run against the same code. Over the last years …

Causality-guided adaptive interventional debugging

A Fariha, S Nath, A Meliou - Proceedings of the 2020 ACM SIGMOD …, 2020 - dl.acm.org
Runtime nondeterminism is a fact of life in modern database applications. Previous research
has shown that nondeterminism can cause applications to intermittently crash, become …

Software testing and android applications: a large-scale empirical study

F Pecorelli, G Catolino, F Ferrucci, A De Lucia… - Empirical Software …, 2022 - Springer
These days, over three billion users rely on mobile applications (aka apps) on a daily basis
to access high-speed connectivity and all kinds of services it enables, from social to …

SleepReplacer: a novel tool-based approach for replacing thread sleeps in selenium WebDriver test code

D Olianas, M Leotta, F Ricca - Software Quality Journal, 2022 - Springer
Assuring quality of web applications is fundamental, given their relevance in the today's
world. A possible way to reach this goal is through end-to-end (E2E) testing, an approach in …

Wait, wait. no, tell me. analyzing selenium configuration effects on test flakiness

K Presler-Marshall, E Horton… - 2019 IEEE/ACM 14th …, 2019 - ieeexplore.ieee.org
Flaky tests are a source of frustration and uncertainty for developers. In an educational
environment, flaky tests can create doubts related to software behavior and student grades …

Intermittently failing tests in the embedded systems domain

PE Strandberg, TJ Ostrand, EJ Weyuker… - Proceedings of the 29th …, 2020 - dl.acm.org
Software testing is sometimes plagued with intermittently failing tests and finding the root
causes of such failing tests is often difficult. This problem has been widely studied at the unit …

On the impact of flaky tests in automated program repair

Y Qin, S Wang, K Liu, X Mao… - 2021 IEEE International …, 2021 - ieeexplore.ieee.org
The literature of Automated Program Repair is largely dominated by approaches that
leverage test suites not only to expose bugs but also to validate the generated patches …

Predicting flaky tests categories using few-shot learning

A Akli, G Haben, S Habchi, M Papadakis… - arXiv preprint arXiv …, 2022 - arxiv.org
Flaky tests are tests that yield different outcomes when run on the same version of a
program. This non-deterministic behaviour plagues continuous integration with false signals …

Toward static test flakiness prediction: A feasibility study

V Pontillo, F Palomba, F Ferrucci - … of the 5th International Workshop on …, 2021 - dl.acm.org
Flaky tests are tests that exhibit both a passing and failing behavior when run against the
same code. While the research community has attempted to define automated approaches …