Root causing flaky tests in a large-scale industrial setting

W Lam, P Godefroid, S Nath, A Santhiar… - Proceedings of the 28th …, 2019 - dl.acm.org
In today's agile world, developers often rely on continuous integration pipelines to help build
and validate their changes by executing tests in an efficient manner. One of the significant …

A replication study on the usability of code vocabulary in predicting flaky tests

G Haben, S Habchi, M Papadakis… - 2021 IEEE/ACM 18th …, 2021 - ieeexplore.ieee.org
Industrial reports indicate that flaky tests are one of the primary concerns of software testing
mainly due to the false signals they provide. To deal with this issue, researchers have …

A large-scale longitudinal study of flaky tests

W Lam, S Winter, A Wei, T Xie, D Marinov… - Proceedings of the ACM …, 2020 - dl.acm.org
Flaky tests are tests that can non-deterministically pass or fail for the same code version.
These tests undermine regression testing efficiency, because developers cannot easily …

Transforming test suites into croissants

Y Chen, A Yildiz, D Marinov… - Proceedings of the 32nd …, 2023 - dl.acm.org
Software developers often rely on regression testing to ensure that recent changes made to
the source code do not introduce bugs. Flaky tests, which non-deterministically pass or fail …

RETRACTED ARTICLE: The smell of fear: on the relation between test smells and flaky tests

F Palomba, A Zaidman - Empirical Software Engineering, 2019 - Springer
Regression testing is the activity performed by developers to check whether new
modifications have not introduced bugs. A crucial requirement to make regression testing …

What we talk about when we talk about software test flakiness

M Barboni, A Bertolino, G De Angelis - … on the Quality of Information and …, 2021 - Springer
Software test flakiness is drawing increasing interest among both academic researchers and
practitioners. In this work we report our findings from a scoping review of white and grey …

Wait, wait. no, tell me. analyzing selenium configuration effects on test flakiness

K Presler-Marshall, E Horton… - 2019 IEEE/ACM 14th …, 2019 - ieeexplore.ieee.org
Flaky tests are a source of frustration and uncertainty for developers. In an educational
environment, flaky tests can create doubts related to software behavior and student grades …

iFixFlakies: A framework for automatically fixing order-dependent flaky tests

A Shi, W Lam, R Oei, T Xie, D Marinov - … of the 2019 27th ACM Joint …, 2019 - dl.acm.org
Regression testing provides important pass or fail signals that developers use to make
decisions after code changes. However, flaky tests, which pass or fail even when the code …

A container-based infrastructure for fuzzy-driven root causing of flaky tests

V Terragni, P Salza, F Ferrucci - Proceedings of the ACM/IEEE 42nd …, 2020 - dl.acm.org
Intermittent test failures (test flakiness) is common during continuous integration as modern
software systems have become inherently non-deterministic. Understanding the root cause …

Test flakiness across programming languages

K Barbosa, R Ferreira, G Pinto… - IEEE Transactions …, 2022 - ieeexplore.ieee.org
Regression Testing (RT) is a quality-assurance practice commonly adopted in the software
industry to check if functionality remains intact after code changes. Test flakiness is a serious …