DeFlaker automatically detecting flaky tests

J Bell, O Legunsen, M Hilton, L Eloussi… - Proceedings of the 40th …, 2018 - dl.acm.org
Developers often run tests to check that their latest changes to a code repository did not
break any previously working functionality. Ideally, any new test failures would indicate …

iDFlakies: A framework for detecting and partially classifying flaky tests

W Lam, R Oei, A Shi, D Marinov… - 2019 12th ieee …, 2019 - ieeexplore.ieee.org
Regression testing is increasingly important with the wide use of continuous integration. A
desirable requirement for regression testing is that a test failure reliably indicates a problem …

iFixFlakies: A framework for automatically fixing order-dependent flaky tests

A Shi, W Lam, R Oei, T Xie, D Marinov - … of the 2019 27th ACM Joint …, 2019 - dl.acm.org
Regression testing provides important pass or fail signals that developers use to make
decisions after code changes. However, flaky tests, which pass or fail even when the code …

Understanding reproducibility and characteristics of flaky tests through test reruns in Java projects

W Lam, S Winter, A Astorga, V Stodden… - 2020 IEEE 31st …, 2020 - ieeexplore.ieee.org
Flaky tests are tests that can non-deterministically pass and fail. They pose a major
impediment to regression testing, because they provide an inconclusive assessment on …

A large-scale longitudinal study of flaky tests

W Lam, S Winter, A Wei, T Xie, D Marinov… - Proceedings of the ACM …, 2020 - dl.acm.org
Flaky tests are tests that can non-deterministically pass or fail for the same code version.
These tests undermine regression testing efficiency, because developers cannot easily …

De-flake your tests: Automatically locating root causes of flaky tests in code at google

C Ziftci, D Cavalcanti - 2020 IEEE International Conference on …, 2020 - ieeexplore.ieee.org
Regression testing is a critical part of software development and maintenance. It ensures
that modifications to existing software do not break existing behavior and functionality. One …

HybridCISave: A Combined Build and Test Selection Approach in Continuous Integration

X Jin, F Servant - ACM Transactions on Software Engineering and …, 2023 - dl.acm.org
Continuous Integration (CI) is a popular practice in modern software engineering.
Unfortunately, it is also a high-cost practice—Google and Mozilla estimate their CI systems …

Preempting flaky tests via non-idempotent-outcome tests

A Wei, P Yi, Z Li, T Xie, D Marinov, W Lam - Proceedings of the 44th …, 2022 - dl.acm.org
Regression testing can greatly help in software development, but it can be seriously
undermined by flaky tests, which can both pass and fail, seemingly nondeterministically, on …

A machine learning approach to improve the detection of ci skip commits

R Abdalkareem, S Mujahid… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
Continuous integration (CI) frameworks, such as Travis CI, are growing in popularity,
encouraged by market trends towards speeding up the release cycle and building higher …

Which commits can be CI skipped?

R Abdalkareem, S Mujahid, E Shihab… - IEEE Transactions on …, 2019 - ieeexplore.ieee.org
Continuous Integration (CI) frameworks such as Travis CI, automatically build and run tests
whenever a new commit is submitted/pushed. Although there are many advantages in using …