Preempting flaky tests via non-idempotent-outcome tests
Regression testing can greatly help in software development, but it can be seriously
undermined by flaky tests, which can both pass and fail, seemingly nondeterministically, on …
undermined by flaky tests, which can both pass and fail, seemingly nondeterministically, on …
Predicting flaky tests categories using few-shot learning
Flaky tests are tests that yield different outcomes when run on the same version of a
program. This non-deterministic behaviour plagues continuous integration with false signals …
program. This non-deterministic behaviour plagues continuous integration with false signals …
iPFlakies: A framework for detecting and fixing python order-dependent flaky tests
Developers typically run tests after code changes. Flaky tests, which are tests that can
nondeterministically pass and fail when run on the same version of code, can mislead …
nondeterministically pass and fail when run on the same version of code, can mislead …
FlakyCat: Predicting flaky tests categories using few-shot learning
Flaky tests are tests that yield different outcomes when run on the same version of a
program. This non-deterministic behaviour plagues continuous integration with false signals …
program. This non-deterministic behaviour plagues continuous integration with false signals …
[HTML][HTML] Test flakiness' causes, detection, impact and responses: A multivocal review
Flaky tests (tests with non-deterministic outcomes) pose a major challenge for software
testing. They are known to cause significant issues, such as reducing the effectiveness and …
testing. They are known to cause significant issues, such as reducing the effectiveness and …
Quantizing large-language models for predicting flaky tests
S Rahman, A Baz, S Misailovic… - 2024 IEEE Conference on …, 2024 - ieeexplore.ieee.org
A major challenge in regression testing practice is the presence of flaky tests, which non-
deterministically pass or fail when run on the same code. Previous research identified …
deterministically pass or fail when run on the same code. Previous research identified …
Evolution-aware detection of order-dependent flaky tests
Regression testing is an important part of the software development process but suffers from
the presence of flaky tests. Flaky tests are tests that can nondeterministically pass or fail …
the presence of flaky tests. Flaky tests are tests that can nondeterministically pass or fail …
FlakeSync: Automatically Repairing Async Flaky Tests
Regression testing is an important part of the development process but suffers from the
presence of flaky tests. Flaky tests nondeterministically pass or fail when run on the same …
presence of flaky tests. Flaky tests nondeterministically pass or fail when run on the same …
Non-Flaky and Nearly-Optimal Time-based Treatment of Asynchronous Wait Web Tests
Asynchronous waits are a common root cause of flaky tests and a major time-influential
factor of web application testing. We build a dataset of 49 reproducible asynchronous wait …
factor of web application testing. We build a dataset of 49 reproducible asynchronous wait …
Neurosymbolic Repair of Test Flakiness
Y Chen, R Jabbarvand - Proceedings of the 33rd ACM SIGSOFT …, 2024 - dl.acm.org
Test flakiness, a non-deterministic behavior of builds irrelevant to code changes, is a major
and continuing impediment to deliver-ing reliable software. The very few techniques for the …
and continuing impediment to deliver-ing reliable software. The very few techniques for the …