Flakeflagger: Predicting flakiness without rerunning tests
When developers make changes to their code, they typically run regression tests to detect if
their recent changes (re) introduce any bugs. However, many tests are flaky, and their …
their recent changes (re) introduce any bugs. However, many tests are flaky, and their …
Root causing, detecting, and fixing flaky tests: State of the art and future roadmap
A flaky test is a test that may lead to different results in different runs on a single code under
test without any change in the test code. Test flakiness is a noxious phenomenon that slows …
test without any change in the test code. Test flakiness is a noxious phenomenon that slows …
Transforming test suites into croissants
Software developers often rely on regression testing to ensure that recent changes made to
the source code do not introduce bugs. Flaky tests, which non-deterministically pass or fail …
the source code do not introduce bugs. Flaky tests, which non-deterministically pass or fail …
Empirical analysis of practitioners' perceptions of test flakiness factors
Identifying the root causes of test flakiness is one of the challenges faced by practitioners
during software testing. In other words, the testing of the software is hampered by test …
during software testing. In other words, the testing of the software is hampered by test …
[HTML][HTML] Test flakiness' causes, detection, impact and responses: A multivocal review
Flaky tests (tests with non-deterministic outcomes) pose a major challenge for software
testing. They are known to cause significant issues, such as reducing the effectiveness and …
testing. They are known to cause significant issues, such as reducing the effectiveness and …
Non-Flaky and Nearly-Optimal Time-based Treatment of Asynchronous Wait Web Tests
Asynchronous waits are a common root cause of flaky tests and a major time-influential
factor of web application testing. We build a dataset of 49 reproducible asynchronous wait …
factor of web application testing. We build a dataset of 49 reproducible asynchronous wait …
Neurosymbolic Repair of Test Flakiness
Y Chen, R Jabbarvand - Proceedings of the 33rd ACM SIGSOFT …, 2024 - dl.acm.org
Test flakiness, a non-deterministic behavior of builds irrelevant to code changes, is a major
and continuing impediment to deliver-ing reliable software. The very few techniques for the …
and continuing impediment to deliver-ing reliable software. The very few techniques for the …
A Generic Approach to Fix Test Flakiness in Real-World Projects
Y Chen, R Jabbarvand - arXiv preprint arXiv:2404.09398, 2024 - arxiv.org
Test flakiness, a non-deterministic behavior of builds irrelevant to code changes, is a major
and continuing impediment to delivering reliable software. The very few techniques for the …
and continuing impediment to delivering reliable software. The very few techniques for the …
Can ChatGPT Repair Non-Order-Dependent Flaky Tests?
Y Chen, R Jabbarvand - Proceedings of the 1st International Workshop …, 2024 - dl.acm.org
Regression testing helps developers check whether the latest code changes break software
functionality. Flaky tests, which can non-deterministically pass or fail on the same code …
functionality. Flaky tests, which can non-deterministically pass or fail on the same code …
Flakiness Repair in the Era of Large Language Models
Y Chen - Proceedings of the 2024 IEEE/ACM 46th International …, 2024 - dl.acm.org
Flaky tests can non-deterministically pass or fail regardless of any change to the code, which
negatively impacts the effectiveness of the regression testing. Prior repair techniques for …
negatively impacts the effectiveness of the regression testing. Prior repair techniques for …