Preempting flaky tests via non-idempotent-outcome tests
Regression testing can greatly help in software development, but it can be seriously
undermined by flaky tests, which can both pass and fail, seemingly nondeterministically, on …
undermined by flaky tests, which can both pass and fail, seemingly nondeterministically, on …
An empirical study of flaky tests in javascript
Flaky tests (tests with non-deterministic outcomes) can be problematic for testing efficiency
and software reliability. Flaky tests in test suites can also significantly delay software …
and software reliability. Flaky tests in test suites can also significantly delay software …
Test flakiness across programming languages
K Barbosa, R Ferreira, G Pinto… - IEEE Transactions …, 2022 - ieeexplore.ieee.org
Regression Testing (RT) is a quality-assurance practice commonly adopted in the software
industry to check if functionality remains intact after code changes. Test flakiness is a serious …
industry to check if functionality remains intact after code changes. Test flakiness is a serious …
Peeler: Learning to effectively predict flakiness without running tests
Regression testing is a widely adopted approach to expose change-induced bugs as well as
to verify the correctness/robustness of code in modern software development settings …
to verify the correctness/robustness of code in modern software development settings …
Mining android api usage to generate unit test cases for pinpointing compatibility issues
Despite being one of the largest and most popular projects, the official Android framework
has only provided test cases for less than 30% of its APIs. Such a poor test case coverage …
has only provided test cases for less than 30% of its APIs. Such a poor test case coverage …
[HTML][HTML] Test flakiness' causes, detection, impact and responses: A multivocal review
Flaky tests (tests with non-deterministic outcomes) pose a major challenge for software
testing. They are known to cause significant issues, such as reducing the effectiveness and …
testing. They are known to cause significant issues, such as reducing the effectiveness and …
What made this test flake? pinpointing classes responsible for test flakiness
Flaky tests are defined as tests that manifest non-deterministic behaviour by passing and
failing intermittently for the same version of the code. These tests cripple continuous …
failing intermittently for the same version of the code. These tests cripple continuous …
Flaky test sanitisation via on-the-fly assumption inference for tests with network dependencies
Flaky tests cause significant problems as they can interrupt automated build processes that
rely on all tests succeeding and undermine the trustworthiness of tests. Numerous causes of …
rely on all tests succeeding and undermine the trustworthiness of tests. Numerous causes of …
Non-Flaky and Nearly-Optimal Time-based Treatment of Asynchronous Wait Web Tests
Asynchronous waits are a common root cause of flaky tests and a major time-influential
factor of web application testing. We build a dataset of 49 reproducible asynchronous wait …
factor of web application testing. We build a dataset of 49 reproducible asynchronous wait …
Reproducing Timing-Dependent GUI Flaky Tests in Android Apps via a Single Event Delay
Flaky tests hinder the development process by exhibiting uncertain behavior in regression
testing. A flaky test may pass in some runs and fail in others while running on the same code …
testing. A flaky test may pass in some runs and fail in others while running on the same code …