Flakify: A black-box, language model-based predictor for flaky tests

S Fatima, TA Ghaleb, L Briand - IEEE Transactions on Software …, 2022 - ieeexplore.ieee.org
Software testing assures that code changes do not adversely affect existing functionality.
However, a test case can be flaky, ie, passing and failing across executions, even for the …

Preempting flaky tests via non-idempotent-outcome tests

A Wei, P Yi, Z Li, T Xie, D Marinov, W Lam - Proceedings of the 44th …, 2022 - dl.acm.org
Regression testing can greatly help in software development, but it can be seriously
undermined by flaky tests, which can both pass and fail, seemingly nondeterministically, on …

Evaluating features for machine learning detection of order-and non-order-dependent flaky tests

O Parry, GM Kapfhammer, M Hilton… - 2022 IEEE Conference …, 2022 - ieeexplore.ieee.org
Flaky tests are test cases that can pass or fail without code changes. They often waste the
time of software developers and obstruct the use of continuous integration. Previous work …

An empirical study of flaky tests in javascript

N Hashemi, A Tahir, S Rasheed - 2022 IEEE International …, 2022 - ieeexplore.ieee.org
Flaky tests (tests with non-deterministic outcomes) can be problematic for testing efficiency
and software reliability. Flaky tests in test suites can also significantly delay software …

Flakime: laboratory-controlled test flakiness impact assessment

M Cordy, R Rwemalika, A Franci, M Papadakis… - Proceedings of the 44th …, 2022 - dl.acm.org
Much research on software testing makes an implicit assumption that test failures are
deterministic such that they always witness the presence of the same defects. However, this …

Repairing order-dependent flaky tests via test generation

C Li, C Zhu, W Wang, A Shi - … of the 44th International Conference on …, 2022 - dl.acm.org
Flaky tests are tests that pass or fail nondeterministically on the same version of code. These
tests can mislead developers concerning the quality of their code changes during regression …

Evolution-aware detection of order-dependent flaky tests

C Li, A Shi - Proceedings of the 31st ACM SIGSOFT International …, 2022 - dl.acm.org
Regression testing is an important part of the software development process but suffers from
the presence of flaky tests. Flaky tests are tests that can nondeterministically pass or fail …

Surveying the developer experience of flaky tests

O Parry, GM Kapfhammer, M Hilton… - Proceedings of the 44th …, 2022 - dl.acm.org
Test cases that pass and fail without changes to the code under test are known as flaky. The
past decade has seen increasing research interest in flaky tests, though little attention has …

Test case prioritization using partial attention

Q Zhang, C Fang, W Sun, S Yu, Y Xu, Y Liu - Journal of Systems and …, 2022 - Elsevier
Test case prioritization (TCP) aims to reorder the regression test suite with a goal of
increasing the fault detection rate. Various TCP techniques have been proposed based on …

API message-driven regression testing framework

ED Demircioğlu, O Kalipsiz - Electronics, 2022 - mdpi.com
With the increase in the number of APIs and interconnected applications, API testing has
become a critical part of the software testing process. Particularly considering the business …