A survey of flaky tests

O Parry, GM Kapfhammer, M Hilton… - ACM Transactions on …, 2021 - dl.acm.org
Tests that fail inconsistently, without changes to the code under test, are described as flaky.
Flaky tests do not give a clear indication of the presence of software bugs and thus limit the …

Research progress of flaky tests

W Zheng, G Liu, M Zhang, X Chen… - 2021 IEEE International …, 2021 - ieeexplore.ieee.org
A flaky test is a test that both passes and fails periodically without any code changes, and its
uncontrolled uncertainty will destroy the value of the test suites and even cause developers …

A large-scale longitudinal study of flaky tests

W Lam, S Winter, A Wei, T Xie, D Marinov… - Proceedings of the ACM …, 2020 - dl.acm.org
Flaky tests are tests that can non-deterministically pass or fail for the same code version.
These tests undermine regression testing efficiency, because developers cannot easily …

Preempting flaky tests via non-idempotent-outcome tests

A Wei, P Yi, Z Li, T Xie, D Marinov, W Lam - Proceedings of the 44th …, 2022 - dl.acm.org
Regression testing can greatly help in software development, but it can be seriously
undermined by flaky tests, which can both pass and fail, seemingly nondeterministically, on …

Build system aware multi-language regression test selection in continuous integration

D Elsner, R Wuersching, M Schnappinger… - Proceedings of the 44th …, 2022 - dl.acm.org
At IVU Traffic Technologies, continuous integration (CI) pipelines build, analyze, and test the
code for inadvertent effects before pull requests are merged. However, compiling the entire …

Hierarchy-Aware Regression Test Prioritization

H Wang, PL Yi, J Parladorio, W Lam… - 2024 IEEE 35th …, 2024 - ieeexplore.ieee.org
Regression testing is widely used to check whether software changes lead to test failures.
Regression Test Prioriti-zation (RTP) aims to order tests such that tests that are more likely to …

Optimizing Continuous Development By Detecting and Preventing Unnecessary Content Generation

T Baral, S Rahman, BN Chanumolu… - 2023 38th IEEE/ACM …, 2023 - ieeexplore.ieee.org
Continuous development (CD) helps developers quickly release and update their software.
To enact CD, developers customize their CD builds to perform several tasks, including …

Comparing and combining analysis-based and learning-based regression test selection

J Zhang, Y Liu, M Gligoric, O Legunsen… - Proceedings of the 3rd …, 2022 - dl.acm.org
Regression testing---rerunning tests on each code version to detect newly-broken
functionality---is important and widely practiced. But, regression testing is costly due to the …

Prioritizing Tests for Improved Runtime

A Baz, M Huang, A Shi - Proceedings of the 39th IEEE/ACM International …, 2024 - dl.acm.org
Regression testing is important but costly due to the large number of tests to run over
frequent changes. Techniques to speed up regression testing such as regression test …

PACE: A Program Analysis Framework for Continuous Performance Prediction

C Biringa, G Kul - ACM Transactions on Software Engineering and …, 2024 - dl.acm.org
Software development teams establish elaborate continuous integration pipelines
containing automated test cases to accelerate the development process of software …