A survey of flaky tests

O Parry, GM Kapfhammer, M Hilton… - ACM Transactions on …, 2021 - dl.acm.org
Tests that fail inconsistently, without changes to the code under test, are described as flaky.
Flaky tests do not give a clear indication of the presence of software bugs and thus limit the …

State of practical applicability of regression testing research: A live systematic literature review

R Greca, B Miranda, A Bertolino - ACM Computing Surveys, 2023 - dl.acm.org
Context: Software regression testing refers to rerunning test cases after the system under
test is modified, ascertaining that the changes have not (re-) introduced failures. Not all …

Root causing, detecting, and fixing flaky tests: State of the art and future roadmap

B Zolfaghari, RM Parizi, G Srivastava… - Software: Practice …, 2021 - Wiley Online Library
A flaky test is a test that may lead to different results in different runs on a single code under
test without any change in the test code. Test flakiness is a noxious phenomenon that slows …

Deeporder: Deep learning for test case prioritization in continuous integration testing

A Sharif, D Marijan, M Liaaen - 2021 IEEE International …, 2021 - ieeexplore.ieee.org
Continuous integration testing is an important step in the modern software engineering life
cycle. Test prioritization is a method that can improve the efficiency of continuous integration …

Empirically evaluating readily available information for regression test optimization in continuous integration

D Elsner, F Hauer, A Pretschner, S Reimer - Proceedings of the 30th …, 2021 - dl.acm.org
Regression test selection (RTS) and prioritization (RTP) techniques aim to reduce testing
efforts and developer feedback time after a change to the code base. Using various …

HybridCISave: A Combined Build and Test Selection Approach in Continuous Integration

X Jin, F Servant - ACM Transactions on Software Engineering and …, 2023 - dl.acm.org
Continuous Integration (CI) is a popular practice in modern software engineering.
Unfortunately, it is also a high-cost practice—Google and Mozilla estimate their CI systems …

Accelerating continuous integration by caching environments and inferring dependencies

K Gallaba, J Ewart, Y Junqueira… - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
To facilitate the rapid release cadence of modern software (on the order of weeks, days, or
even hours), software development organizations invest in practices like Continuous …

Continuous test suite failure prediction

C Pan, M Pradel - Proceedings of the 30th ACM SIGSOFT International …, 2021 - dl.acm.org
Continuous integration advocates to run the test suite of a project frequently, eg, for every
code change committed to a shared repository. This process imposes a high computational …

Build system aware multi-language regression test selection in continuous integration

D Elsner, R Wuersching, M Schnappinger… - Proceedings of the 44th …, 2022 - dl.acm.org
At IVU Traffic Technologies, continuous integration (CI) pipelines build, analyze, and test the
code for inadvertent effects before pull requests are merged. However, compiling the entire …

Test Selection for Unified Regression Testing

S Wang, X Lian, D Marinov, T Xu - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
Today's software failures have two dominating root causes: code bugs and
misconfigurations. To combat failure-inducing software changes, unified regression testing …