Flakify: A black-box, language model-based predictor for flaky tests
Software testing assures that code changes do not adversely affect existing functionality.
However, a test case can be flaky, ie, passing and failing across executions, even for the …
However, a test case can be flaky, ie, passing and failing across executions, even for the …
What is the vocabulary of flaky tests?
Flaky tests are tests whose outcomes are non-deterministic. Despite the recent research
activity on this topic, no effort has been made on understanding the vocabulary of flaky tests …
activity on this topic, no effort has been made on understanding the vocabulary of flaky tests …
Not all bugs are the same: Understanding, characterizing, and classifying bug types
Modern version control systems, eg, GitHub, include bug tracking mechanisms that
developers can use to highlight the presence of bugs. This is done by means of bug reports …
developers can use to highlight the presence of bugs. This is done by means of bug reports …
Hybrid regression test selection
L Zhang - Proceedings of the 40th International Conference on …, 2018 - dl.acm.org
Regression testing is crucial but can be extremely costly. Regression Test Selection (RTS)
aims to reduce regression testing cost by only selecting and running the tests that may be …
aims to reduce regression testing cost by only selecting and running the tests that may be …
Predictive test selection
M Machalica, A Samylkin, M Porth… - 2019 IEEE/ACM 41st …, 2019 - ieeexplore.ieee.org
Change-based testing is a key component of continuous integration at Facebook. However,
a large number of tests coupled with a high rate of changes committed to our monolithic …
a large number of tests coupled with a high rate of changes committed to our monolithic …
What it would take to use mutation testing in industry—a study at facebook
Traditionally, mutation testing generates an abundance of small deviations of a program,
called mutants. At industrial systems the scale and size of Facebook's, doing this is …
called mutants. At industrial systems the scale and size of Facebook's, doing this is …
Detecting flaky tests in probabilistic and machine learning applications
Probabilistic programming systems and machine learning frameworks like Pyro, PyMC3,
TensorFlow, and PyTorch provide scalable and efficient primitives for inference and training …
TensorFlow, and PyTorch provide scalable and efficient primitives for inference and training …
An empirical characterization of bad practices in continuous integration
Continuous Integration (CI) has been claimed to introduce several benefits in software
development, including high software quality and reliability. However, recent work pointed …
development, including high software quality and reliability. However, recent work pointed …
Understanding reproducibility and characteristics of flaky tests through test reruns in Java projects
Flaky tests are tests that can non-deterministically pass and fail. They pose a major
impediment to regression testing, because they provide an inconclusive assessment on …
impediment to regression testing, because they provide an inconclusive assessment on …
A survey of challenges in spectrum-based software fault localization
QI Sarhan, Á Beszédes - IEEE Access, 2022 - ieeexplore.ieee.org
In software debugging, fault localization is the most difficult, expensive, tedious, and time-
consuming task, particularly for large-scale software systems. This is due to the fact that it …
consuming task, particularly for large-scale software systems. This is due to the fact that it …