Test smells are defined as sub-optimal design choices developers make when
implementing test cases. Hence, similar to code smells, the research community has …

Tests that fail inconsistently, without changes to the code under test, are described as flaky.
Flaky tests do not give a clear indication of the presence of software bugs and thus limit the …

Developers often run tests to check that their latest changes to a code repository did not
break any previously working functionality. Ideally, any new test failures would indicate …

Regression testing is increasingly important with the wide use of continuous integration. A
desirable requirement for regression testing is that a test failure reliably indicates a problem …

When developers make changes to their code, they typically run regression tests to detect if
their recent changes (re) introduce any bugs. However, many tests are flaky, and their …

Regression testing provides important pass or fail signals that developers use to make
decisions after code changes. However, flaky tests, which pass or fail even when the code …

A flaky test is a test that both passes and fails periodically without any code changes, and its
uncontrolled uncertainty will destroy the value of the test suites and even cause developers …

Regression test selection (RTS) aims to reduce regression testing time by only re-running
the tests affected by code changes. Prior research on RTS can be broadly split into dy namic …

Software testing is one of the key activities to achieve software quality in practice. Despite its
importance, however, we have a remarkable lack of knowledge on how developers test in …

We report on Facebook's deployment of MIA (Metamorphic Interaction Automaton). MIA is
used to test Facebook's Web Enabled Simulation, built on a web infrastructure of hundreds …