Writing reliable test suites for large object-oriented systems is complex and time consuming.
One common cause of unreliable test suites are test dependencies that can cause tests to …

Test smells are symptoms in the test code that indicate possible design or implementation
problems. Previous research demonstrated their harmfulness and the developers' …

Fault-detection, localization, and repair methods are vital to software quality; but it is difficult
to evaluate their generality, applicability, and current effectiveness. Large, diverse, realistic …

Test flakiness forms a major testing concern. Flaky tests manifest non-deterministic
outcomes that cripple continu-ous integration and lead developers to investigate false alerts …

Mutation analysis is a well-studied, fault-based testing technique. It requires testers to
design tests based on a set of artificial defects. The defects help in performing testing …

Continuous delivery of cloud systems requires constant running of jobs (build processes,
tests, etc.). One issue that plagues this continuous integration (CI) process are intermittent …

Statement coverage is commonly used as a measure of test suite quality. Coverage is often
used as a part of a code review process: if a patch decreases overall coverage, or is itself …

Industrial reports indicate that flaky tests are one of the primary concerns of software testing
mainly due to the false signals they provide. To deal with this issue, researchers have …

Test flakiness---inability to reliably repeat a test's Pass/Fail outcome---continues to be a
significant problem in Industry, adversely impacting continuous integration and test …

Many machine learning (ML) algorithms are inherently random–multiple executions using
the same inputs may produce slightly different results each time. Randomness impacts how …