Flaky tests can pass or fail non-deterministically, without alterations to a software system.
Such tests are frequently encountered by developers and hinder the credibility of test suites …

The risk posed by software bugs has increased tremendously as software is now essential to
many aspects of our daily lives. Software testing is still the most common method for finding …

A flaky test is a test case that can pass or fail without changes to the test case code or the
code under test. They are a wide-spread problem with serious consequences for developers …

As software becomes more important and ubiquitous, high quality software also becomes
crucial. Developers constantly make changes to improve software, and they rely on …

Some Java libraries have underdetermined specifications that allow more than one correct
output for the same input, eg, an output array may have its elements in any order. While such …

Software testing is the dominant method for quality assurance and control in software
engineering [1],[2]. Test suites serve as quality gates to safeguard against programming …

We present EMOP, a tool for incremental runtime verification (RV) of test executions during
software evolution. We previously used RV to find hundreds of bugs in open-source projects …

Abstract Machine Learning (ML) is rapidly revolutionizing the way modern-day systems are
developed. However, testing ML-based systems is challenging due to 1) the presence of …

Continuous Integration (CI) has become a staple of modern software development by
making developers find bugs quicker, improving overall software quality, and enabling …

Software testing is the dominant method for quality assurance and quality control in software
development organisations [10, 11]. Software testing was established as a disciplined …