There have been rapid recent developments in automated software test design, repair and
program improvement. Advances in artificial intelligence also have great potential impact to …

This paper describes Meta's TestGen-LLM tool, which uses LLMs to automatically improve
existing human-written tests. TestGen-LLM verifies that its generated test classes …

Test flakiness is a phenomenon occurring when a test case is non-deterministic and exhibits
both a passing and failing behavior when run against the same code. Over the last years …

Flaky tests (tests with non-deterministic outcomes) pose a major challenge for software
testing. They are known to cause significant issues, such as reducing the effectiveness and …

Non-deterministically behaving (ie, flaky) tests hamper regression testing as they destroy
trust and waste computational and human resources. Eradicating flakiness in test suites is …

Context: Test flakiness is a topmost concern in software test automation. While conducting
pre-deployment testing, those tests that are flagged as flaky are put aside for being either …

Context: Test flakiness arises when test cases have a non-deterministic, intermittent
behavior that leads them to either pass or fail when run against the same code. While …

Software testing plays a crucial role to guarantee a desired level of software quality. Its goal
is to ensure software products respect specified requirements, function as intended and are …

A flaky test is a test case that can pass or fail without changes to the test case code or the
code under test. They are a wide-spread problem with serious consequences for developers …