FlakyCat: Predicting flaky tests categories using few-shot learning

A Akli, G Haben, S Habchi… - 2023 IEEE/ACM …, 2023 - ieeexplore.ieee.org
Flaky tests are tests that yield different outcomes when run on the same version of a
program. This non-deterministic behaviour plagues continuous integration with false signals …

Practical flaky test prediction using common code evolution and test history data

M Gruber, M Heine, N Oster… - … IEEE Conference on …, 2023 - ieeexplore.ieee.org
Non-deterministically behaving test cases cause developers to lose trust in their regression
test suites and to eventually ignore failures. Detecting flaky tests is therefore a crucial task in …

Debugging flaky tests using spectrum-based fault localization

M Gruber, G Fraser - … on Automation of Software Test (AST), 2023 - ieeexplore.ieee.org
Non-deterministically behaving (ie, flaky) tests hamper regression testing as they destroy
trust and waste computational and human resources. Eradicating flakiness in test suites is …

Systematically producing test orders to detect order-dependent flaky tests

C Li, MM Khosravi, W Lam, A Shi - Proceedings of the 32nd ACM …, 2023 - dl.acm.org
Software testing suffers from the presence of flaky tests, which can pass or fail when run on
the same version of code. Order-dependent tests (OD tests) are flaky tests whose outcome …

[PDF][PDF] Test Flakiness Prediction Techniques for Evolving Software Systems

G Haben - 2023 - orbilu.uni.lu
Software testing plays a crucial role to guarantee a desired level of software quality. Its goal
is to ensure software products respect specified requirements, function as intended and are …

Understanding and Mitigating Flaky Software Test Cases

O Parry - 2023 - etheses.whiterose.ac.uk
A flaky test is a test case that can pass or fail without changes to the test case code or the
code under test. They are a wide-spread problem with serious consequences for developers …