What we talk about when we talk about software test flakiness
Software test flakiness is drawing increasing interest among both academic researchers and
practitioners. In this work we report our findings from a scoping review of white and grey …
practitioners. In this work we report our findings from a scoping review of white and grey …
A survey of flaky tests
O Parry, GM Kapfhammer, M Hilton… - ACM Transactions on …, 2021 - dl.acm.org
Tests that fail inconsistently, without changes to the code under test, are described as flaky.
Flaky tests do not give a clear indication of the presence of software bugs and thus limit the …
Flaky tests do not give a clear indication of the presence of software bugs and thus limit the …
[HTML][HTML] Test flakiness' causes, detection, impact and responses: A multivocal review
Flaky tests (tests with non-deterministic outcomes) pose a major challenge for software
testing. They are known to cause significant issues, such as reducing the effectiveness and …
testing. They are known to cause significant issues, such as reducing the effectiveness and …
Test Flakiness' Causes, Detection, Impact and Responses: A Multivocal Review
Flaky tests (tests with non-deterministic outcomes) pose a major challenge for software
testing. They are known to cause significant issues such as reducing the effectiveness and …
testing. They are known to cause significant issues such as reducing the effectiveness and …
Understanding flaky tests: The developer's perspective
Flaky tests are software tests that exhibit a seemingly random outcome (pass or fail) despite
exercising unchanged code. In this work, we examine the perceptions of software …
exercising unchanged code. In this work, we examine the perceptions of software …
Surveying the developer experience of flaky tests
O Parry, GM Kapfhammer, M Hilton… - Proceedings of the 44th …, 2022 - dl.acm.org
Test cases that pass and fail without changes to the code under test are known as flaky. The
past decade has seen increasing research interest in flaky tests, though little attention has …
past decade has seen increasing research interest in flaky tests, though little attention has …
A survey on how test flakiness affects developers and what support they need to address it
Non-deterministically passing and failing test cases, so-called flaky tests, have recently
become a focus area of software engineering research. While this research focus has been …
become a focus area of software engineering research. While this research focus has been …
Root causing, detecting, and fixing flaky tests: State of the art and future roadmap
A flaky test is a test that may lead to different results in different runs on a single code under
test without any change in the test code. Test flakiness is a noxious phenomenon that slows …
test without any change in the test code. Test flakiness is a noxious phenomenon that slows …
Static test flakiness prediction: How far can we go?
Test flakiness is a phenomenon occurring when a test case is non-deterministic and exhibits
both a passing and failing behavior when run against the same code. Over the last years …
both a passing and failing behavior when run against the same code. Over the last years …
A qualitative study on the sources, impacts, and mitigation strategies of flaky tests
Test flakiness forms a major testing concern. Flaky tests manifest non-deterministic
outcomes that cripple continu-ous integration and lead developers to investigate false alerts …
outcomes that cripple continu-ous integration and lead developers to investigate false alerts …