RETRACTED ARTICLE: The smell of fear: on the relation between test smells and flaky tests

F Palomba, A Zaidman - Empirical Software Engineering, 2019 - Springer
Regression testing is the activity performed by developers to check whether new
modifications have not introduced bugs. A crucial requirement to make regression testing …

A survey of flaky tests

O Parry, GM Kapfhammer, M Hilton… - ACM Transactions on …, 2021 - dl.acm.org
Tests that fail inconsistently, without changes to the code under test, are described as flaky.
Flaky tests do not give a clear indication of the presence of software bugs and thus limit the …

Test flakiness across programming languages

K Barbosa, R Ferreira, G Pinto… - IEEE Transactions …, 2022 - ieeexplore.ieee.org
Regression Testing (RT) is a quality-assurance practice commonly adopted in the software
industry to check if functionality remains intact after code changes. Test flakiness is a serious …

Flakime: laboratory-controlled test flakiness impact assessment

M Cordy, R Rwemalika, A Franci, M Papadakis… - Proceedings of the 44th …, 2022 - dl.acm.org
Much research on software testing makes an implicit assumption that test failures are
deterministic such that they always witness the presence of the same defects. However, this …

An empirical analysis of flaky tests

Q Luo, F Hariri, L Eloussi, D Marinov - Proceedings of the 22nd ACM …, 2014 - dl.acm.org
Regression testing is a crucial part of software development. It checks that software changes
do not break existing functionality. An important assumption of regression testing is that test …

Surveying the developer experience of flaky tests

O Parry, GM Kapfhammer, M Hilton… - Proceedings of the 44th …, 2022 - dl.acm.org
Test cases that pass and fail without changes to the code under test are known as flaky. The
past decade has seen increasing research interest in flaky tests, though little attention has …

Understanding flaky tests: The developer's perspective

M Eck, F Palomba, M Castelluccio… - Proceedings of the 2019 …, 2019 - dl.acm.org
Flaky tests are software tests that exhibit a seemingly random outcome (pass or fail) despite
exercising unchanged code. In this work, we examine the perceptions of software …

[HTML][HTML] Test flakiness' causes, detection, impact and responses: A multivocal review

A Tahir, S Rasheed, J Dietrich, N Hashemi… - Journal of Systems and …, 2023 - Elsevier
Flaky tests (tests with non-deterministic outcomes) pose a major challenge for software
testing. They are known to cause significant issues, such as reducing the effectiveness and …

De-flake your tests: Automatically locating root causes of flaky tests in code at google

C Ziftci, D Cavalcanti - 2020 IEEE International Conference on …, 2020 - ieeexplore.ieee.org
Regression testing is a critical part of software development and maintenance. It ensures
that modifications to existing software do not break existing behavior and functionality. One …

A large-scale longitudinal study of flaky tests

W Lam, S Winter, A Wei, T Xie, D Marinov… - Proceedings of the ACM …, 2020 - dl.acm.org
Flaky tests are tests that can non-deterministically pass or fail for the same code version.
These tests undermine regression testing efficiency, because developers cannot easily …