Reducing flakiness in End-to-End test suites: An experience report

D Olianas, M Leotta, F Ricca, L Villa - … on the Quality of Information and …, 2021 - Springer
Abstract End-to-end (E2E) testing, a technique employed to assure quality of web
applications, is cost-effective only if the test suite is not flaky. Flaky test scripts produce non …

Identifying key success factors in stopping flaky tests in automated REST service testing

MA Mascheroni, E Irrazábal - Journal of Computer Science & …, 2018 - sedici.unlp.edu.ar
A flaky test is a test which could fail or pass for the same version of a certain software code.
In continuous software development environments, flaky tests represent a problem. It is …

Flakyloc: flakiness localization for reliable test suites in web applications

J Morán, C Augusto, A Bertolino… - Journal of Web …, 2020 - ieeexplore.ieee.org
Web application testing is a great challenge due to the management of complex
asynchronous communications, the concurrency between the clients-servers, and the …

A survey of flaky tests

O Parry, GM Kapfhammer, M Hilton… - ACM Transactions on …, 2021 - dl.acm.org
Tests that fail inconsistently, without changes to the code under test, are described as flaky.
Flaky tests do not give a clear indication of the presence of software bugs and thus limit the …

[PDF][PDF] Debugging Flaky Tests on Web Applications.

J Morán, C Augusto, A Bertolino, C de la Riva… - WEBIST, 2019 - openportal.isti.cnr.it
Testing web applications is a challenging practice because it involves managing
asynchronous requests between clients and servers, the integration of heterogeneous …

A qualitative study on the sources, impacts, and mitigation strategies of flaky tests

S Habchi, G Haben, M Papadakis… - … IEEE Conference on …, 2022 - ieeexplore.ieee.org
Test flakiness forms a major testing concern. Flaky tests manifest non-deterministic
outcomes that cripple continu-ous integration and lead developers to investigate false alerts …

Do Automatic Test Generation Tools Generate Flaky Tests?

M Gruber, MF Roslan, O Parry, F Scharnböck… - Proceedings of the 46th …, 2024 - dl.acm.org
Non-deterministic test behavior, or flakiness, is common and dreaded among developers.
Researchers have studied the issue and proposed approaches to mitigate it. However, the …

An empirical analysis of flaky tests

Q Luo, F Hariri, L Eloussi, D Marinov - Proceedings of the 22nd ACM …, 2014 - dl.acm.org
Regression testing is a crucial part of software development. It checks that software changes
do not break existing functionality. An important assumption of regression testing is that test …

WEFix: Intelligent Automatic Generation of Explicit Waits for Efficient Web End-to-End Flaky Tests

X Liu, Z Song, W Fang, W Yang, W Wang - arXiv preprint arXiv …, 2024 - arxiv.org
Web end-to-end (e2e) testing evaluates the workflow of a web application. It simulates real-
world user scenarios to ensure the application flows behave as expected. However, web …

An empirical study of flaky tests in javascript

N Hashemi, A Tahir, S Rasheed - 2022 IEEE International …, 2022 - ieeexplore.ieee.org
Flaky tests (tests with non-deterministic outcomes) can be problematic for testing efficiency
and software reliability. Flaky tests in test suites can also significantly delay software …