Flakeflagger: Predicting flakiness without rerunning tests

A Alshammari, C Morris, M Hilton… - 2021 IEEE/ACM 43rd …, 2021 - ieeexplore.ieee.org
When developers make changes to their code, they typically run regression tests to detect if
their recent changes (re) introduce any bugs. However, many tests are flaky, and their …

Flakime: laboratory-controlled test flakiness impact assessment

M Cordy, R Rwemalika, A Franci, M Papadakis… - Proceedings of the 44th …, 2022 - dl.acm.org
Much research on software testing makes an implicit assumption that test failures are
deterministic such that they always witness the presence of the same defects. However, this …

SleepReplacer: a novel tool-based approach for replacing thread sleeps in selenium WebDriver test code

D Olianas, M Leotta, F Ricca - Software Quality Journal, 2022 - Springer
Assuring quality of web applications is fundamental, given their relevance in the today's
world. A possible way to reach this goal is through end-to-end (E2E) testing, an approach in …

Intermittently failing tests in the embedded systems domain

PE Strandberg, TJ Ostrand, EJ Weyuker… - Proceedings of the 29th …, 2020 - dl.acm.org
Software testing is sometimes plagued with intermittently failing tests and finding the root
causes of such failing tests is often difficult. This problem has been widely studied at the unit …

Towards language-independent brown build detection

D Olewicki, M Nayrolles, B Adams - Proceedings of the 44th International …, 2022 - dl.acm.org
In principle, continuous integration (CI) practices allow modern software organizations to
build and test their products after each code change to detect quality issues as soon as …

What we talk about when we talk about software test flakiness

M Barboni, A Bertolino, G De Angelis - … on the Quality of Information and …, 2021 - Springer
Software test flakiness is drawing increasing interest among both academic researchers and
practitioners. In this work we report our findings from a scoping review of white and grey …

An initial investigation of the effect of quality factors on Agile test case quality through experts' review

SO Barraood, H Mohd, F Baharom - Cogent Engineering, 2022 - Taylor & Francis
A test case is a cornerstone of the testing process; hence, it is quintessential to ensure the
quality of the test cases. However, test case design in the Agile testing process has …

Reducing flakiness in End-to-End test suites: An experience report

D Olianas, M Leotta, F Ricca, L Villa - … on the Quality of Information and …, 2021 - Springer
Abstract End-to-end (E2E) testing, a technique employed to assure quality of web
applications, is cost-effective only if the test suite is not flaky. Flaky test scripts produce non …

On Technical Debt in Software Testing-Observations from Industry

S Eldh - International Symposium on Leveraging Applications of …, 2022 - Springer
Testing large complex systems in an agile way of working was a tough transition for systems
having large active legacy and honouring backward compatibility. Transition from manual …

A multi-factor approach for flaky test detection and automated root cause analysis

A Ahmad, FG de Oliveira Neto, Z Shi… - 2021 28th Asia …, 2021 - ieeexplore.ieee.org
Developers often spend time to determine whether test case failures are real failures or
flaky. The flaky tests, also known as non-deterministic tests, switch their outcomes without …