Empirical analysis of practitioners' perceptions of test flakiness factors

A Ahmad, O Leifler, K Sandahl - Software Testing, Verification …, 2021 - Wiley Online Library
… This study reported 19 factors that are perceived by professionals to affect test flakiness…
perceived factors and their effect on test flakiness. Later we report the test smells found in the test

Flakime: laboratory-controlled test flakiness impact assessment

M Cordy, R Rwemalika, A Franci, M Papadakis… - Proceedings of the 44th …, 2022 - dl.acm.org
… can stress-test their techniques and study their limits. It remains important to validate research
techniques in practice, through empirical studies with real flaky tests. What FlakiMe offers …

A multi-factor approach for flaky test detection and automated root cause analysis

A Ahmad, FG de Oliveira Neto, Z Shi… - 2021 28th Asia …, 2021 - ieeexplore.ieee.org
… Our results show that the combination of different factors can be used to identify flaky tests.
Each factor has its own … Test Smells: Many studies empirically show the relationship between …

Flakeflagger: Predicting flakiness without rerunning tests

A Alshammari, C Morris, M Hilton… - 2021 IEEE/ACM 43rd …, 2021 - ieeexplore.ieee.org
… up to 1,000 times to increase the likelihood of determining if a test is flaky [18]. In this paper,
we describe an empirical study of flaky tests that we conducted by rerunning tests 10,000 …

Reducing flakiness in End-to-End test suites: An experience report

D Olianas, M Leotta, F Ricca, L Villa - International Conference on the …, 2021 - Springer
… Recently, we were involved in the refactoring of an existing automated flaky E2E test suite for
a … flaky test suite. Moreover, as a positive side effect, the execution time of the test suite has …

Flakiness Goes Live: Insights from Running Flaky Tests into the Field

M Barboni, A Bertolino, G De Angelis - Available at SSRN 4095579 - papers.ssrn.com
… work concerns the perceived harmfulness of flaky tests. Flakiness … we analyze those tests
methods that exhibited some intermittence (ie, In Vivo, In House, or both) and we compare their

An initial investigation of the effect of quality factors on Agile test case quality through experts' review

SO Barraood, H Mohd, F Baharom - Cogent Engineering, 2022 - Taylor & Francis
factors and criteria of test case quality by software testing experts in an Agile environment.
The proposed factors and … The factors and criteria were extracted from the existing empirical

[PDF][PDF] Test case quality: issues and limitations in Agile software development

SO Barraood, H Mohd, F Baharom - Knowledge Management …, 2021 - researchgate.net
… with software testing. However, findings from literature and the critical analysis of empirical
studies revealed that less academic research has investigated the test case quality in Agile …

Practical flaky test prediction using common code evolution and test history data

M Gruber, M Heine, N Oster… - … on Software Testing …, 2023 - ieeexplore.ieee.org
perceived business value of retesting is limited when nothing has changed, we cannot expect
to see much repeated testing … [45] conducted the first empirical study on flaky tests. They …

[PDF][PDF] Mitigation and handling of non-deterministic tests in automatic regression testing

A Berglund, O Vateman - LU-CS-EX, 2020 - lup.lub.lu.se
… From the literature review we found that previous empirical studies done on aky tests all
found asynchronous implementation as the culprit for a large amount of explored aky tests [ , , ]. …