Evaluation of machine learning models in predicting software flakiness

C Saastamoinen - 2024 - oulurepo.oulu.fi
… this research is to use data gathered from the virtual machines running the tests to distinguish
flaky test fails from non-flaky test … This research was the first approach to detect flaky tests

A Synthesis of the Dibble et al. Controlled Experiments into the Mechanics of Lithic Production

L Li, SC Lin, SP McPherron, A Abdolahzadeh… - … Method and Theory, 2023 - Springer
… Here we review the work of Dibble and colleagues on controlled flaking experiments by …
about flake variability from these controlled experiments to better understand the flake formation …

Using mutation testing to measure behavioural test diversity

FG de Oliveira Neto, F Dobslaw… - … on Software Testing …, 2020 - ieeexplore.ieee.org
test execution logs which are often not available or can be difficult to obtain due to flaky tests,
scarcity of testEmpirical studies have shown promising results when diversity is used to …

An empirical analysis of source code metrics and smart contract resource consumption

N Ajienka, P Vangorp… - Journal of Software …, 2020 - Wiley Online Library
… the analysis of design patterns for SCs and resource usage at the function level. We also
aim to investigate automated testing in the context of SCs (eg, flaky tests and mutation testing) …

A deep learning-based automated framework for functional User Interface testing

Z Khaliq, SU Farooq, DA Khan - Information and Software Technology, 2022 - Elsevier
… We evaluate our model for repairing flaky tests in case the UI is modified. The model …
testing. Further, we also prove through the experiments that our framework can repair flaky tests if …

Empirically evaluating readily available information for regression test optimization in continuous integration

D Elsner, F Hauer, A Pretschner, S Reimer - … Testing and Analysis, 2021 - dl.acm.org
research exists on test dependency aware RTP and RTS [39]. Thus, while our empirical study
of … We argue that flaky test detection requires special efforts and can be performed on top …

Finding polluter tests using Java PathFinder

P Yi, A Wei, W Lam, T Xie, D Marinov - ACM SIGSOFT Software …, 2021 - dl.acm.org
… of flaky tests, identifying a dozen kinds of flaky tests based on … flaky tests that depend on
the order of the tests in the test … An empirical study of flaky tests in Python. In ICST, 2021. [4] A…

Simulation-based testing of unmanned aerial vehicles with aerialist

S Khatiri, S Panichella, P Tonella - Proceedings of the 2024 IEEE/ACM …, 2024 - dl.acm.org
Empirical studies have … test description to identify related test cases that could potentially
trigger unsafe UAV behavior in simulation. Figure 2 illustrates a challenging and flaky test case …

How can manual testing processes be optimized? developer survey, optimization guidelines, and case studies

R Haas, D Elsner, E Juergens, A Pretschner… - Proceedings of the 29th …, 2021 - dl.acm.org
… , empirical studies on the state-of-practice in manual testing … encounter flaky tests (20), while
others report that flaky results … not sure whether there are flaky tests in their test suite. Only 5 …

T-evos: A large-scale longitudinal study on ci test execution and failure

AR Chen, THP Chen, S Wang - IEEE Transactions on Software …, 2022 - ieeexplore.ieee.org
flaky test failure instances account for over 58% of the test failure instances. For non-flaky test
cases, the same test … Prior studies conducted empirical studies on test code, and proposed …