Flaky test detection in Android via event order exploration

Z Dong, A Tiwari, XL Yu, A Roychoudhury - Proceedings of the 29th ACM …, 2021 - dl.acm.org
Validation of Android apps via testing is difficult owing to the presence of flaky tests. Due to
non-deterministic execution environments, a sequence of events (a test) may lead to …

Web test dependency detection

M Biagiola, A Stocco, A Mesbah, F Ricca… - Proceedings of the 2019 …, 2019 - dl.acm.org
E2E web test suites are prone to test dependencies due to the heterogeneous multi-tiered
nature of modern web apps, which makes it difficult for developers to create isolated …

Evolution-aware detection of order-dependent flaky tests

C Li, A Shi - Proceedings of the 31st ACM SIGSOFT International …, 2022 - dl.acm.org
Regression testing is an important part of the software development process but suffers from
the presence of flaky tests. Flaky tests are tests that can nondeterministically pass or fail …

What we talk about when we talk about software test flakiness

M Barboni, A Bertolino, G De Angelis - … on the Quality of Information and …, 2021 - Springer
Software test flakiness is drawing increasing interest among both academic researchers and
practitioners. In this work we report our findings from a scoping review of white and grey …

Practical flaky test prediction using common code evolution and test history data

M Gruber, M Heine, N Oster… - … IEEE Conference on …, 2023 - ieeexplore.ieee.org
Non-deterministically behaving test cases cause developers to lose trust in their regression
test suites and to eventually ignore failures. Detecting flaky tests is therefore a crucial task in …

To seed or not to seed? an empirical analysis of usage of seeds for testing in machine learning projects

S Dutta, A Arunachalam… - 2022 IEEE Conference on …, 2022 - ieeexplore.ieee.org
Many Machine Learning (ML) algorithms are in-herently random in nature-executing them
using the same inputs may lead to slightly different results across different runs. Such …

Surveying the developer experience of flaky tests

O Parry, GM Kapfhammer, M Hilton… - Proceedings of the 44th …, 2022 - dl.acm.org
Test cases that pass and fail without changes to the code under test are known as flaky. The
past decade has seen increasing research interest in flaky tests, though little attention has …

Tera: Optimizing stochastic regression tests in machine learning projects

S Dutta, J Selvam, A Jain, S Misailovic - Proceedings of the 30th ACM …, 2021 - dl.acm.org
The stochastic nature of many Machine Learning (ML) algorithms makes testing of ML tools
and libraries challenging. ML algorithms allow a developer to control their accuracy and run …

Inline tests

Y Liu, P Nie, O Legunsen, M Gligoric - Proceedings of the 37th IEEE …, 2022 - dl.acm.org
Unit tests are widely used to check source code quality, but they can be too coarse-grained
or ill-suited for testing individual program statements. We introduce inline tests to make it …

FlakeSync: Automatically Repairing Async Flaky Tests

S Rahman, A Shi - Proceedings of the IEEE/ACM 46th International …, 2024 - dl.acm.org
Regression testing is an important part of the development process but suffers from the
presence of flaky tests. Flaky tests nondeterministically pass or fail when run on the same …