Evaluating features for machine learning detection of order-and non-order-dependent flaky tests

O Parry, GM Kapfhammer, M Hilton… - 2022 IEEE Conference …, 2022 - ieeexplore.ieee.org
Flaky tests are test cases that can pass or fail without code changes. They often waste the
time of software developers and obstruct the use of continuous integration. Previous work …

[HTML][HTML] Predicting unstable software benchmarks using static source code features

C Laaber, M Basmaci, P Salza - Empirical Software Engineering, 2021 - Springer
Software benchmarks are only as good as the performance measurements they yield.
Unstable benchmarks show high variability among repeated measurements, which causes …

Understanding and improving regression test selection in continuous integration

A Shi, P Zhao, D Marinov - 2019 IEEE 30th International …, 2019 - ieeexplore.ieee.org
Developers rely on regression testing in their continuous integration (CI) environment to find
changes that introduce regression faults. While regression testing is widely practiced, it can …

WES: Agent-based user interaction simulation on real infrastructure

J Ahlgren, ME Berezin, K Bojarczuk… - Proceedings of the …, 2020 - dl.acm.org
We introduce the Web-Enabled Simulation (WES) research agenda, and describe
FACEBOOK's WW system. We describe the application of WW to reliability, integrity and …

On the recall of static call graph construction in practice

L Sui, J Dietrich, A Tahir, G Fourtounis - Proceedings of the ACM/IEEE …, 2020 - dl.acm.org
Static analyses have problems modelling dynamic language features soundly while
retaining acceptable precision. The problem is well-understood in theory, but there is little …

Pizza versus pinsa: On the perception and measurability of unit test code quality

G Grano, C De Iaco, F Palomba… - 2020 IEEE international …, 2020 - ieeexplore.ieee.org
Test cases are an essential asset to evaluate software quality. The research community has
provided various alternatives to help developers assessing the quality of tests, like code or …

[HTML][HTML] RETRACTED ARTICLE: The smell of fear: on the relation between test smells and flaky tests

F Palomba, A Zaidman - Empirical Software Engineering, 2019 - Springer
Regression testing is the activity performed by developers to check whether new
modifications have not introduced bugs. A crucial requirement to make regression testing …

Challenges of end-to-end testing with selenium WebDriver and how to face them: A survey

M Leotta, B García, F Ricca… - 2023 IEEE Conference …, 2023 - ieeexplore.ieee.org
Modern web applications are complex and used for tasks of primary importance, so their
quality must be guaranteed at the highest levels. For this reason, testing techniques (eg, end …

An empirical study of flaky tests in javascript

N Hashemi, A Tahir, S Rasheed - 2022 IEEE International …, 2022 - ieeexplore.ieee.org
Flaky tests (tests with non-deterministic outcomes) can be problematic for testing efficiency
and software reliability. Flaky tests in test suites can also significantly delay software …

On determinism of game engines used for simulation-based autonomous vehicle verification

G Chance, A Ghobrial, K McAreavey… - IEEE Transactions …, 2022 - ieeexplore.ieee.org
Game engines are increasingly used as simulation platforms by the autonomous vehicle
community to develop vehicle control systems and test environments. A key requirement for …