Understanding flaky tests: The developer's perspective

M Eck, F Palomba, M Castelluccio… - Proceedings of the 2019 …, 2019 - dl.acm.org
Flaky tests are software tests that exhibit a seemingly random outcome (pass or fail) despite
exercising unchanged code. In this work, we examine the perceptions of software …

Root causing flaky tests in a large-scale industrial setting

W Lam, P Godefroid, S Nath, A Santhiar… - Proceedings of the 28th …, 2019 - dl.acm.org
In today's agile world, developers often rely on continuous integration pipelines to help build
and validate their changes by executing tests in an efficient manner. One of the significant …

iDFlakies: A framework for detecting and partially classifying flaky tests

W Lam, R Oei, A Shi, D Marinov… - 2019 12th ieee …, 2019 - ieeexplore.ieee.org
Regression testing is increasingly important with the wide use of continuous integration. A
desirable requirement for regression testing is that a test failure reliably indicates a problem …

iFixFlakies: A framework for automatically fixing order-dependent flaky tests

A Shi, W Lam, R Oei, T Xie, D Marinov - … of the 2019 27th ACM Joint …, 2019 - dl.acm.org
Regression testing provides important pass or fail signals that developers use to make
decisions after code changes. However, flaky tests, which pass or fail even when the code …

Not all bugs are the same: Understanding, characterizing, and classifying bug types

G Catolino, F Palomba, A Zaidman… - Journal of Systems and …, 2019 - Elsevier
Modern version control systems, eg, GitHub, include bug tracking mechanisms that
developers can use to highlight the presence of bugs. This is done by means of bug reports …

Predictive test selection

M Machalica, A Samylkin, M Porth… - 2019 IEEE/ACM 41st …, 2019 - ieeexplore.ieee.org
Change-based testing is a key component of continuous integration at Facebook. However,
a large number of tests coupled with a high rate of changes committed to our monolithic …

Mitigating the effects of flaky tests on mutation testing

A Shi, J Bell, D Marinov - Proceedings of the 28th ACM SIGSOFT …, 2019 - dl.acm.org
Mutation testing is widely used in research as a metric for evaluating the quality of test
suites. Mutation testing runs the test suite on generated mutants (variants of the code under …

ECJ at 20: toward a general metaheuristics toolkit

EO Scott, S Luke - Proceedings of the genetic and evolutionary …, 2019 - dl.acm.org
ECJ is now 20 years old. Begun as a genetic programming and evolutionary computation
library in Java, it has since established itself as historically one of the most popular EC …

Understanding and improving regression test selection in continuous integration

A Shi, P Zhao, D Marinov - 2019 IEEE 30th International …, 2019 - ieeexplore.ieee.org
Developers rely on regression testing in their continuous integration (CI) environment to find
changes that introduce regression faults. While regression testing is widely practiced, it can …

RETRACTED ARTICLE: The smell of fear: on the relation between test smells and flaky tests

F Palomba, A Zaidman - Empirical Software Engineering, 2019 - Springer
Regression testing is the activity performed by developers to check whether new
modifications have not introduced bugs. A crucial requirement to make regression testing …