Reinforcement learning for automatic test case prioritization and selection in continuous integration

H Spieker, A Gotlieb, D Marijan… - Proceedings of the 26th …, 2017 - dl.acm.org
Testing in Continuous Integration (CI) involves test case prioritization, selection, and
execution at each cycle. Selecting the most promising test cases to detect bugs is hard if …

Bugs. jar: A large-scale, diverse dataset of real-world java bugs

RK Saha, Y Lyu, W Lam, H Yoshida… - Proceedings of the 15th …, 2018 - dl.acm.org
We present Bugs. jar, a large-scale dataset for research in automated debugging, patching,
and testing of Java programs. Bugs. jar is comprised of 1,158 bugs and patches, drawn from …

Practical regression test selection with dynamic file dependencies

M Gligoric, L Eloussi, D Marinov - Proceedings of the 2015 International …, 2015 - dl.acm.org
Regression testing is important but can be time-intensive. One approach to speed it up is
regression test selection (RTS), which runs only a subset of tests. RTS was proposed over …

An extensive study of static regression test selection in modern software evolution

O Legunsen, F Hariri, A Shi, Y Lu, L Zhang… - Proceedings of the …, 2016 - dl.acm.org
Regression test selection (RTS) aims to reduce regression testing time by only re-running
the tests affected by code changes. Prior research on RTS can be broadly split into dy namic …

Hybrid regression test selection

L Zhang - Proceedings of the 40th International Conference on …, 2018 - dl.acm.org
Regression testing is crucial but can be extremely costly. Regression Test Selection (RTS)
aims to reduce regression testing cost by only selecting and running the tests that may be …

Empirically evaluating readily available information for regression test optimization in continuous integration

D Elsner, F Hauer, A Pretschner, S Reimer - Proceedings of the 30th acm …, 2021 - dl.acm.org
Regression test selection (RTS) and prioritization (RTP) techniques aim to reduce testing
efforts and developer feedback time after a change to the code base. Using various …

Comparing and combining test-suite reduction and regression test selection

A Shi, T Yung, A Gyori, D Marinov - Proceedings of the 2015 10th joint …, 2015 - dl.acm.org
Regression testing is widely used to check that changes made to software do not break
existing functionality, but regression test suites grow, and running them fully can become …

A large-scale study of test coverage evolution

M Hilton, J Bell, D Marinov - Proceedings of the 33rd ACM/IEEE …, 2018 - dl.acm.org
Statement coverage is commonly used as a measure of test suite quality. Coverage is often
used as a part of a code review process: if a patch decreases overall coverage, or is itself …

How can manual testing processes be optimized? developer survey, optimization guidelines, and case studies

R Haas, D Elsner, E Juergens, A Pretschner… - Proceedings of the 29th …, 2021 - dl.acm.org
Manual software testing is tedious and costly as it involves significant human effort. Yet, it is
still widely applied in industry and will be in the foreseeable future. Although there is …

Empirically revisiting and enhancing IR-based test-case prioritization

Q Peng, A Shi, L Zhang - Proceedings of the 29th ACM SIGSOFT …, 2020 - dl.acm.org
Test-case prioritization (TCP) aims to detect regression bugs faster via reordering the tests
run. While TCP has been studied for over 20 years, it was almost always evaluated using …