Reproducibility in computing research: An empirical study

W Raghupathi, V Raghupathi, J Ren - IEEE Access, 2022 - ieeexplore.ieee.org
In computing, research findings are often anecdotally faulted for not being reproducible.
Numerous empirical studies have analyzed the reproducibility of a variety of research. Our …

Laying Foundations to Quantify the “Effort of Reproducibility”

AP Akella, D Koop, H Alhoori - 2023 ACM/IEEE Joint …, 2023 - ieeexplore.ieee.org
Why are some research studies easy to reproduce while others are difficult? Casting doubt
on the accuracy of scientific work is not fruitful, especially when an individual researcher …

Repeatability, Reproducibility, Replicability, Reusability (4R) in Journals' Policies and Software/Data Management in Scientific Publications: A Survey, Discussion, and …

JA Hernández, M Colom - arXiv preprint arXiv:2312.11028, 2023 - arxiv.org
With the recognized crisis of credibility in scientific research, there is a growth of
reproducibility studies in computer science, and although existing surveys have reviewed …

Toward a compatible reproducibility taxonomy for computational and computing sciences

MA Heroux, LA Barba, M Parashar, V Stodden… - 2018 - osti.gov
Reproducibility is an essential ingredient of the scientific enterprise. The ability to reproduce
results builds trust that we can rely on the results as foundations for future scientific …

Guest editors' introduction: reproducible research

S Fomel, JF Claerbout - Computing in Science & Engineering, 2008 - ieeexplore.ieee.org
The articles in this special issue provide independent solutions for practical reproducible
research systems. The use of Matlab-based tools such as the famous Wavelab and …

Towards an ecosystem for reproducible research in computer networking

Q Scheitle, M Wählisch, O Gasser, TC Schmidt… - Proceedings of the …, 2017 - dl.acm.org
Reproducibility is key to rigorous scientific progress. However, many publications in the
computer networks community lack support for reproducibility. In this paper, we argue that …

Understanding experiments and research practices for reproducibility: an exploratory study

S Samuel, B König-Ries - PeerJ, 2021 - peerj.com
Scientific experiments and research practices vary across disciplines. The research
practices followed by scientists in each domain play an essential role in the …

The state of reproducible research in computer science

JRF Cacho, K Taghva - 17th International Conference on Information …, 2020 - Springer
Reproducible research is the cornerstone of cumulative science and yet is one of the most
serious crisis that we face today in all fields. This paper aims to describe the ongoing …

Packing experiments for sharing and publication

F Chirigati, D Shasha, J Freire - Proceedings of the 2013 ACM SIGMOD …, 2013 - dl.acm.org
Reproducibility is a core component of the scientific process. Revisiting and reusing past
results allow science to move forward-" standing on the shoulders of giants", as Newton …

An empirical analysis of journal policy effectiveness for computational reproducibility

V Stodden, J Seiler, Z Ma - Proceedings of the National …, 2018 - National Acad Sciences
A key component of scientific communication is sufficient information for other researchers in
the field to reproduce published findings. For computational and data-enabled research, this …