Toward the Geoscience Paper of the Future: Best practices for documenting and sharing research from data to software to provenance
Geoscientists now live in a world rich with digital data and methods, and their computational
research cannot be fully captured in traditional publications. The Geoscience Paper of the …
research cannot be fully captured in traditional publications. The Geoscience Paper of the …
OpenML: networked science in machine learning
Many sciences have made significant breakthroughs by adopting online tools that help
organize, structure and mine information that is too detailed to be printed in journals. In this …
organize, structure and mine information that is too detailed to be printed in journals. In this …
Scientific benchmarking of parallel computing systems: twelve ways to tell the masses when reporting performance results
Measuring and reporting performance of parallel computers constitutes the basis for
scientific advancement of high-performance computing (HPC). Most scientific reports show …
scientific advancement of high-performance computing (HPC). Most scientific reports show …
From repeatability to reproducibility and corroboration
DG Feitelson - ACM SIGOPS Operating Systems Review, 2015 - dl.acm.org
Being able to repeat experiments is considered a hallmark of the scientific method, used to
confirm or refute hypotheses and previously obtained results. But this can take many forms …
confirm or refute hypotheses and previously obtained results. But this can take many forms …
Computational reproducibility: state-of-the-art, challenges, and database research opportunities
Computational experiments have become an integral part of the scientific method, but
reproducing, archiving, and querying them is still a challenge. The first barrier to a wider …
reproducing, archiving, and querying them is still a challenge. The first barrier to a wider …
Experiment databases: A new way to share, organize and learn from experiments
Thousands of machine learning research papers contain extensive experimental
comparisons. However, the details of those experiments are often lost after publication …
comparisons. However, the details of those experiments are often lost after publication …
Quickstep: A data platform based on the scaling-up approach
Modern servers pack enough storage and computing power that just a decade ago was
spread across a modest-sized cluster. This paper presents a prototype system, called …
spread across a modest-sized cluster. This paper presents a prototype system, called …
The open international soccer database for machine learning
How well can machine learning predict the outcome of a soccer game, given the most
commonly and freely available match data? To help answer this question and to facilitate …
commonly and freely available match data? To help answer this question and to facilitate …
Repeatability and workability evaluation of SIGMOD 2011
SIGMOD has offered, since 2008, to verify the experiments published in the papers accepted
at the conference. This year, we have been in charge of reproducing the experiments …
at the conference. This year, we have been in charge of reproducing the experiments …
[PDF][PDF] Trust but verify: How to leverage policies, workflows, and infrastructure to ensure computational reproducibility in publication
This article distills findings from a qualitative study of seven reproducibility initiatives to
enumerate nine key decision points for journals seeking to address concerns about the …
enumerate nine key decision points for journals seeking to address concerns about the …