" Get in Researchers; We're Measuring Reproducibility": A Reproducibility Study of Machine Learning Papers in Tier 1 Security Conferences

D Olszewski, A Lu, C Stillman, K Warren… - Proceedings of the …, 2023 - dl.acm.org
Reproducibility is crucial to the advancement of science; it strengthens confidence in
seemingly contradictory results and expands the boundaries of known discoveries …

A transferability study of interpolation-based hardware model checking for software verification

D Beyer, PC Chien, M Jankola, NZ Lee - Proceedings of the ACM on …, 2024 - dl.acm.org
Assuring the correctness of computing systems is fundamental to our society and economy,
and formal verification is a class of techniques approaching this issue with mathematical …

Longevity of Artifacts in Leading Parallel and Distributed Systems Conferences: a Review of the State of the Practice in 2023

Q Guilloteau, F Ciorba, M Poquet, D Goepp… - Proceedings of the 2nd …, 2024 - dl.acm.org
Reproducibility is the cornerstone of science. Many scientific communities have been struck
by the reproducibility crisis, and computer science is no exception. Its answer has been to …

Community expectations for research artifacts and evaluation processes

B Hermann, S Winter, J Siegmund - Proceedings of the 28th ACM joint …, 2020 - dl.acm.org
Background. Artifact evaluation has been introduced into the software engineering and
programming languages research community with a pilot at ESEC/FSE 2011 and has since …

A second look at the impact of passive voice requirements on domain modeling: Bayesian reanalysis of an experiment

J Frattini, D Fucci, R Torkar, D Mendez - Proceedings of the 1st IEEE …, 2024 - dl.acm.org
The quality of requirements specifications may impact subsequent, dependent software
engineering (SE) activities. However, empirical evidence of this impact remains scarce and …

Replication in Requirements Engineering: The NLP for RE Case

S Abualhaija, FB Aydemir, F Dalpiaz… - ACM Transactions on …, 2024 - dl.acm.org
Natural language processing (NLP) techniques have been widely applied in the
requirements engineering (RE) field to support tasks such as classification and ambiguity …

What has artifact evaluation ever done for us?

B Hermann - IEEE Security & Privacy, 2022 - ieeexplore.ieee.org
Artifact evaluation is an established peer review practice in several fields of computer
science research. In the security field it only has been introduced recently. The author …

[HTML][HTML] Requirements quality research artifacts: Recovery, analysis, and management guideline

J Frattini, L Montgomery, D Fucci… - Journal of Systems and …, 2024 - Elsevier
Requirements quality research, which is dedicated to assessing and improving the quality of
requirements specifications, is dependent on research artifacts like data sets (containing …

[HTML][HTML] Research artifacts for human-oriented experiments in software engineering: An ACM badges-driven structure proposal

C Guevara-Vega, B Bernárdez, M Cruz, A Durán… - Journal of Systems and …, 2024 - Elsevier
Abstract Context: The Open Science (OS) movement promotes the value of making public
the research artifacts (datasets, analysis scripts, guidelines, etc.) used during empirical …

Extract, model, refine: improved modelling of program verification tools through data enrichment

S Lathouwers, Y Liu, V Zaytsev - Software and Systems Modeling, 2025 - Springer
In software engineering, models are used for many different things. In this paper, we focus
on program verification, where we use models to reason about the correctness of systems …