[HTML][HTML] A systematic literature review on benchmarks for evaluating debugging approaches

T Hirsch, B Hofer - Journal of Systems and Software, 2022 - Elsevier
Bug benchmarks are used in development and evaluation of debugging approaches, eg
fault localization and automated repair. Quantitative performance comparison of different …

Understanding memory and thread safety practices and issues in real-world Rust programs

B Qin, Y Chen, Z Yu, L Song, Y Zhang - Proceedings of the 41st ACM …, 2020 - dl.acm.org
Rust is a young programming language designed for systems software development. It aims
to provide safety guarantees like high-level languages and performance efficiency like low …

Understanding real-world concurrency bugs in go

T Tu, X Liu, L Song, Y Zhang - Proceedings of the twenty-fourth …, 2019 - dl.acm.org
Go is a statically-typed programming language that aims to provide a simple, efficient, and
safe way to build multi-threaded software. Since its creation in 2009, Go has matured and …

SecBench. js: An executable security benchmark suite for server-side JavaScript

MHM Bhuiyan, AS Parthasarathy… - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
NPM is the largest software ecosystem in the world, offering millions of free, reusable
packages. In recent years, various security threats to packages published on npm have …

Gobench: A benchmark suite of real-world go concurrency bugs

T Yuan, G Li, J Lu, C Liu, L Li… - 2021 IEEE/ACM …, 2021 - ieeexplore.ieee.org
Go, a fast growing programming language, is often considered as “the programming
language of the cloud”. The language provides a rich set of synchronization primitives …

A survey of recent trends in testing concurrent software systems

FA Bianchi, A Margara, M Pezzè - IEEE Transactions on …, 2017 - ieeexplore.ieee.org
Many modern software systems are composed of multiple execution flows that run
simultaneously, spanning from applications designed to exploit the power of modern multi …

Bugs in machine learning-based systems: a faultload benchmark

MM Morovati, A Nikanjam, F Khomh… - Empirical Software …, 2023 - Springer
The rapid escalation of applying Machine Learning (ML) in various domains has led to
paying more attention to the quality of ML components. There is then a growth of techniques …

Sound deadlock prediction

CG Kalhauge, J Palsberg - Proceedings of the ACM on Programming …, 2018 - dl.acm.org
For a concurrent program, a prediction tool maps the history of a single run to a prediction of
bugs in an exponential number of other runs. If all those bugs can occur, then the tool is …

Code4Bench: A multidimensional benchmark of Codeforces data for different program analysis techniques

A Majd, M Vahidi-Asl, A Khalilian… - Journal of Computer …, 2019 - Elsevier
Reproducible research relies on well-designed benchmarks. However, evaluation on a
single benchmark increases the risk of overfitting; that is, an optimization to reach a certain …

Lazy diagnosis of in-production concurrency bugs

B Kasikci, W Cui, X Ge, B Niu - Proceedings of the 26th Symposium on …, 2017 - dl.acm.org
Diagnosing concurrency bugs---the process of understanding the root causes of
concurrency failures---is hard. Developers depend on reproducing concurrency bugs to …