Continuous integration (CI) emphasizes quick feedback to developers. This is at odds with
current practice of performance testing, which predominantely focuses on long-running tests …

Executing software microbenchmarks, a form of small-scale performance tests
predominantly used for libraries and frameworks, is a costly endeavor. Full benchmark …

Rigorous performance engineering traditionally assumes measuring on bare-metal
environments to control for as many confounding factors as possible. Unfortunately, some …

Microbenchmarking is a widely used form of performance testing in Java software. A
microbenchmark repeatedly executes a small chunk of code while collecting measurements …

Software performance changes are costly and often hard to detect pre-release. Similar to
software testing frameworks, either application benchmarks or microbenchmarks can be …

Microbenchmarking evaluates, in isolation, the execution time of small code segments that
play a critical role in large applications. The accuracy of a microbenchmark depends on two …

The usage of open source (OS) software is wide-spread across many industries. While the
functional quality of OS projects is considered to be similar to closed-source software, much …

Software performance testing is an essential quality assurance mechanism that can identify
optimization opportunities. Automating this process requires strong tool support, especially …

We present an automated performance evaluation framework that enables an automated
workflow for testing and performance evaluation of software libraries. Integrating this …

Abstract Evaluation methodology underpins all innovation in experimental computer
science. It requires relevant workloads, appropriate experimental design, and rigorous …