Towards effective assessment of steady state performance in Java software: are we there yet?

L Traini, V Cortellessa, D Di Pompeo… - Empirical Software …, 2023 - Springer
Microbenchmarking is a widely used form of performance testing in Java software. A
microbenchmark repeatedly executes a small chunk of code while collecting measurements …

A configurable method for benchmarking scalability of cloud-native applications

S Henning, W Hasselbring - Empirical Software Engineering, 2022 - Springer
Cloud-native applications constitute a recent trend for designing large-scale software
systems. However, even though several cloud-native tools and patterns have emerged to …

Microservices: A performance tester's dream or nightmare?

S Eismann, CP Bezemer, W Shang… - Proceedings of the …, 2020 - dl.acm.org
In recent years, there has been a shift in software development towards microservice-based
architectures, which consist of small services that focus on one particular functionality. Many …

Predicting unstable software benchmarks using static source code features

C Laaber, M Basmaci, P Salza - Empirical Software Engineering, 2021 - Springer
Software benchmarks are only as good as the performance measurements they yield.
Unstable benchmarks show high variability among repeated measurements, which causes …

FOCloud: feature model guided performance prediction and explanation for deployment configurable cloud applications

I Kumara, MH Ariz, MB Chhetri… - IEEE Transactions …, 2022 - ieeexplore.ieee.org
The increasing heterogeneity of the VM offerings on public IaaS clouds gives rise to a very
large number of deployment options for constructing distributed, multi-component cloud …

Dynamically reconfiguring software microbenchmarks: Reducing execution time without sacrificing result quality

C Laaber, S Würsten, HC Gall, P Leitner - … of the 28th ACM Joint Meeting …, 2020 - dl.acm.org
Executing software microbenchmarks, a form of small-scale performance tests
predominantly used for libraries and frameworks, is a costly endeavor. Full benchmark …

Applying test case prioritization to software microbenchmarks

C Laaber, HC Gall, P Leitner - Empirical Software Engineering, 2021 - Springer
Regression testing comprises techniques which are applied during software evolution to
uncover faults effectively and efficiently. While regression testing is widely studied for …

Evaluating Search-Based Software Microbenchmark Prioritization

C Laaber, T Yue, S Ali - IEEE Transactions on Software …, 2024 - ieeexplore.ieee.org
Ensuring that software performance does not degrade after a code change is paramount. A
solution is to regularly execute software microbenchmarks, a performance testing technique …

Get Your Memory Right: The Crispy Resource Allocation Assistant for Large-Scale Data Processing

J Will, L Thamsen, J Bader… - … Conference on Cloud …, 2022 - ieeexplore.ieee.org
Distributed dataflow systems like Apache Spark and Apache Hadoop enable data-parallel
processing of large datasets on clusters. Yet, selecting appropriate computational resources …

Using microbenchmark suites to detect application performance changes

M Grambow, D Kovalev, C Laaber… - … on Cloud Computing, 2022 - ieeexplore.ieee.org
Software performance changes are costly and often hard to detect pre-release. Similar to
software testing frameworks, either application benchmarks or microbenchmarks can be …