Benchmarking in optimization: Best practice and open issues

T Bartz-Beielstein, C Doerr, D Berg, J Bossek… - arXiv preprint arXiv …, 2020 - arxiv.org
This survey compiles ideas and recommendations from more than a dozen researchers with
different backgrounds and from different institutes around the world. Promoting best practice …

[HTML][HTML] Maximum number of generations as a stopping criterion considered harmful

M Ravber, SH Liu, M Mernik, M Črepinšek - Applied Soft Computing, 2022 - Elsevier
Evolutionary algorithms have been shown to be very effective in solving complex
optimization problems. This has driven the research community in the development of novel …

Per-run algorithm selection with warm-starting using trajectory-based features

A Kostovska, A Jankovic, D Vermetten… - … Conference on Parallel …, 2022 - Springer
Per-instance algorithm selection seeks to recommend, for a given problem instance and a
given performance criterion, one or several suitable algorithms that are expected to perform …

Evolutionary algorithms for parameter optimization—thirty years later

THW Bäck, AV Kononova, B van Stein… - Evolutionary …, 2023 - ieeexplore.ieee.org
Thirty years, 1993–2023, is a huge time frame in science. We address some major
developments in the field of evolutionary algorithms, with applications in parameter …

Iohexperimenter: Benchmarking platform for iterative optimization heuristics

J de Nobel, F Ye, D Vermetten, H Wang… - Evolutionary …, 2024 - direct.mit.edu
We present IOHexperimenter, the experimentation module of the IOHprofiler project.
IOHexperimenter aims at providing an easy-to-use and customizable toolbox for …

Tuning as a means of assessing the benefits of new ideas in interplay with existing algorithmic modules

J de Nobel, D Vermetten, H Wang, C Doerr… - Proceedings of the …, 2021 - dl.acm.org
Introducing new algorithmic ideas is a key part of the continuous improvement of existing
optimization algorithms. However, when introducing a new component into an existing …

[图书][B] Hyperparameter tuning for machine and deep learning with R: A practical guide

E Bartz, T Bartz-Beielstein, M Zaefferer, O Mersmann - 2023 - library.oapen.org
This open access book provides a wealth of hands-on examples that illustrate how
hyperparameter tuning can be applied in practice and gives deep insights into the working …

Explainable benchmarking for iterative optimization heuristics

N van Stein, D Vermetten, AV Kononova… - arXiv preprint arXiv …, 2024 - arxiv.org
Benchmarking heuristic algorithms is vital to understand under which conditions and on
what kind of problems certain algorithms perform well. In most current research into heuristic …

Optimizing with low budgets: A comparison on the black-box optimization benchmarking suite and openai gym

E Raponi, NC Rakotonirina, J Rapin… - IEEE Transactions …, 2023 - ieeexplore.ieee.org
The growing ubiquity of machine learning (ML) has led it to enter various areas of computer
science, including black-box optimization (BBO). Recent research is particularly concerned …

[PDF][PDF] MA-BBOB: Many-affine combinations of BBOB functions for evaluating automl approaches in noiseless numerical black-box optimization contexts

D Vermetten, F Ye, T Bäck… - … on Automated Machine …, 2023 - proceedings.mlr.press
Extending a recent suggestion to generate new instances for numerical black-box
optimization benchmarking by interpolating pairs of the well-established BBOB functions …