Hyperparameter optimization: Foundations, algorithms, best practices, and open challenges

B Bischl, M Binder, M Lang, T Pielok… - … : Data Mining and …, 2023 - Wiley Online Library
Most machine learning algorithms are configured by a set of hyperparameters whose values
must be carefully chosen and which often considerably impact performance. To avoid a time …

Hyper-parameter optimization: A review of algorithms and applications

T Yu, H Zhu - arXiv preprint arXiv:2003.05689, 2020 - arxiv.org
Since deep neural networks were developed, they have made huge contributions to
everyday lives. Machine learning provides more rational advice than humans are capable of …

[PDF][PDF] Hyperparameter optimization

M Feurer, F Hutter - Automated machine learning: Methods …, 2019 - library.oapen.org
Recent interest in complex and computationally expensive machine learning models with
many hyperparameters, such as automated machine learning (AutoML) frameworks and …

[图书][B] Automated machine learning: methods, systems, challenges

F Hutter, L Kotthoff, J Vanschoren - 2019 - library.oapen.org
This open access book presents the first comprehensive overview of general methods in
Automated Machine Learning (AutoML), collects descriptions of existing systems based on …

Auto-sklearn 2.0: Hands-free automl via meta-learning

M Feurer, K Eggensperger, S Falkner… - Journal of Machine …, 2022 - jmlr.org
Automated Machine Learning (AutoML) supports practitioners and researchers with the
tedious task of designing machine learning pipelines and has recently achieved substantial …

Neural architecture search: A survey

T Elsken, JH Metzen, F Hutter - Journal of Machine Learning Research, 2019 - jmlr.org
Deep Learning has enabled remarkable progress over the last years on a variety of tasks,
such as image recognition, speech recognition, and machine translation. One crucial aspect …

A tutorial on Bayesian optimization

PI Frazier - arXiv preprint arXiv:1807.02811, 2018 - arxiv.org
Bayesian optimization is an approach to optimizing objective functions that take a long time
(minutes or hours) to evaluate. It is best-suited for optimization over continuous domains of …

BOHB: Robust and efficient hyperparameter optimization at scale

S Falkner, A Klein, F Hutter - International conference on …, 2018 - proceedings.mlr.press
Modern deep learning methods are very sensitive to many hyperparameters, and, due to the
long training times of state-of-the-art models, vanilla Bayesian hyperparameter optimization …

[PDF][PDF] Taking human out of learning applications: A survey on automated machine learning

Q Yao, M Wang, Y Chen, W Dai, YF Li… - arXiv preprint arXiv …, 2018 - academia.edu
Machine learning techniques have deeply rooted in our everyday life. However, since it is
knowledge-and labor-intensive to pursue good learning performance, humans are heavily …

Benchmark and survey of automated machine learning frameworks

MA Zöller, MF Huber - Journal of artificial intelligence research, 2021 - jair.org
Abstract Machine learning (ML) has become a vital part in many aspects of our daily life.
However, building well performing machine learning applications requires highly …