On hyperparameter optimization of machine learning algorithms: Theory and practice

L Yang, A Shami - Neurocomputing, 2020 - Elsevier
Abstract Machine learning algorithms have been used widely in various applications and
areas. To fit a machine learning model into different problems, its hyper-parameters must be …

A comprehensive survey of neural architecture search: Challenges and solutions

P Ren, Y Xiao, X Chang, PY Huang, Z Li… - ACM Computing …, 2021 - dl.acm.org
Deep learning has made substantial breakthroughs in many fields due to its powerful
automatic representation capabilities. It has been proven that neural architecture design is …

Hyper-parameter optimization: A review of algorithms and applications

T Yu, H Zhu - arXiv preprint arXiv:2003.05689, 2020 - arxiv.org
Since deep neural networks were developed, they have made huge contributions to
everyday lives. Machine learning provides more rational advice than humans are capable of …

[HTML][HTML] Automated machine learning: Review of the state-of-the-art and opportunities for healthcare

J Waring, C Lindvall, R Umeton - Artificial intelligence in medicine, 2020 - Elsevier
Objective This work aims to provide a review of the existing literature in the field of
automated machine learning (AutoML) to help healthcare professionals better utilize …

Revisiting neural scaling laws in language and vision

IM Alabdulmohsin, B Neyshabur… - Advances in Neural …, 2022 - proceedings.neurips.cc
The remarkable progress in deep learning in recent years is largely driven by improvements
in scale, where bigger models are trained on larger datasets for longer schedules. To predict …

Optuna: A next-generation hyperparameter optimization framework

T Akiba, S Sano, T Yanase, T Ohta… - Proceedings of the 25th …, 2019 - dl.acm.org
The purpose of this study is to introduce new design-criteria for next-generation
hyperparameter optimization software. The criteria we propose include (1) define-by-run API …

AutoML: A survey of the state-of-the-art

X He, K Zhao, X Chu - Knowledge-based systems, 2021 - Elsevier
Deep learning (DL) techniques have obtained remarkable achievements on various tasks,
such as image recognition, object detection, and language modeling. However, building a …

Closed-loop optimization of fast-charging protocols for batteries with machine learning

PM Attia, A Grover, N Jin, KA Severson, TM Markov… - Nature, 2020 - nature.com
Simultaneously optimizing many design parameters in time-consuming experiments causes
bottlenecks in a broad range of scientific and engineering disciplines,. One such example is …

[PDF][PDF] Hyperparameter optimization

M Feurer, F Hutter - Automated machine learning: Methods …, 2019 - library.oapen.org
Recent interest in complex and computationally expensive machine learning models with
many hyperparameters, such as automated machine learning (AutoML) frameworks and …

Auto-sklearn 2.0: Hands-free automl via meta-learning

M Feurer, K Eggensperger, S Falkner… - Journal of Machine …, 2022 - jmlr.org
Automated Machine Learning (AutoML) supports practitioners and researchers with the
tedious task of designing machine learning pipelines and has recently achieved substantial …