Weight-sharing neural architecture search: A battle to shrink the optimization gap

L Xie, X Chen, K Bi, L Wei, Y Xu, L Wang… - ACM Computing …, 2021 - dl.acm.org
Neural architecture search (NAS) has attracted increasing attention. In recent years,
individual search methods have been replaced by weight-sharing search methods for higher …

Eight years of AutoML: categorisation, review and trends

R Barbudo, S Ventura, JR Romero - Knowledge and Information Systems, 2023 - Springer
Abstract Knowledge extraction through machine learning techniques has been successfully
applied in a large number of application domains. However, apart from the required …

Neural architecture search: Insights from 1000 papers

C White, M Safari, R Sukthanker, B Ru, T Elsken… - arXiv preprint arXiv …, 2023 - arxiv.org
In the past decade, advances in deep learning have resulted in breakthroughs in a variety of
areas, including computer vision, natural language understanding, speech recognition, and …

Brp-nas: Prediction-based nas using gcns

L Dudziak, T Chau, M Abdelfattah… - Advances in …, 2020 - proceedings.neurips.cc
Neural architecture search (NAS) enables researchers to automatically explore broad
design spaces in order to improve efficiency of neural networks. This efficiency is especially …

[PDF][PDF] Nas-bench-301 and the case for surrogate benchmarks for neural architecture search

J Siems, L Zimmer, A Zela, J Lukasik… - arXiv preprint arXiv …, 2020 - researchgate.net
ABSTRACT Neural Architecture Search (NAS) is a logical next step in the automatic learning
of representations, but the development of NAS methods is slowed by high computational …

How powerful are performance predictors in neural architecture search?

C White, A Zela, R Ru, Y Liu… - Advances in Neural …, 2021 - proceedings.neurips.cc
Early methods in the rapidly developing field of neural architecture search (NAS) required
fully training thousands of neural networks. To reduce this extreme computational cost …

Npenas: Neural predictor guided evolution for neural architecture search

C Wei, C Niu, Y Tang, Y Wang, H Hu… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Neural architecture search (NAS) adopts a search strategy to explore the predefined search
space to find superior architecture with the minimum searching costs. Bayesian optimization …

Evaluating efficient performance estimators of neural architectures

X Ning, C Tang, W Li, Z Zhou, S Liang… - Advances in …, 2021 - proceedings.neurips.cc
Conducting efficient performance estimations of neural architectures is a major challenge in
neural architecture search (NAS). To reduce the architecture training costs in NAS, one-shot …

Neural predictor based quantum architecture search

SX Zhang, CY Hsieh, S Zhang… - … Learning: Science and …, 2021 - iopscience.iop.org
Variational quantum algorithms (VQAs) are widely speculated to deliver quantum
advantages for practical problems under the quantum–classical hybrid computational …

Oms-dpm: Optimizing the model schedule for diffusion probabilistic models

E Liu, X Ning, Z Lin, H Yang… - … Conference on Machine …, 2023 - proceedings.mlr.press
Diffusion probabilistic models (DPMs) are a new class of generative models that have
achieved state-of-the-art generation quality in various domains. Despite the promise, one …