An introduction to neural architecture search for convolutional networks

G Kyriakides, K Margaritis - arXiv preprint arXiv:2005.11074, 2020 - arxiv.org
Neural Architecture Search (NAS) is a research field concerned with utilizing optimization
algorithms to design optimal neural network architectures. There are many approaches …

A comprehensive survey of neural architecture search: Challenges and solutions

P Ren, Y Xiao, X Chang, PY Huang, Z Li… - ACM Computing …, 2021 - dl.acm.org
Deep learning has made substantial breakthroughs in many fields due to its powerful
automatic representation capabilities. It has been proven that neural architecture design is …

A framework for exploring and modeling neural architecture search methods

P Radiuk, N Hrypynska - 2020 - elar.khmnu.edu.ua
Анотація For the past years, many researchers and engineers have been developing and
optimising deep neural networks (DNN). The process of neural architecture design and …

A review of neural architecture search

D Baymurzina, E Golikov, M Burtsev - Neurocomputing, 2022 - Elsevier
Despite the impressive progress in neural network architecture design, improving the
performance of the existing state-of-the-art models has become increasingly challenging …

Neural architecture search benchmarks: Insights and survey

KT Chitty-Venkata, M Emani, V Vishwanath… - IEEE …, 2023 - ieeexplore.ieee.org
Neural Architecture Search (NAS), a promising and fast-moving research field, aims to
automate the architectural design of Deep Neural Networks (DNNs) to achieve better …

Neural architecture search: Insights from 1000 papers

C White, M Safari, R Sukthanker, B Ru, T Elsken… - arXiv preprint arXiv …, 2023 - arxiv.org
In the past decade, advances in deep learning have resulted in breakthroughs in a variety of
areas, including computer vision, natural language understanding, speech recognition, and …

A technical view on neural architecture search

YQ Hu, Y Yu - International Journal of Machine Learning and …, 2020 - Springer
Due to the discovery of innovative and practical neural architectures, deep learning has
achieved bright successes in many fields, such as computer vision, natural language …

Nats-bench: Benchmarking nas algorithms for architecture topology and size

X Dong, L Liu, K Musial… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Neural architecture search (NAS) has attracted a lot of attention and has been illustrated to
bring tangible benefits in a large number of applications in the past few years. Architecture …

Best practices for scientific research on neural architecture search

M Lindauer, F Hutter - Journal of Machine Learning Research, 2020 - jmlr.org
Finding a well-performing architecture is often tedious for both deep learning practitioners
and researchers, leading to tremendous interest in the automation of this task by means of …

Weight-sharing neural architecture search: A battle to shrink the optimization gap

L Xie, X Chen, K Bi, L Wei, Y Xu, L Wang… - ACM Computing …, 2021 - dl.acm.org
Neural architecture search (NAS) has attracted increasing attention. In recent years,
individual search methods have been replaced by weight-sharing search methods for higher …