A comprehensive survey of neural architecture search: Challenges and solutions

P Ren, Y Xiao, X Chang, PY Huang, Z Li… - ACM Computing …, 2021 - dl.acm.org
Deep learning has made substantial breakthroughs in many fields due to its powerful
automatic representation capabilities. It has been proven that neural architecture design is …

Neural architecture search survey: A computer vision perspective

JS Kang, JK Kang, JJ Kim, KW Jeon, HJ Chung… - Sensors, 2023 - mdpi.com
In recent years, deep learning (DL) has been widely studied using various methods across
the globe, especially with respect to training methods and network structures, proving highly …

Best practices for scientific research on neural architecture search

M Lindauer, F Hutter - Journal of Machine Learning Research, 2020 - jmlr.org
Finding a well-performing architecture is often tedious for both deep learning practitioners
and researchers, leading to tremendous interest in the automation of this task by means of …

Weight-sharing neural architecture search: A battle to shrink the optimization gap

L Xie, X Chen, K Bi, L Wei, Y Xu, L Wang… - ACM Computing …, 2021 - dl.acm.org
Neural architecture search (NAS) has attracted increasing attention. In recent years,
individual search methods have been replaced by weight-sharing search methods for higher …

Neural architecture search benchmarks: Insights and survey

KT Chitty-Venkata, M Emani, V Vishwanath… - IEEE …, 2023 - ieeexplore.ieee.org
Neural Architecture Search (NAS), a promising and fast-moving research field, aims to
automate the architectural design of Deep Neural Networks (DNNs) to achieve better …

Neural architecture search: Insights from 1000 papers

C White, M Safari, R Sukthanker, B Ru, T Elsken… - arXiv preprint arXiv …, 2023 - arxiv.org
In the past decade, advances in deep learning have resulted in breakthroughs in a variety of
areas, including computer vision, natural language understanding, speech recognition, and …

A review of neural architecture search

D Baymurzina, E Golikov, M Burtsev - Neurocomputing, 2022 - Elsevier
Despite the impressive progress in neural network architecture design, improving the
performance of the existing state-of-the-art models has become increasingly challenging …

An introduction to neural architecture search for convolutional networks

G Kyriakides, K Margaritis - arXiv preprint arXiv:2005.11074, 2020 - arxiv.org
Neural Architecture Search (NAS) is a research field concerned with utilizing optimization
algorithms to design optimal neural network architectures. There are many approaches …

A survey on evolutionary neural architecture search

Y Liu, Y Sun, B Xue, M Zhang, GG Yen… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Deep neural networks (DNNs) have achieved great success in many applications. The
architectures of DNNs play a crucial role in their performance, which is usually manually …

Neural architecture search: A survey

T Elsken, JH Metzen, F Hutter - Journal of Machine Learning Research, 2019 - jmlr.org
Deep Learning has enabled remarkable progress over the last years on a variety of tasks,
such as image recognition, speech recognition, and machine translation. One crucial aspect …