A comprehensive survey of neural architecture search: Challenges and solutions

P Ren, Y Xiao, X Chang, PY Huang, Z Li… - ACM Computing …, 2021 - dl.acm.org
Deep learning has made substantial breakthroughs in many fields due to its powerful
automatic representation capabilities. It has been proven that neural architecture design is …

[HTML][HTML] Automated machine learning: Review of the state-of-the-art and opportunities for healthcare

J Waring, C Lindvall, R Umeton - Artificial intelligence in medicine, 2020 - Elsevier
Objective This work aims to provide a review of the existing literature in the field of
automated machine learning (AutoML) to help healthcare professionals better utilize …

Grid search, random search, genetic algorithm: a big comparison for NAS

P Liashchynskyi, P Liashchynskyi - arXiv preprint arXiv:1912.06059, 2019 - arxiv.org
In this paper, we compare the three most popular algorithms for hyperparameter
optimization (Grid Search, Random Search, and Genetic Algorithm) and attempt to use them …

AutoML: A survey of the state-of-the-art

X He, K Zhao, X Chu - Knowledge-based systems, 2021 - Elsevier
Deep learning (DL) techniques have obtained remarkable achievements on various tasks,
such as image recognition, object detection, and language modeling. However, building a …

Model compression and hardware acceleration for neural networks: A comprehensive survey

L Deng, G Li, S Han, L Shi, Y Xie - Proceedings of the IEEE, 2020 - ieeexplore.ieee.org
Domain-specific hardware is becoming a promising topic in the backdrop of improvement
slow down for general-purpose processors due to the foreseeable end of Moore's Law …

Proxylessnas: Direct neural architecture search on target task and hardware

H Cai, L Zhu, S Han - arXiv preprint arXiv:1812.00332, 2018 - arxiv.org
Neural architecture search (NAS) has a great impact by automatically designing effective
neural network architectures. However, the prohibitive computational demand of …

Haq: Hardware-aware automated quantization with mixed precision

K Wang, Z Liu, Y Lin, J Lin… - Proceedings of the IEEE …, 2019 - openaccess.thecvf.com
Abstract Model quantization is a widely used technique to compress and accelerate deep
neural network (DNN) inference. Emergent DNN hardware accelerators begin to support …

Neural architecture search: Insights from 1000 papers

C White, M Safari, R Sukthanker, B Ru, T Elsken… - arXiv preprint arXiv …, 2023 - arxiv.org
In the past decade, advances in deep learning have resulted in breakthroughs in a variety of
areas, including computer vision, natural language understanding, speech recognition, and …

Neural architecture search: A survey

T Elsken, JH Metzen, F Hutter - Journal of Machine Learning Research, 2019 - jmlr.org
Deep Learning has enabled remarkable progress over the last years on a variety of tasks,
such as image recognition, speech recognition, and machine translation. One crucial aspect …

b-darts: Beta-decay regularization for differentiable architecture search

P Ye, B Li, Y Li, T Chen, J Fan… - proceedings of the …, 2022 - openaccess.thecvf.com
Abstract Neural Architecture Search (NAS) has attracted increasingly more attention in
recent years because of its capability to design deep neural network automatically. Among …