A comprehensive survey of neural architecture search: Challenges and solutions

P Ren, Y Xiao, X Chang, PY Huang, Z Li… - ACM Computing …, 2021 - dl.acm.org
Deep learning has made substantial breakthroughs in many fields due to its powerful
automatic representation capabilities. It has been proven that neural architecture design is …

A review of neural architecture search

D Baymurzina, E Golikov, M Burtsev - Neurocomputing, 2022 - Elsevier
Despite the impressive progress in neural network architecture design, improving the
performance of the existing state-of-the-art models has become increasingly challenging …

AutoML: A survey of the state-of-the-art

X He, K Zhao, X Chu - Knowledge-based systems, 2021 - Elsevier
Deep learning (DL) techniques have obtained remarkable achievements on various tasks,
such as image recognition, object detection, and language modeling. However, building a …

Pc-darts: Partial channel connections for memory-efficient architecture search

Y Xu, L Xie, X Zhang, X Chen, GJ Qi, Q Tian… - arXiv preprint arXiv …, 2019 - arxiv.org
Differentiable architecture search (DARTS) provided a fast solution in finding effective
network architectures, but suffered from large memory and computing overheads in jointly …

Investigating bi-level optimization for learning and vision from a unified perspective: A survey and beyond

R Liu, J Gao, J Zhang, D Meng… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Bi-Level Optimization (BLO) is originated from the area of economic game theory and then
introduced into the optimization community. BLO is able to handle problems with a …

Neural architecture search on imagenet in four gpu hours: A theoretically inspired perspective

W Chen, X Gong, Z Wang - arXiv preprint arXiv:2102.11535, 2021 - arxiv.org
Neural Architecture Search (NAS) has been explosively studied to automate the discovery of
top-performer neural networks. Current works require heavy training of supernet or intensive …

b-darts: Beta-decay regularization for differentiable architecture search

P Ye, B Li, Y Li, T Chen, J Fan… - proceedings of the …, 2022 - openaccess.thecvf.com
Abstract Neural Architecture Search (NAS) has attracted increasingly more attention in
recent years because of its capability to design deep neural network automatically. Among …

Neural architecture search: Insights from 1000 papers

C White, M Safari, R Sukthanker, B Ru, T Elsken… - arXiv preprint arXiv …, 2023 - arxiv.org
In the past decade, advances in deep learning have resulted in breakthroughs in a variety of
areas, including computer vision, natural language understanding, speech recognition, and …

DC-BENCH: Dataset condensation benchmark

J Cui, R Wang, S Si, CJ Hsieh - Advances in Neural …, 2022 - proceedings.neurips.cc
Dataset Condensation is a newly emerging technique aiming at learning a tiny dataset that
captures the rich information encoded in the original dataset. As the size of datasets …

Lighttrack: Finding lightweight neural networks for object tracking via one-shot architecture search

B Yan, H Peng, K Wu, D Wang… - Proceedings of the …, 2021 - openaccess.thecvf.com
Object tracking has achieved significant progress over the past few years. However, state-of-
the-art trackers become increasingly heavy and expensive, which limits their deployments in …