Emq: Evolving training-free proxies for automated mixed precision quantization

P Dong, L Li, Z Wei, X Niu, Z Tian… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Mixed-Precision Quantization (MQ) can achieve a competitive accuracy-complexity
trade-off for models. Conventional training-based search methods require time-consuming …

Nas-bench-suite-zero: Accelerating research on zero cost proxies

A Krishnakumar, C White, A Zela… - Advances in …, 2022 - proceedings.neurips.cc
Zero-cost proxies (ZC proxies) are a recent architecture performance prediction technique
aiming to significantly speed up algorithms for neural architecture search (NAS). Recent …

[HTML][HTML] Training-free neural architecture search: a review

MT Wu, CW Tsai - ICT Express, 2023 - Elsevier
The goal of neural architecture search (NAS) is to either downsize the neural architecture
and model of a deep neural network (DNN), adjust a neural architecture to improve its end …

Evaluating efficient performance estimators of neural architectures

X Ning, C Tang, W Li, Z Zhou, S Liang… - Advances in …, 2021 - proceedings.neurips.cc
Conducting efficient performance estimations of neural architectures is a major challenge in
neural architecture search (NAS). To reduce the architecture training costs in NAS, one-shot …

Zico: Zero-shot nas via inverse coefficient of variation on gradients

G Li, Y Yang, K Bhardwaj, R Marculescu - arXiv preprint arXiv:2301.11300, 2023 - arxiv.org
Neural Architecture Search (NAS) is widely used to automatically obtain the neural network
with the best performance among a large number of candidate architectures. To reduce the …

Manas: multi-agent neural architecture search

V Lopes, FM Carlucci, PM Esperança, M Singh… - Machine Learning, 2024 - Springer
Abstract The Neural Architecture Search (NAS) problem is typically formulated as a graph
search problem where the goal is to learn the optimal operations over edges in order to …

Efficient guided evolution for neural architecture search

V Lopes, M Santos, B Degardin… - Proceedings of the …, 2022 - dl.acm.org
Neural Architecture Search methods have been successfully applied to image tasks with
excellent results. However, NAS methods are often complex and tend to quickly converge for …

Freerea: Training-free evolution-based architecture search

N Cavagnero, L Robbiano… - Proceedings of the …, 2023 - openaccess.thecvf.com
In the last decade, most research in Machine Learning contributed to the improvement of
existing models, with the aim of increasing the performance of neural networks for the …

RD-NAS: Enhancing one-shot supernet ranking ability via ranking distillation from zero-cost proxies

P Dong, X Niu, L Li, Z Tian, X Wang… - ICASSP 2023-2023 …, 2023 - ieeexplore.ieee.org
Neural architecture search (NAS) has made tremendous progress in the automatic design of
effective neural network structures but suffers from a heavy computational burden. One-shot …

[HTML][HTML] Are neural architecture search benchmarks well designed? A deeper look into operation importance

V Lopes, B Degardin, LA Alexandre - Information Sciences, 2023 - Elsevier
Abstract Neural Architecture Search (NAS) benchmarks significantly improved the capability
of developing and comparing NAS methods while at the same time drastically reduced the …