Eight years of AutoML: categorisation, review and trends

R Barbudo, S Ventura, JR Romero - Knowledge and Information Systems, 2023 - Springer
Abstract Knowledge extraction through machine learning techniques has been successfully
applied in a large number of application domains. However, apart from the required …

Efficient automation of neural network design: A survey on differentiable neural architecture search

A Heuillet, A Nasser, H Arioui, H Tabia - ACM Computing Surveys, 2024 - dl.acm.org
In the past few years, Differentiable Neural Architecture Search (DNAS) rapidly imposed
itself as the trending approach to automate the discovery of deep neural network …

Neural architecture search for spiking neural networks

Y Kim, Y Li, H Park, Y Venkatesha, P Panda - European conference on …, 2022 - Springer
Abstract Spiking Neural Networks (SNNs) have gained huge attention as a potential energy-
efficient alternative to conventional Artificial Neural Networks (ANNs) due to their inherent …

Vitas: Vision transformer architecture search

X Su, S You, J Xie, M Zheng, F Wang, C Qian… - … on Computer Vision, 2022 - Springer
Vision transformers (ViTs) inherited the success of NLP but their structures have not been
sufficiently investigated and optimized for visual tasks. One of the simplest solutions is to …

Zico: Zero-shot nas via inverse coefficient of variation on gradients

G Li, Y Yang, K Bhardwaj, R Marculescu - arXiv preprint arXiv:2301.11300, 2023 - arxiv.org
Neural Architecture Search (NAS) is widely used to automatically obtain the neural network
with the best performance among a large number of candidate architectures. To reduce the …

Multi-task learning with multi-query transformer for dense prediction

Y Xu, X Li, H Yuan, Y Yang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Previous multi-task dense prediction studies developed complex pipelines such as multi-
modal distillations in multiple stages or searching for task relational contexts for each task …

Shapley-NAS: Discovering operation contribution for neural architecture search

H Xiao, Z Wang, Z Zhu, J Zhou… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
In this paper, we propose a Shapley value based method to evaluate operation contribution
(Shapley-NAS) for neural architecture search. Differentiable architecture search (DARTS) …

Prioritized architecture sampling with monto-carlo tree search

X Su, T Huang, Y Li, S You, F Wang… - Proceedings of the …, 2021 - openaccess.thecvf.com
One-shot neural architecture search (NAS) methods significantly reduce the search cost by
considering the whole search space as one network, which only needs to be trained once …

[HTML][HTML] Neural architecture search: A contemporary literature review for computer vision applications

M Poyser, TP Breckon - Pattern Recognition, 2024 - Elsevier
Abstract Deep Neural Networks have received considerable attention in recent years. As the
complexity of network architecture increases in relation to the task complexity, it becomes …

K-shot nas: Learnable weight-sharing for nas with k-shot supernets

X Su, S You, M Zheng, F Wang… - International …, 2021 - proceedings.mlr.press
In one-shot weight sharing for NAS, the weights of each operation (at each layer) are
supposed to be identical for all architectures (paths) in the supernet. However, this rules out …