Exploring randomly wired neural networks for image recognition

S Xie, A Kirillov, R Girshick… - Proceedings of the IEEE …, 2019 - openaccess.thecvf.com
Neural networks for image recognition have evolved through extensive manual design from
simple chain-like models to structures with multiple wiring paths. The success of ResNets …

On network design spaces for visual recognition

I Radosavovic, J Johnson, S Xie… - Proceedings of the …, 2019 - openaccess.thecvf.com
Over the past several years progress in designing better neural network architectures for
visual recognition has been substantial. To help sustain this rate of progress, in this work we …

Discovering neural wirings

M Wortsman, A Farhadi… - Advances in Neural …, 2019 - proceedings.neurips.cc
The success of neural networks has driven a shift in focus from feature engineering to
architecture engineering. However, successful networks today are constructed using a small …

A semi-supervised assessor of neural architectures

Y Tang, Y Wang, Y Xu, H Chen, B Shi… - proceedings of the …, 2020 - openaccess.thecvf.com
Neural architecture search (NAS) aims to automatically design deep neural networks of
satisfactory performance. Wherein, architecture performance predictor is critical to efficiently …

Learning implicitly recurrent CNNs through parameter sharing

P Savarese, M Maire - arXiv preprint arXiv:1902.09701, 2019 - arxiv.org
We introduce a parameter sharing scheme, in which different layers of a convolutional
neural network (CNN) are defined by a learned linear combination of parameter tensors …

Fbnetv3: Joint architecture-recipe search using predictor pretraining

X Dai, A Wan, P Zhang, B Wu, Z He… - Proceedings of the …, 2021 - openaccess.thecvf.com
Abstract Neural Architecture Search (NAS) yields state-of-the-art neural networks that
outperform their best manually-designed counterparts. However, previous NAS methods …

Fbnet: Hardware-aware efficient convnet design via differentiable neural architecture search

B Wu, X Dai, P Zhang, Y Wang, F Sun… - Proceedings of the …, 2019 - openaccess.thecvf.com
Designing accurate and efficient ConvNets for mobile devices is challenging because the
design space is combinatorially large. Due to this, previous neural architecture search (NAS) …

Neural architecture search on imagenet in four gpu hours: A theoretically inspired perspective

W Chen, X Gong, Z Wang - arXiv preprint arXiv:2102.11535, 2021 - arxiv.org
Neural Architecture Search (NAS) has been explosively studied to automate the discovery of
top-performer neural networks. Current works require heavy training of supernet or intensive …

Neural architecture search without training

J Mellor, J Turner, A Storkey… - … conference on machine …, 2021 - proceedings.mlr.press
The time and effort involved in hand-designing deep neural networks is immense. This has
prompted the development of Neural Architecture Search (NAS) techniques to automate this …

Single-path nas: Designing hardware-efficient convnets in less than 4 hours

D Stamoulis, R Ding, D Wang… - … Conference on Machine …, 2019 - Springer
Can we automatically design a Convolutional Network (ConvNet) with the highest image
classification accuracy under the latency constraint of a mobile device? Neural architecture …