[HTML][HTML] A survey on computationally efficient neural architecture search

S Liu, H Zhang, Y Jin - Journal of Automation and Intelligence, 2022 - Elsevier
Neural architecture search (NAS) has become increasingly popular in the deep learning
community recently, mainly because it can provide an opportunity to allow interested users …

Efficient Deep Learning Infrastructures for Embedded Computing Systems: A Comprehensive Survey and Future Envision

X Luo, D Liu, H Kong, S Huai, H Chen… - ACM Transactions on …, 2024 - dl.acm.org
Deep neural networks (DNNs) have recently achieved impressive success across a wide
range of real-world vision and language processing tasks, spanning from image …

Deep multitask learning with progressive parameter sharing

H Shi, S Ren, T Zhang, SJ Pan - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
We propose a novel progressive parameter-sharing strategy (MPPS) in this paper for
effectively training multitask learning models on diverse computer vision tasks …

Pa&da: Jointly sampling path and data for consistent nas

S Lu, Y Hu, L Yang, Z Sun, J Mei… - Proceedings of the …, 2023 - openaccess.thecvf.com
Based on the weight-sharing mechanism, one-shot NAS methods train a supernet and then
inherit the pre-trained weights to evaluate sub-models, largely reducing the search cost …

Learning to compose superweights for neural parameter allocation search

P Teterwak, S Nelson, N Dryden… - Proceedings of the …, 2024 - openaccess.thecvf.com
Neural parameter allocation search (NPAS) automates parameter sharing by obtaining
weights for a network given an arbitrary, fixed parameter budget. Prior work has two major …

Nas-lid: Efficient neural architecture search with local intrinsic dimension

X He, J Yao, Y Wang, Z Tang, KC Cheung… - Proceedings of the …, 2023 - ojs.aaai.org
One-shot neural architecture search (NAS) substantially improves the search efficiency by
training one supernet to estimate the performance of every possible child architecture (ie …

TA-GATES: An encoding scheme for neural network architectures

X Ning, Z Zhou, J Zhao, T Zhao… - Advances in …, 2022 - proceedings.neurips.cc
Neural architecture search tries to shift the manual design of neural network (NN)
architectures to algorithmic design. In these cases, the NN architecture itself can be viewed …

An effective one-shot neural architecture search method with supernet fine-tuning for image classification

G Yuan, B Xue, M Zhang - Proceedings of the Genetic and Evolutionary …, 2023 - dl.acm.org
Neural architecture search (NAS) is becoming increasingly popular for its ability to
automatically search for an appropriate network architecture, avoiding laborious manual …

A generic graph-based neural architecture encoding scheme with multifaceted information

X Ning, Y Zheng, Z Zhou, T Zhao… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Neural architecture search (NAS) can automatically discover well-performing architectures
in a large search space and has been shown to bring improvements to various applications …

Let's Be Self-generated via Step by Step: A Curriculum Learning Approach to Automated Reasoning with Large Language Models

K Luo, Z Ding, Z Weng, L Qiao, M Zhao, X Li… - arXiv preprint arXiv …, 2024 - arxiv.org
While Chain of Thought (CoT) prompting approaches have significantly consolidated the
reasoning capabilities of large language models (LLMs), they still face limitations that …