Simmatch: Semi-supervised learning with similarity matching

M Zheng, S You, L Huang, F Wang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Learning with few labeled data has been a longstanding problem in the computer vision and
machine learning research community. In this paper, we introduced a new semi-supervised …

Mngnas: distilling adaptive combination of multiple searched networks for one-shot neural architecture search

Z Chen, G Qiu, P Li, L Zhu, X Yang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Recently neural architecture (NAS) search has attracted great interest in academia and
industry. It remains a challenging problem due to the huge search space and computational …

Can gpt-4 perform neural architecture search?

M Zheng, X Su, S You, F Wang, C Qian, C Xu… - arXiv preprint arXiv …, 2023 - arxiv.org
We investigate the potential of GPT-4~\cite {gpt4} to perform Neural Architecture Search
(NAS)--the task of designing effective neural architectures. Our proposed approach,\textbf …

Re-mine, learn and reason: Exploring the cross-modal semantic correlations for language-guided hoi detection

Y Cao, Q Tang, F Yang, X Su, S You… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Human-Object Interaction (HOI) detection is a challenging computer vision task that
requires visual models to address the complex interactive relationship between humans and …

Using large language models for hyperparameter optimization

MR Zhang, N Desai, J Bae, J Lorraine… - … 2023 Foundation Models …, 2023 - openreview.net
This paper studies using foundational large language models (LLMs) to make decisions
during hyperparameter optimization (HPO). Empirical evaluations demonstrate that in …

Lightvit: Towards light-weight convolution-free vision transformers

T Huang, L Huang, S You, F Wang, C Qian… - arXiv preprint arXiv …, 2022 - arxiv.org
Vision transformers (ViTs) are usually considered to be less light-weight than convolutional
neural networks (CNNs) due to the lack of inductive bias. Recent works thus resort to …

Vitas: Vision transformer architecture search

X Su, S You, J Xie, M Zheng, F Wang, C Qian… - … on Computer Vision, 2022 - Springer
Vision transformers (ViTs) inherited the success of NLP but their structures have not been
sufficiently investigated and optimized for visual tasks. One of the simplest solutions is to …

Nas-bench-suite: Nas evaluation is (now) surprisingly easy

Y Mehta, C White, A Zela, A Krishnakumar… - arXiv preprint arXiv …, 2022 - arxiv.org
The release of tabular benchmarks, such as NAS-Bench-101 and NAS-Bench-201, has
significantly lowered the computational overhead for conducting scientific research in neural …

Dyrep: Bootstrapping training with dynamic re-parameterization

T Huang, S You, B Zhang, Y Du… - Proceedings of the …, 2022 - openaccess.thecvf.com
Structural re-parameterization (Rep) methods achieve noticeable improvements on simple
VGG-style networks. Despite the prevalence, current Rep methods simply re-parameterize …

Neural architecture search benchmarks: Insights and survey

KT Chitty-Venkata, M Emani, V Vishwanath… - IEEE …, 2023 - ieeexplore.ieee.org
Neural Architecture Search (NAS), a promising and fast-moving research field, aims to
automate the architectural design of Deep Neural Networks (DNNs) to achieve better …