Graph neural networks: Taxonomy, advances, and trends

Y Zhou, H Zheng, X Huang, S Hao, D Li… - ACM Transactions on …, 2022 - dl.acm.org
Graph neural networks provide a powerful toolkit for embedding real-world graphs into low-
dimensional spaces according to specific tasks. Up to now, there have been several surveys …

Parameter prediction for unseen deep architectures

B Knyazev, M Drozdzal, GW Taylor… - Advances in …, 2021 - proceedings.neurips.cc
Deep learning has been successful in automating the design of features in machine learning
pipelines. However, the algorithms optimizing neural network parameters remain largely …

AutoCTS: Automated correlated time series forecasting

X Wu, D Zhang, C Guo, C He, B Yang… - Proceedings of the VLDB …, 2021 - vbn.aau.dk
Correlated time series (CTS) forecasting plays an essential role in many cyber-physical
systems, where multiple sensors emit time series that capture interconnected processes …

Pinat: A permutation invariance augmented transformer for nas predictor

S Lu, Y Hu, P Wang, Y Han, J Tan, J Li… - Proceedings of the …, 2023 - ojs.aaai.org
Time-consuming performance evaluation is the bottleneck of traditional Neural Architecture
Search (NAS) methods. Predictor-based NAS can speed up performance evaluation by …

TNASP: A Transformer-based NAS Predictor with a Self-evolution Framework

S Lu, J Li, J Tan, S Yang, J Liu - Advances in Neural …, 2021 - proceedings.neurips.cc
Abstract Predictor-based Neural Architecture Search (NAS) continues to be an important
topic because it aims to mitigate the time-consuming search procedure of traditional NAS …

Differentiable feature aggregation search for knowledge distillation

Y Guan, P Zhao, B Wang, Y Zhang, C Yao… - Computer Vision–ECCV …, 2020 - Springer
Abstract Knowledge distillation has become increasingly important in model compression. It
boosts the performance of a miniaturized student network with the supervision of the output …

Nar-former: Neural architecture representation learning towards holistic attributes prediction

Y Yi, H Zhang, W Hu, N Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
With the wide and deep adoption of deep learning models in real applications, there is an
increasing need to model and learn the representations of the neural networks themselves …

GNN2GNN: Graph neural networks to generate neural networks

A Agiollo, A Omicini - Uncertainty in Artificial Intelligence, 2022 - proceedings.mlr.press
The success of neural networks (NNs) is tightly linked with their architectural design—a
complex problem by itself. We here introduce a novel framework leveraging Graph Neural …

Not all operations contribute equally: Hierarchical operation-adaptive predictor for neural architecture search

Z Chen, Y Zhan, B Yu, M Gong… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Graph-based predictors have recently shown promising results on neural architecture
search (NAS). Despite their efficiency, current graph-based predictors treat all operations …

Gqnas: Graph q network for neural architecture search

Y Qin, X Wang, P Cui, W Zhu - 2021 IEEE International …, 2021 - ieeexplore.ieee.org
Neural Architecture Search (NAS), aiming to automatically search for neural structure that
performs the best, has attracted lots of attentions from both the academy and industry …