Design space for graph neural networks

J You, Z Ying, J Leskovec - Advances in Neural Information …, 2020 - proceedings.neurips.cc
The rapid evolution of Graph Neural Networks (GNNs) has led to a growing number of new
architectures as well as novel applications. However, current research focuses on proposing …

Adaptive message quantization and parallelization for distributed full-graph gnn training

B Wan, J Zhao, C Wu - Proceedings of Machine Learning …, 2023 - proceedings.mlsys.org
Distributed full-graph training of Graph Neural Networks (GNNs) over large graphs is
bandwidth-demanding and time-consuming. Frequent exchanges of node features …

Geom-gcn: Geometric graph convolutional networks

H Pei, B Wei, KCC Chang, Y Lei, B Yang - arXiv preprint arXiv:2002.05287, 2020 - arxiv.org
Message-passing neural networks (MPNNs) have been successfully applied to
representation learning on graphs in a variety of real-world applications. However, two …

A comprehensive study on large-scale graph training: Benchmarking and rethinking

K Duan, Z Liu, P Wang, W Zheng… - Advances in …, 2022 - proceedings.neurips.cc
Large-scale graph training is a notoriously challenging problem for graph neural networks
(GNNs). Due to the nature of evolving graph structures into the training process, vanilla …

Am-gcn: Adaptive multi-channel graph convolutional networks

X Wang, M Zhu, D Bo, P Cui, C Shi, J Pei - Proceedings of the 26th ACM …, 2020 - dl.acm.org
Graph Convolutional Networks (GCNs) have gained great popularity in tackling various
analytics tasks on graph and network data. However, some recent studies raise concerns …

Distdgl: distributed graph neural network training for billion-scale graphs

D Zheng, C Ma, M Wang, J Zhou, Q Su… - 2020 IEEE/ACM 10th …, 2020 - ieeexplore.ieee.org
Graph neural networks (GNN) have shown great success in learning from graph-structured
data. They are widely used in various applications, such as recommendation, fraud …

Computing graph neural networks: A survey from algorithms to accelerators

S Abadal, A Jain, R Guirado, J López-Alonso… - ACM Computing …, 2021 - dl.acm.org
Graph Neural Networks (GNNs) have exploded onto the machine learning scene in recent
years owing to their capability to model and learn from graph-structured data. Such an ability …

Position-aware graph neural networks

J You, R Ying, J Leskovec - International conference on …, 2019 - proceedings.mlr.press
Learning node embeddings that capture a node's position within the broader graph structure
is crucial for many prediction tasks on graphs. However, existing Graph Neural Network …

Graph-mlp: Node classification without message passing in graph

Y Hu, H You, Z Wang, Z Wang, E Zhou… - arXiv preprint arXiv …, 2021 - arxiv.org
Graph Neural Network (GNN) has been demonstrated its effectiveness in dealing with non-
Euclidean structural data. Both spatial-based and spectral-based GNNs are relying on …

Optimization of graph neural networks: Implicit acceleration by skip connections and more depth

K Xu, M Zhang, S Jegelka… - … on Machine Learning, 2021 - proceedings.mlr.press
Abstract Graph Neural Networks (GNNs) have been studied through the lens of expressive
power and generalization. However, their optimization properties are less well understood …