A comprehensive study on large-scale graph training: Benchmarking and rethinking

K Duan, Z Liu, P Wang, W Zheng… - Advances in …, 2022 - proceedings.neurips.cc
Large-scale graph training is a notoriously challenging problem for graph neural networks
(GNNs). Due to the nature of evolving graph structures into the training process, vanilla …

Ripple walk training: A subgraph-based training framework for large and deep graph neural network

J Bai, Y Ren, J Zhang - 2021 International Joint Conference on …, 2021 - ieeexplore.ieee.org
Graph neural networks (GNNs) have achieved outstanding performance in learning graph-
structured data and various tasks. However, many current GNNs suffer from three common …

Seastar: vertex-centric programming for graph neural networks

Y Wu, K Ma, Z Cai, T Jin, B Li, C Zheng… - Proceedings of the …, 2021 - dl.acm.org
Graph neural networks (GNNs) have achieved breakthrough performance in graph analytics
such as node classification, link prediction and graph clustering. Many GNN training …

Understanding and bridging the gaps in current GNN performance optimizations

K Huang, J Zhai, Z Zheng, Y Yi, X Shen - Proceedings of the 26th ACM …, 2021 - dl.acm.org
Graph Neural Network (GNN) has recently drawn a rapid increase of interest in many
domains for its effectiveness in learning over graphs. Maximizing its performance is …

Bns-gcn: Efficient full-graph training of graph convolutional networks with partition-parallelism and random boundary node sampling

C Wan, Y Li, A Li, NS Kim, Y Lin - Proceedings of Machine …, 2022 - proceedings.mlsys.org
Abstract Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art
method for graph-based learning tasks. However, training GCNs at scale is still challenging …

Bag of tricks for training deeper graph neural networks: A comprehensive benchmark study

T Chen, K Zhou, K Duan, W Zheng… - … on Pattern Analysis …, 2022 - ieeexplore.ieee.org
Training deep graph neural networks (GNNs) is notoriously hard. Besides the standard
plights in training deep architectures such as vanishing gradients and overfitting, it also …

A survey on graph neural network acceleration: Algorithms, systems, and customized hardware

S Zhang, A Sohrabizadeh, C Wan, Z Huang… - arXiv preprint arXiv …, 2023 - arxiv.org
Graph neural networks (GNNs) are emerging for machine learning research on graph-
structured data. GNNs achieve state-of-the-art performance on many tasks, but they face …

Sampling methods for efficient training of graph convolutional networks: A survey

X Liu, M Yan, L Deng, G Li, X Ye… - IEEE/CAA Journal of …, 2021 - ieeexplore.ieee.org
Graph convolutional networks (GCNs) have received significant attention from various
research fields due to the excellent performance in learning graph representations. Although …

EXACT: Scalable graph neural networks training via extreme activation compression

Z Liu, K Zhou, F Yang, L Li, R Chen… - … Conference on Learning …, 2021 - openreview.net
Training Graph Neural Networks (GNNs) on large graphs is a fundamental challenge due to
the high memory usage, which is mainly occupied by activations (eg, node embeddings) …

Distributed hybrid cpu and gpu training for graph neural networks on billion-scale heterogeneous graphs

D Zheng, X Song, C Yang, D LaSalle… - Proceedings of the 28th …, 2022 - dl.acm.org
Graph neural networks (GNN) have shown great success in learn-ing from graph-structured
data. They are widely used in various applications, such as recommendation, fraud …