Distributed graph neural network training: A survey

Y Shao, H Li, X Gu, H Yin, Y Li, X Miao… - ACM Computing …, 2024 - dl.acm.org
Graph neural networks (GNNs) are a type of deep learning models that are trained on
graphs and have been successfully applied in various domains. Despite the effectiveness of …

Learn locally, correct globally: A distributed algorithm for training graph neural networks

M Ramezani, W Cong, M Mahdavi… - arXiv preprint arXiv …, 2021 - arxiv.org
Despite the recent success of Graph Neural Networks (GNNs), training GNNs on large
graphs remains challenging. The limited resource capacities of the existing servers, the …

Graph coarsening via convolution matching for scalable graph neural network training

C Dickens, E Huang, A Reganti, J Zhu… - … Proceedings of the …, 2024 - dl.acm.org
Graph summarization as a preprocessing step is an effective and complementary technique
for scalable graph neural network (GNN) training. In this work, we propose the Coarsening …

Distributed optimization of graph convolutional network using subgraph variance

T Zhao, X Song, M Li, J Li, W Luo… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
In recent years, distributed graph convolutional networks (GCNs) training frameworks have
achieved great success in learning the representation of graph-structured data with large …

Graph Neural Network Training Systems: A Performance Comparison of Full-Graph and Mini-Batch

S Bajaj, H Son, J Liu, H Guan, M Serafini - arXiv preprint arXiv:2406.00552, 2024 - arxiv.org
Graph Neural Networks (GNNs) have gained significant attention in recent years due to their
ability to learn representations of graph structured data. Two common methods for training …

Simplifying distributed neural network training on massive graphs: Randomized partitions improve model aggregation

J Zhu, A Reganti, EW Huang, C Dickens… - ACM Transactions on …, 2024 - dl.acm.org
Distributed graph neural network (GNN) training facilitates learning on massive graphs that
surpass the storage and computational capabilities of a single machine. Traditional …

Ppsgcn: A privacy-preserving subgraph sampling based distributed gcn training method

B Zhang, M Luo, S Feng, Z Liu, J Zhou… - arXiv preprint arXiv …, 2021 - arxiv.org
Graph convolutional networks (GCNs) have been widely adopted for graph representation
learning and achieved impressive performance. For larger graphs stored separately on …

Advancing Graph Neural Networks for Complex Data: A Perspective Beyond Homophily

J Zhu - 2024 - deepblue.lib.umich.edu
Graph Neural Networks (GNNs) have demonstrated significant potential in extending the
empirical success of deep learning from Euclidean spaces to non-Euclidean, graph …