Distributed graph neural network training: A survey

Y Shao, H Li, X Gu, H Yin, Y Li, X Miao… - ACM Computing …, 2024 - dl.acm.org
Graph neural networks (GNNs) are a type of deep learning models that are trained on
graphs and have been successfully applied in various domains. Despite the effectiveness of …

Low-bit quantization for deep graph neural networks with smoothness-aware message propagation

S Wang, B Eravci, R Guliyev… - Proceedings of the 32nd …, 2023 - dl.acm.org
Graph Neural Network (GNN) training and inference involve significant challenges of
scalability with respect to both model sizes and number of layers, resulting in degradation of …

A survey of graph convolutional networks (GCNs) in FPGA-based accelerators

M Procaccini, A Sahebi, R Giorgi - Journal of Big Data, 2024 - Springer
This survey overviews recent Graph Convolutional Networks (GCN) advancements,
highlighting their growing significance across various tasks and applications. It underscores …

Sylvie: 3d-adaptive and universal system for large-scale graph neural network training

M Zhang, Q Hu, C Wan, H Wang, P Sun… - 2024 IEEE 40th …, 2024 - ieeexplore.ieee.org
Distributed full-graph training of Graph Neural Networks (GNNs) has been widely adopted to
learn large-scale graphs. While recent system advancements can improve the training …

Helios: An Efficient Out-of-core GNN Training System on Terabyte-scale Graphs with In-memory Performance

J Sun, M Sun, Z Zhang, J Xie, Z Shi, Z Yang… - arXiv preprint arXiv …, 2023 - arxiv.org
Training graph neural networks (GNNs) on large-scale graph data holds immense promise
for numerous real-world applications but remains a great challenge. Several disk-based …

Fight Fire with Fire: Towards Robust Graph Neural Networks on Dynamic Graphs via Actively Defense

H Li, S Di, CHY Li, L Chen, X Zhou - Proceedings of the VLDB …, 2024 - dl.acm.org
Graph neural networks (GNNs) have achieved great success on various graph tasks.
However, recent studies have revealed that GNNs are vulnerable to injective attacks. Due to …

Text-Rich Graph Neural Networks with Subjective-Objective Semantic Modeling

Y Li, Z Yu, D He - IEEE Transactions on Knowledge and Data …, 2024 - ieeexplore.ieee.org
Graph Neural Networks (GNNs), which obtain node embeddings by attribute propagates
along graph topology, exhibit significant power in graph-structured data mining. However …

GraNNDis: Efficient Unified Distributed Training Framework for Deep GNNs on Large Clusters

J Song, H Jang, J Jung, Y Kim, J Lee - arXiv preprint arXiv:2311.06837, 2023 - arxiv.org
Graph neural networks (GNNs) are one of the most rapidly growing fields within deep
learning. According to the growth in the dataset and the model size used for GNNs, an …

Revisiting Graph Neural Networks on Graph-level Tasks: Comprehensive Experiments, Analysis, and Improvements

H Li, Y Xu, CJ Zhang, A Zhou, L Chen, Q Li - arXiv preprint arXiv …, 2025 - arxiv.org
Graphs are essential data structures for modeling complex interactions in domains such as
social networks, molecular structures, and biological systems. Graph-level tasks, which …

Graph Neural Network Training Systems: A Performance Comparison of Full-Graph and Mini-Batch

S Bajaj, H Son, J Liu, H Guan, M Serafini - arXiv preprint arXiv:2406.00552, 2024 - arxiv.org
Graph Neural Networks (GNNs) have gained significant attention in recent years due to their
ability to learn representations of graph structured data. Two common methods for training …