TorchGT: A Holistic System for Large-Scale Graph Transformer Training

M Zhang, J Sun, Q Hu, P Sun, Z Wang… - … Conference for High …, 2024 - ieeexplore.ieee.org
Graph Transformer is a new architecture that surpasses GNNs in graph learning. While there
emerge inspiring algorithm advancements, their practical adoption is still limited, particularly …

MixGCN: Scalable GCN Training by Mixture of Parallelism and Mixture of Accelerators

C Wan, R Tao, Z Du, YK Zhao, YC Lin - arXiv preprint arXiv:2501.01951, 2025 - arxiv.org
Graph convolutional networks (GCNs) have demonstrated superiority in graph-based
learning tasks. However, training GCNs on full graphs is particularly challenging, due to the …