Distributed graph neural network training: A survey

Y Shao, H Li, X Gu, H Yin, Y Li, X Miao… - ACM Computing …, 2024 - dl.acm.org
Graph neural networks (GNNs) are a type of deep learning models that are trained on
graphs and have been successfully applied in various domains. Despite the effectiveness of …

A survey on processing-in-memory techniques: Advances and challenges

K Asifuzzaman, NR Miniskar, AR Young, F Liu… - … , Devices, Circuits and …, 2023 - Elsevier
Abstract Processing-in-memory (PIM) techniques have gained much attention from computer
architecture researchers, and significant research effort has been invested in exploring and …

Parallel and distributed graph neural networks: An in-depth concurrency analysis

M Besta, T Hoefler - IEEE Transactions on Pattern Analysis and …, 2024 - ieeexplore.ieee.org
Graph neural networks (GNNs) are among the most powerful tools in deep learning. They
routinely solve complex problems on unstructured networks, such as node classification …

Hyperscale FPGA-as-a-service architecture for large-scale distributed graph neural network

S Li, D Niu, Y Wang, W Han, Z Zhang, T Guan… - Proceedings of the 49th …, 2022 - dl.acm.org
Graph neural network (GNN) is a promising emerging application for link prediction,
recommendation, etc. Existing hardware innovation is limited to single-machine GNN (SM …

G-nmp: Accelerating graph neural networks with dimm-based near-memory processing

T Tian, X Wang, L Zhao, W Wu, X Zhang, F Lu… - Journal of Systems …, 2022 - Elsevier
Abstract Graph Neural Networks (GNNs) are of great value in numerous applications and
promote the development of cognitive intelligence, due to the capability of modeling non …

GraNDe: Near-data processing architecture with adaptive matrix mapping for graph convolutional networks

S Yun, B Kim, J Park, H Nam, JH Ahn… - IEEE Computer …, 2022 - ieeexplore.ieee.org
Graph Convolutional Network (GCN) models have attracted attention given their high
accuracy in interpreting graph data. One of the primary building blocks of a GCN model is …

DeltaGNN: Accelerating graph neural networks on dynamic graphs with delta updating

C Yin, J Jiang, Q Wang, Z Mao… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Graph neural network (GNN) accelerators have achieved prominent performance speedup
on static graphs but fallen with inefficiency on dynamic graphs. The reason is that in dynamic …

Energy efficient design of coarse-grained reconfigurable architectures: Insights, trends and challenges

E Aliagha, D Göhringer - 2022 International Conference on …, 2022 - ieeexplore.ieee.org
Coarse-Grained Reconfigurable Architectures (CGRAs) are promising solutions to achieve
more performance with the end of Moore's law. Thanks to word-level programmability, they …

Barad-dur: Near-Storage Accelerator for Training Large Graph Neural Networks

J An, E Aliaj, SW Jun - 2023 32nd International Conference on …, 2023 - ieeexplore.ieee.org
Graph Neural Networks (GNNs) enable effective machine learning on graph-structured data,
but their performance and scalability are often limited by the irregular structure and large …

Fe-GCN: A 3D FeFET Memory Based PIM Accelerator for Graph Convolutional Networks

H Zhong, Y Zhu, L Luo, T Li, C Wang… - 2023 IEEE Computer …, 2023 - ieeexplore.ieee.org
Graph convolutional network (GCN) has emerged as a powerful model for many graph-
related tasks. In conventional von Neumann architectures, massive data movement and …