A unified lottery ticket hypothesis for graph neural networks

T Chen, Y Sui, X Chen, A Zhang… - … conference on machine …, 2021 - proceedings.mlr.press
With graphs rapidly growing in size and deeper graph neural networks (GNNs) emerging,
the training and inference of GNNs become increasingly expensive. Existing network weight …

Brave the wind and the waves: Discovering robust and generalizable graph lottery tickets

K Wang, Y Liang, X Li, G Li, B Ghanem… - … on Pattern Analysis …, 2023 - ieeexplore.ieee.org
The training and inference of Graph Neural Networks (GNNs) are costly when scaling up to
large-scale graphs. Graph Lottery Ticket (GLT) has presented the first attempt to accelerate …

EXACT: Scalable graph neural networks training via extreme activation compression

Z Liu, K Zhou, F Yang, L Li, R Chen… - … Conference on Learning …, 2021 - openreview.net
Training Graph Neural Networks (GNNs) on large graphs is a fundamental challenge due to
the high memory usage, which is mainly occupied by activations (eg, node embeddings) …

Gcod: Graph convolutional network acceleration via dedicated algorithm and accelerator co-design

H You, T Geng, Y Zhang, A Li… - 2022 IEEE International …, 2022 - ieeexplore.ieee.org
Graph Convolutional Networks (GCNs) have emerged as the state-of-the-art graph learning
model. However, it can be notoriously challenging to inference GCNs over large graph …

Comprehensive graph gradual pruning for sparse training in graph neural networks

C Liu, X Ma, Y Zhan, L Ding, D Tao… - … on Neural Networks …, 2023 - ieeexplore.ieee.org
Graph neural networks (GNNs) tend to suffer from high computation costs due to the
exponentially increasing scale of graph data and a large number of model parameters …

[PDF][PDF] Searching lottery tickets in graph neural networks: A dual perspective

K Wang, Y Liang, P Wang, X Wang, P Gu… - The Eleventh …, 2022 - openreview.net
Graph Neural Networks (GNNs) have shown great promise in various graph learning tasks.
However, the computational overheads of fitting GNNs to large-scale graphs grow rapidly …

Survey on graph neural network acceleration: An algorithmic perspective

X Liu, M Yan, L Deng, G Li, X Ye, D Fan, S Pan… - arXiv preprint arXiv …, 2022 - arxiv.org
Graph neural networks (GNNs) have been a hot spot of recent research and are widely
utilized in diverse applications. However, with the use of huger data and deeper models, an …

Generalization guarantee of training graph convolutional networks with graph topology sampling

H Li, M Wang, S Liu, PY Chen… - … Conference on Machine …, 2022 - proceedings.mlr.press
Graph convolutional networks (GCNs) have recently achieved great empirical success in
learning graph-structured data. To address its scalability issue due to the recursive …

Molecular property prediction by combining LSTM and GAT

L Xu, S Pan, L Xia, Z Li - Biomolecules, 2023 - mdpi.com
Molecular property prediction is an important direction in computer-aided drug design. In this
paper, to fully explore the information from SMILE stings and graph data of molecules, we …

Data-centric graph learning: A survey

C Yang, D Bo, J Liu, Y Peng, B Chen, H Dai… - arXiv preprint arXiv …, 2023 - arxiv.org
The history of artificial intelligence (AI) has witnessed the significant impact of high-quality
data on various deep learning models, such as ImageNet for AlexNet and ResNet. Recently …