Graph neural tangent kernel: Convergence on large graphs

S Krishnagopal, L Ruiz - International Conference on …, 2023 - proceedings.mlr.press
Graph neural networks (GNNs) achieve remarkable performance in graph machine learning
tasks but can be hard to train on large-graph data, where their learning dynamics are not …

Generalization of geometric graph neural networks

Z Wang, J Cervino, A Ribeiro - arXiv preprint arXiv:2409.05191, 2024 - arxiv.org
In this paper, we study the generalization capabilities of geometric graph neural networks
(GNNs). We consider GNNs over a geometric graph constructed from a finite set of randomly …

Generalization Bounds for Message Passing Networks on Mixture of Graphons

S Maskey, G Kutyniok, R Levie - arXiv preprint arXiv:2404.03473, 2024 - arxiv.org
We study the generalization capabilities of Message Passing Neural Networks (MPNNs), a
prevalent class of Graph Neural Networks (GNN). We derive generalization bounds …

Distributed training of large graph neural networks with variable communication rates

J Cervino, MA Turja, H Mostafa, N Himayat… - arXiv preprint arXiv …, 2024 - arxiv.org
Training Graph Neural Networks (GNNs) on large graphs presents unique challenges due to
the large memory and computing requirements. Distributed GNN training, where the graph is …

Convergence of Message Passing Graph Neural Networks with Generic Aggregation On Large Random Graphs

M Cordonnier, N Keriven, N Tremblay… - arXiv preprint arXiv …, 2023 - arxiv.org
We study the convergence of message passing graph neural networks on random graph
models to their continuous counterpart as the number of nodes tends to infinity. Until now …

Transferability of Graph Neural Networks using Graphon and Sampling Theories

AM Neuman, JJ Bramburger - arXiv preprint arXiv:2307.13206, 2023 - arxiv.org
Graph neural networks (GNNs) have become powerful tools for processing graph-based
information in various domains. A desirable property of GNNs is transferability, where a …

A Local Graph Limits Perspective on Sampling-Based GNNs

Y Alimohammadi, L Ruiz, A Saberi - arXiv preprint arXiv:2310.10953, 2023 - arxiv.org
We propose a theoretical framework for training Graph Neural Networks (GNNs) on large
input graphs via training on small, fixed-size sampled subgraphs. This framework is …

A Manifold Perspective on the Statistical Generalization of Graph Neural Networks

Z Wang, J Cervino, A Ribeiro - arXiv preprint arXiv:2406.05225, 2024 - arxiv.org
Convolutional neural networks have been successfully extended to operate on graphs,
giving rise to Graph Neural Networks (GNNs). GNNs combine information from adjacent …

A Poincar\'e Inequality and Consistency Results for Signal Sampling on Large Graphs

T Le, L Ruiz, S Jegelka - arXiv preprint arXiv:2311.10610, 2023 - arxiv.org
Large-scale graph machine learning is challenging as the complexity of learning models
scales with the graph size. Subsampling the graph is a viable alternative, but sampling on …

Online Learning Of Expanding Graphs

S Rey, B Das, E Isufi - arXiv preprint arXiv:2409.08660, 2024 - arxiv.org
This paper addresses the problem of online network topology inference for expanding
graphs from a stream of spatiotemporal signals. Online algorithms for dynamic graph …