Graph neural networks are inherently good generalizers: Insights by bridging gnns and mlps

C Yang, Q Wu, J Wang, J Yan - arXiv preprint arXiv:2212.09034, 2022 - arxiv.org
Graph neural networks (GNNs), as the de-facto model class for representation learning on
graphs, are built upon the multi-layer perceptrons (MLP) architecture with additional …

Rethinking graph regularization for graph neural networks

H Yang, K Ma, J Cheng - Proceedings of the AAAI Conference on …, 2021 - ojs.aaai.org
The graph Laplacian regularization term is usually used in semi-supervised representation
learning to provide graph structure information for a model f (X). However, with the recent …

Reconstruction for powerful graph representations

L Cotta, C Morris, B Ribeiro - Advances in Neural …, 2021 - proceedings.neurips.cc
Graph neural networks (GNNs) have limited expressive power, failing to represent many
graph classes correctly. While more expressive graph representation learning (GRL) …

Graph neural networks: Methods, applications, and opportunities

L Waikhom, R Patgiri - arXiv preprint arXiv:2108.10733, 2021 - arxiv.org
In the last decade or so, we have witnessed deep learning reinvigorating the machine
learning field. It has solved many problems in the domains of computer vision, speech …

A survey on the expressive power of graph neural networks

R Sato - arXiv preprint arXiv:2003.04078, 2020 - arxiv.org
Graph neural networks (GNNs) are effective machine learning models for various graph
learning problems. Despite their empirical successes, the theoretical limitations of GNNs …

Orthogonal graph neural networks

K Guo, K Zhou, X Hu, Y Li, Y Chang… - Proceedings of the AAAI …, 2022 - ojs.aaai.org
Graph neural networks (GNNs) have received tremendous attention due to their superiority
in learning node representations. These models rely on message passing and feature …

Combining label propagation and simple models out-performs graph neural networks

Q Huang, H He, A Singh, SN Lim… - arXiv preprint arXiv …, 2020 - arxiv.org
Graph Neural Networks (GNNs) are the predominant technique for learning over graphs.
However, there is relatively little understanding of why GNNs are successful in practice and …

Node-wise localization of graph neural networks

Z Liu, Y Fang, C Liu, SCH Hoi - arXiv preprint arXiv:2110.14322, 2021 - arxiv.org
Graph neural networks (GNNs) emerge as a powerful family of representation learning
models on graphs. To derive node representations, they utilize a global model that …

Graph mamba: Towards learning on graphs with state space models

A Behrouz, F Hashemi - arXiv preprint arXiv:2402.08678, 2024 - arxiv.org
Graph Neural Networks (GNNs) have shown promising potential in graph representation
learning. The majority of GNNs define a local message-passing mechanism, propagating …

On the bottleneck of graph neural networks and its practical implications

U Alon, E Yahav - arXiv preprint arXiv:2006.05205, 2020 - arxiv.org
Since the proposal of the graph neural network (GNN) by Gori et al.(2005) and Scarselli et
al.(2008), one of the major problems in training GNNs was their struggle to propagate …