From relational pooling to subgraph gnns: A universal framework for more expressive graph neural networks

C Zhou, X Wang, M Zhang - International Conference on …, 2023 - proceedings.mlr.press
International Conference on Machine Learning, 2023proceedings.mlr.press
Relational pooling is a framework for building more expressive and permutation-invariant
graph neural networks. However, there is limited understanding of the exact enhancement in
the expressivity of RP and its connection with the Weisfeiler-Lehman hierarchy. Starting from
RP, we propose to explicitly assign labels to nodes as additional features to improve graph
isomorphism distinguishing power of message passing neural networks. The method is then
extended to higher-dimensional WL, leading to a novel $ k, l $-WL algorithm, a more general …
Abstract
Relational pooling is a framework for building more expressive and permutation-invariant graph neural networks. However, there is limited understanding of the exact enhancement in the expressivity of RP and its connection with the Weisfeiler-Lehman hierarchy. Starting from RP, we propose to explicitly assign labels to nodes as additional features to improve graph isomorphism distinguishing power of message passing neural networks. The method is then extended to higher-dimensional WL, leading to a novel -WL algorithm, a more general framework than -WL. We further introduce the subgraph concept into our hierarchy and propose a localized -WL framework, incorporating a wide range of existing work, including many subgraph GNNs. Theoretically, we analyze the expressivity of -WL wrt and and compare it with the traditional -WL. Complexity reduction methods are also systematically discussed to build powerful and practical -GNN instances. We theoretically and experimentally prove that our method is universally compatible and capable of improving the expressivity of any base GNN model. Our -GNNs achieve superior performance on many synthetic and real-world datasets, which verifies the effectiveness of our framework.
proceedings.mlr.press
以上显示的是最相近的搜索结果。 查看全部搜索结果