A non-asymptotic analysis of oversmoothing in graph neural networks

X Wu, Z Chen, W Wang, A Jadbabaie - arXiv preprint arXiv:2212.10701, 2022 - arxiv.org
Oversmoothing is a central challenge of building more powerful Graph Neural Networks
(GNNs). While previous works have only demonstrated that oversmoothing is inevitable …

A survey on oversmoothing in graph neural networks

TK Rusch, MM Bronstein, S Mishra - arXiv preprint arXiv:2303.10993, 2023 - arxiv.org
Node features of graph neural networks (GNNs) tend to become more similar with the
increase of the network depth. This effect is known as over-smoothing, which we …

Demystifying oversmoothing in attention-based graph neural networks

X Wu, A Ajorlou, Z Wu… - Advances in Neural …, 2024 - proceedings.neurips.cc
Abstract Oversmoothing in Graph Neural Networks (GNNs) refers to the phenomenon where
increasing network depth leads to homogeneous node representations. While previous work …

Tackling over-smoothing for general graph convolutional networks

W Huang, Y Rong, T Xu, F Sun, J Huang - arXiv preprint arXiv:2008.09864, 2020 - arxiv.org
Increasing the depth of GCN, which is expected to permit more expressivity, is shown to
incur performance detriment especially on node classification. The main cause of this lies in …

Unifying over-smoothing and over-squashing in graph neural networks: A physics informed approach and beyond

Z Shao, D Shi, A Han, Y Guo, Q Zhao, J Gao - arXiv preprint arXiv …, 2023 - arxiv.org
Graph Neural Networks (GNNs) have emerged as one of the leading approaches for
machine learning on graph-structured data. Despite their great success, critical …

On the trade-off between over-smoothing and over-squashing in deep graph neural networks

JH Giraldo, K Skianis, T Bouwmans… - Proceedings of the 32nd …, 2023 - dl.acm.org
Graph Neural Networks (GNNs) have succeeded in various computer science applications,
yet deep GNNs underperform their shallow counterparts despite deep learning's success in …

Two sides of the same coin: Heterophily and oversmoothing in graph convolutional neural networks

Y Yan, M Hashemi, K Swersky, Y Yang… - … Conference on Data …, 2022 - ieeexplore.ieee.org
In node classification tasks, graph convolutional neural networks (GCNs) have
demonstrated competitive performance over traditional methods on diverse graph data …

On provable benefits of depth in training graph convolutional networks

W Cong, M Ramezani… - Advances in Neural …, 2021 - proceedings.neurips.cc
Abstract Graph Convolutional Networks (GCNs) are known to suffer from performance
degradation as the number of layers increases, which is usually attributed to over …

Understanding graph neural networks from graph signal denoising perspectives

G Fu, Y Hou, J Zhang, K Ma, BF Kamhoua… - arXiv preprint arXiv …, 2020 - arxiv.org
Graph neural networks (GNNs) have attracted much attention because of their excellent
performance on tasks such as node classification. However, there is inadequate …

Revisiting over-smoothing in deep GCNs

C Yang, R Wang, S Yao, S Liu… - arXiv preprint arXiv …, 2020 - arxiv.org
Oversmoothing has been assumed to be the major cause of performance drop in deep
graph convolutional networks (GCNs). In this paper, we propose a new view that deep …