A fractional graph laplacian approach to oversmoothing

S Maskey, R Paolino, A Bacho… - Advances in Neural …, 2024 - proceedings.neurips.cc
Graph neural networks (GNNs) have shown state-of-the-art performances in various
applications. However, GNNs often struggle to capture long-range dependencies in graphs …

A survey on oversmoothing in graph neural networks

TK Rusch, MM Bronstein, S Mishra - arXiv preprint arXiv:2303.10993, 2023 - arxiv.org
Node features of graph neural networks (GNNs) tend to become more similar with the
increase of the network depth. This effect is known as over-smoothing, which we …

Optimization-induced graph implicit nonlinear diffusion

Q Chen, Y Wang, Y Wang, J Yang… - … on Machine Learning, 2022 - proceedings.mlr.press
Due to the over-smoothing issue, most existing graph neural networks can only capture
limited dependencies with their inherently finite aggregation layers. To overcome this …

A non-asymptotic analysis of oversmoothing in graph neural networks

X Wu, Z Chen, W Wang, A Jadbabaie - arXiv preprint arXiv:2212.10701, 2022 - arxiv.org
Oversmoothing is a central challenge of building more powerful Graph Neural Networks
(GNNs). While previous works have only demonstrated that oversmoothing is inevitable …

Curvdrop: A ricci curvature based approach to prevent graph neural networks from over-smoothing and over-squashing

Y Liu, C Zhou, S Pan, J Wu, Z Li, H Chen… - Proceedings of the ACM …, 2023 - dl.acm.org
Graph neural networks (GNNs) are powerful models to handle graph data and can achieve
state-of-the-art in many critical tasks including node classification and link prediction …

Two sides of the same coin: Heterophily and oversmoothing in graph convolutional neural networks

Y Yan, M Hashemi, K Swersky, Y Yang… - … Conference on Data …, 2022 - ieeexplore.ieee.org
In node classification tasks, graph convolutional neural networks (GCNs) have
demonstrated competitive performance over traditional methods on diverse graph data …

Tackling over-smoothing for general graph convolutional networks

W Huang, Y Rong, T Xu, F Sun, J Huang - arXiv preprint arXiv:2008.09864, 2020 - arxiv.org
Increasing the depth of GCN, which is expected to permit more expressivity, is shown to
incur performance detriment especially on node classification. The main cause of this lies in …

Beyond low-frequency information in graph convolutional networks

D Bo, X Wang, C Shi, H Shen - Proceedings of the AAAI conference on …, 2021 - ojs.aaai.org
Graph neural networks (GNNs) have been proven to be effective in various network-related
tasks. Most existing GNNs usually exploit the low-frequency signals of node features, which …

Training robust graph neural networks with topology adaptive edge dropping

Z Gao, S Bhattacharya, L Zhang, RS Blum… - arXiv preprint arXiv …, 2021 - arxiv.org
Graph neural networks (GNNs) are processing architectures that exploit graph structural
information to model representations from network data. Despite their success, GNNs suffer …

Towards deeper graph neural networks with differentiable group normalization

K Zhou, X Huang, Y Li, D Zha… - Advances in neural …, 2020 - proceedings.neurips.cc
Graph neural networks (GNNs), which learn the representation of a node by aggregating its
neighbors, have become an effective computational tool in downstream applications. Over …