Heterogeneous graph masked autoencoders

Y Tian, K Dong, C Zhang, C Zhang… - Proceedings of the AAAI …, 2023 - ojs.aaai.org
Generative self-supervised learning (SSL), especially masked autoencoders, has become
one of the most exciting learning paradigms and has shown great potential in handling …

Graphmae: Self-supervised masked graph autoencoders

Z Hou, X Liu, Y Cen, Y Dong, H Yang, C Wang… - Proceedings of the 28th …, 2022 - dl.acm.org
Self-supervised learning (SSL) has been extensively explored in recent years. Particularly,
generative SSL has seen emerging success in natural language processing and other …

Graphmae2: A decoding-enhanced masked self-supervised graph learner

Z Hou, Y He, Y Cen, X Liu, Y Dong… - Proceedings of the …, 2023 - dl.acm.org
Graph self-supervised learning (SSL), including contrastive and generative approaches,
offers great potential to address the fundamental challenge of label scarcity in real-world …

Gigamae: Generalizable graph masked autoencoder via collaborative latent space reconstruction

Y Shi, Y Dong, Q Tan, J Li, N Liu - Proceedings of the 32nd ACM …, 2023 - dl.acm.org
Self-supervised learning with masked autoencoders has recently gained popularity for its
ability to produce effective image or textual representations, which can be applied to various …

What's Behind the Mask: Understanding Masked Graph Modeling for Graph Autoencoders

J Li, R Wu, W Sun, L Chen, S Tian, L Zhu… - Proceedings of the 29th …, 2023 - dl.acm.org
The last years have witnessed the emergence of a promising self-supervised learning
strategy, referred to as masked autoencoding. However, there is a lack of theoretical …

Mgae: Masked autoencoders for self-supervised learning on graphs

Q Tan, N Liu, X Huang, R Chen, SH Choi… - arXiv preprint arXiv …, 2022 - arxiv.org
We introduce a novel masked graph autoencoder (MGAE) framework to perform effective
learning on graph structure data. Taking insights from self-supervised learning, we randomly …

S2gae: Self-supervised graph autoencoders are generalizable learners with graph masking

Q Tan, N Liu, X Huang, SH Choi, L Li, R Chen… - Proceedings of the …, 2023 - dl.acm.org
Self-supervised learning (SSL) has been demonstrated to be effective in pre-training models
that can be generalized to various downstream tasks. Graph Autoencoder (GAE), an …

Multi-task self-supervised graph neural networks enable stronger task generalization

M Ju, T Zhao, Q Wen, W Yu, N Shah, Y Ye… - arXiv preprint arXiv …, 2022 - arxiv.org
Self-supervised learning (SSL) for graph neural networks (GNNs) has attracted increasing
attention from the graph machine learning community in recent years, owing to its capability …

Decoupled self-supervised learning for graphs

T Xiao, Z Chen, Z Guo, Z Zhuang… - Advances in Neural …, 2022 - proceedings.neurips.cc
This paper studies the problem of conducting self-supervised learning for node
representation learning on graphs. Most existing self-supervised learning methods assume …

Seegera: Self-supervised semi-implicit graph variational auto-encoders with masking

X Li, T Ye, C Shan, D Li, M Gao - … of the ACM web conference 2023, 2023 - dl.acm.org
Generative graph self-supervised learning (SSL) aims to learn node representations by
reconstructing the input graph data. However, most existing methods focus on unsupervised …