A comprehensive survey on pretrained foundation models: A history from bert to chatgpt

C Zhou, Q Li, C Li, J Yu, Y Liu, G Wang… - International Journal of …, 2024 - Springer
Abstract Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks across different data modalities. A PFM (eg, BERT, ChatGPT, GPT-4) is …

Self-supervised learning of graph neural networks: A unified review

Y Xie, Z Xu, J Zhang, Z Wang… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Deep models trained in supervised mode have achieved remarkable success on a variety of
tasks. When labeled samples are limited, self-supervised learning (SSL) is emerging as a …

Improving graph collaborative filtering with neighborhood-enriched contrastive learning

Z Lin, C Tian, Y Hou, WX Zhao - … of the ACM web conference 2022, 2022 - dl.acm.org
Recently, graph collaborative filtering methods have been proposed as an effective
recommendation approach, which can capture users' preference over items by modeling the …

Graph contrastive learning automated

Y You, T Chen, Y Shen, Z Wang - … Conference on Machine …, 2021 - proceedings.mlr.press
Self-supervised learning on graph-structured data has drawn recent interest for learning
generalizable, transferable and robust representations from unlabeled graphs. Among …

LightGCL: Simple yet effective graph contrastive learning for recommendation

X Cai, C Huang, L Xia, X Ren - arXiv preprint arXiv:2302.08191, 2023 - arxiv.org
Graph neural network (GNN) is a powerful learning approach for graph-based recommender
systems. Recently, GNNs integrated with contrastive learning have shown superior …

Graph self-supervised learning: A survey

Y Liu, M Jin, S Pan, C Zhou, Y Zheng… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Deep learning on graphs has attracted significant interests recently. However, most of the
works have focused on (semi-) supervised learning, resulting in shortcomings including …

Motif-based graph self-supervised learning for molecular property prediction

Z Zhang, Q Liu, H Wang, C Lu… - Advances in Neural …, 2021 - proceedings.neurips.cc
Predicting molecular properties with data-driven methods has drawn much attention in
recent years. Particularly, Graph Neural Networks (GNNs) have demonstrated remarkable …

Graph contrastive learning with augmentations

Y You, T Chen, Y Sui, T Chen… - Advances in neural …, 2020 - proceedings.neurips.cc
Generalizable, transferrable, and robust representation learning on graph-structured data
remains a challenge for current graph neural networks (GNNs). Unlike what has been …

Graph contrastive learning with adaptive augmentation

Y Zhu, Y Xu, F Yu, Q Liu, S Wu, L Wang - Proceedings of the web …, 2021 - dl.acm.org
Recently, contrastive learning (CL) has emerged as a successful method for unsupervised
graph representation learning. Most graph CL methods first perform stochastic augmentation …

Graphprompt: Unifying pre-training and downstream tasks for graph neural networks

Z Liu, X Yu, Y Fang, X Zhang - Proceedings of the ACM Web Conference …, 2023 - dl.acm.org
Graphs can model complex relationships between objects, enabling a myriad of Web
applications such as online page/article classification and social recommendation. While …