A comprehensive survey on pretrained foundation models: A history from bert to chatgpt

C Zhou, Q Li, C Li, J Yu, Y Liu, G Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks with different data modalities. A PFM (eg, BERT, ChatGPT, and GPT-4) is …

A comprehensive survey on community detection with deep learning

X Su, S Xue, F Liu, J Wu, J Yang, C Zhou… - … on Neural Networks …, 2022 - ieeexplore.ieee.org
Detecting a community in a network is a matter of discerning the distinct features and
connections of a group of members that are different from those in other communities. The …

Graph self-supervised learning: A survey

Y Liu, M Jin, S Pan, C Zhou, Y Zheng… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Deep learning on graphs has attracted significant interests recently. However, most of the
works have focused on (semi-) supervised learning, resulting in shortcomings including …

Self-supervised learning of graph neural networks: A unified review

Y Xie, Z Xu, J Zhang, Z Wang… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Deep models trained in supervised mode have achieved remarkable success on a variety of
tasks. When labeled samples are limited, self-supervised learning (SSL) is emerging as a …

Heterogeneous graph contrastive learning for recommendation

M Chen, C Huang, L Xia, W Wei, Y Xu… - Proceedings of the …, 2023 - dl.acm.org
Graph Neural Networks (GNNs) have become powerful tools in modeling graph-structured
data in recommender systems. However, real-life recommendation scenarios usually involve …

Self-supervised learning on graphs: Contrastive, generative, or predictive

L Wu, H Lin, C Tan, Z Gao, SZ Li - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Deep learning on graphs has recently achieved remarkable success on a variety of tasks,
while such success relies heavily on the massive and carefully labeled data. However …

Multi-level cross-view contrastive learning for knowledge-aware recommender system

D Zou, W Wei, XL Mao, Z Wang, M Qiu, F Zhu… - Proceedings of the 45th …, 2022 - dl.acm.org
Knowledge graph (KG) plays an increasingly important role in recommender systems.
Recently, graph neural networks (GNNs) based model has gradually become the theme of …

A survey on heterogeneous graph embedding: methods, techniques, applications and sources

X Wang, D Bo, C Shi, S Fan, Y Ye… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Heterogeneous graphs (HGs) also known as heterogeneous information networks have
become ubiquitous in real-world scenarios; therefore, HG embedding, which aims to learn …

Contrastive meta learning with behavior multiplicity for recommendation

W Wei, C Huang, L Xia, Y Xu, J Zhao… - Proceedings of the fifteenth …, 2022 - dl.acm.org
A well-informed recommendation framework could not only help users identify their
interested items, but also benefit the revenue of various online platforms (eg, e-commerce …

Heterogeneous graph masked autoencoders

Y Tian, K Dong, C Zhang, C Zhang… - Proceedings of the AAAI …, 2023 - ojs.aaai.org
Generative self-supervised learning (SSL), especially masked autoencoders, has become
one of the most exciting learning paradigms and has shown great potential in handling …