A comprehensive survey on pretrained foundation models: A history from bert to chatgpt

C Zhou, Q Li, C Li, J Yu, Y Liu, G Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks with different data modalities. A PFM (eg, BERT, ChatGPT, and GPT-4) is …

Llmrec: Large language models with graph augmentation for recommendation

W Wei, X Ren, J Tang, Q Wang, L Su, S Cheng… - Proceedings of the 17th …, 2024 - dl.acm.org
The problem of data sparsity has long been a challenge in recommendation systems, and
previous studies have attempted to address this issue by incorporating side information …

Graph neural prompting with large language models

Y Tian, H Song, Z Wang, H Wang, Z Hu… - Proceedings of the …, 2024 - ojs.aaai.org
Large language models (LLMs) have shown remarkable generalization capability with
exceptional performance in various language modeling tasks. However, they still exhibit …

Learning mlps on graphs: A unified view of effectiveness, robustness, and efficiency

Y Tian, C Zhang, Z Guo, X Zhang… - … Conference on Learning …, 2022 - openreview.net
While Graph Neural Networks (GNNs) have demonstrated their efficacy in dealing with non-
Euclidean structural data, they are difficult to be deployed in real applications due to the …

Federated graph learning under domain shift with generalizable prototypes

G Wan, W Huang, M Ye - Proceedings of the AAAI Conference on …, 2024 - ojs.aaai.org
Federated Graph Learning is a privacy-preserving collaborative approach for training a
shared model on graph-structured data in the distributed environment. However, in real …

Knowledge distillation on graphs: A survey

Y Tian, S Pei, X Zhang, C Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
Graph Neural Networks (GNNs) have attracted tremendous attention by demonstrating their
capability to handle graph data. However, they are difficult to be deployed in resource …

Breaking the trilemma of privacy, utility, and efficiency via controllable machine unlearning

Z Liu, G Dou, E Chien, C Zhang, Y Tian… - Proceedings of the ACM …, 2024 - dl.acm.org
Machine Unlearning (MU) algorithms have become increasingly critical due to the
imperative adherence to data privacy regulations. The primary objective of MU is to erase …

Fair graph representation learning via diverse mixture-of-experts

Z Liu, C Zhang, Y Tian, E Zhang, C Huang… - Proceedings of the …, 2023 - dl.acm.org
Graph Neural Networks (GNNs) have demonstrated a great representation learning
capability on graph data and have been utilized in various downstream applications …

Vqgraph: Graph vector-quantization for bridging gnns and mlps

L Yang, Y Tian, M Xu, Z Liu, S Hong, W Qu… - arXiv preprint arXiv …, 2023 - arxiv.org
Graph Neural Networks (GNNs) conduct message passing which aggregates local
neighbors to update node representations. Such message passing leads to scalability …

Sslrec: A self-supervised learning framework for recommendation

X Ren, L Xia, Y Yang, W Wei, T Wang, X Cai… - Proceedings of the 17th …, 2024 - dl.acm.org
Self-supervised learning (SSL) has gained significant interest in recent years as a solution to
address the challenges posed by sparse and noisy data in recommender systems. Despite …