The evolution of distributed systems for graph neural networks and their origin in graph processing and deep learning: A survey

J Vatter, R Mayer, HA Jacobsen - ACM Computing Surveys, 2023 - dl.acm.org
Graph neural networks (GNNs) are an emerging research field. This specialized deep
neural network architecture is capable of processing graph structured data and bridges the …

A comprehensive survey on graph anomaly detection with deep learning

X Ma, J Wu, S Xue, J Yang, C Zhou… - … on Knowledge and …, 2021 - ieeexplore.ieee.org
Anomalies are rare observations (eg, data records or events) that deviate significantly from
the others in the sample. Over the past few decades, research on anomaly mining has …

Vision gnn: An image is worth graph of nodes

K Han, Y Wang, J Guo, Y Tang… - Advances in neural …, 2022 - proceedings.neurips.cc
Network architecture plays a key role in the deep learning-based computer vision system.
The widely-used convolutional neural network and transformer treat the image as a grid or …

Exploring the potential of large language models (llms) in learning on graphs

Z Chen, H Mao, H Li, W Jin, H Wen, X Wei… - ACM SIGKDD …, 2024 - dl.acm.org
Learning on Graphs has attracted immense attention due to its wide real-world applications.
The most popular pipeline for learning on graphs with textual node attributes primarily relies …

Nodeformer: A scalable graph structure learning transformer for node classification

Q Wu, W Zhao, Z Li, DP Wipf… - Advances in Neural …, 2022 - proceedings.neurips.cc
Graph neural networks have been extensively studied for learning with inter-connected data.
Despite this, recent evidence has revealed GNNs' deficiencies related to over-squashing …

How attentive are graph attention networks?

S Brody, U Alon, E Yahav - arXiv preprint arXiv:2105.14491, 2021 - arxiv.org
Graph Attention Networks (GATs) are one of the most popular GNN architectures and are
considered as the state-of-the-art architecture for representation learning with graphs. In …

Large scale learning on non-homophilous graphs: New benchmarks and strong simple methods

D Lim, F Hohne, X Li, SL Huang… - Advances in …, 2021 - proceedings.neurips.cc
Many widely used datasets for graph machine learning tasks have generally been
homophilous, where nodes with similar labels connect to each other. Recently, new Graph …

HGNN+: General Hypergraph Neural Networks

Y Gao, Y Feng, S Ji, R Ji - IEEE Transactions on Pattern …, 2022 - ieeexplore.ieee.org
Graph Neural Networks have attracted increasing attention in recent years. However,
existing GNN frameworks are deployed based upon simple graphs, which limits their …

One embedder, any task: Instruction-finetuned text embeddings

H Su, W Shi, J Kasai, Y Wang, Y Hu… - arXiv preprint arXiv …, 2022 - arxiv.org
We introduce INSTRUCTOR, a new method for computing text embeddings given task
instructions: every text input is embedded together with instructions explaining the use case …

A survey of machine unlearning

TT Nguyen, TT Huynh, PL Nguyen, AWC Liew… - arXiv preprint arXiv …, 2022 - arxiv.org
Today, computer systems hold large amounts of personal data. Yet while such an
abundance of data allows breakthroughs in artificial intelligence, and especially machine …