Large-scale multi-modal pre-trained models: A comprehensive survey

X Wang, G Chen, G Qian, P Gao, XY Wei… - Machine Intelligence …, 2023 - Springer
With the urgent demand for generalized deep models, many pre-trained big models are
proposed, such as bidirectional encoder representations (BERT), vision transformer (ViT) …

A survey on knowledge graphs: Representation, acquisition, and applications

S Ji, S Pan, E Cambria, P Marttinen… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Human knowledge provides a formal understanding of the world. Knowledge graphs that
represent structural relations between entities have become an increasingly popular …

Graph neural networks: foundation, frontiers and applications

L Wu, P Cui, J Pei, L Zhao, X Guo - … of the 28th ACM SIGKDD Conference …, 2022 - dl.acm.org
The field of graph neural networks (GNNs) has seen rapid and incredible strides over the
recent years. Graph neural networks, also known as deep learning on graphs, graph …

How attentive are graph attention networks?

S Brody, U Alon, E Yahav - arXiv preprint arXiv:2105.14491, 2021 - arxiv.org
Graph Attention Networks (GATs) are one of the most popular GNN architectures and are
considered as the state-of-the-art architecture for representation learning with graphs. In …

Graph neural networks for natural language processing: A survey

L Wu, Y Chen, K Shen, X Guo, H Gao… - … and Trends® in …, 2023 - nowpublishers.com
Deep learning has become the dominant approach in addressing various tasks in Natural
Language Processing (NLP). Although text inputs are typically represented as a sequence …

Learning knowledge graph embedding with heterogeneous relation attention networks

Z Li, H Liu, Z Zhang, T Liu… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Knowledge graph (KG) embedding aims to study the embedding representation to retain the
inherent structure of KGs. Graph neural networks (GNNs), as an effective graph …

Low-dimensional hyperbolic knowledge graph embeddings

I Chami, A Wolf, DC Juan, F Sala, S Ravi… - arXiv preprint arXiv …, 2020 - arxiv.org
Knowledge graph (KG) embeddings learn low-dimensional representations of entities and
relations to predict missing facts. KGs often exhibit hierarchical and logical patterns which …

[图书][B] Deep learning on graphs

Y Ma, J Tang - 2021 - books.google.com
Deep learning on graphs has become one of the hottest topics in machine learning. The
book consists of four parts to best accommodate our readers with diverse backgrounds and …

A survey of knowledge graph reasoning on graph types: Static, dynamic, and multi-modal

K Liang, L Meng, M Liu, Y Liu, W Tu… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
Knowledge graph reasoning (KGR), aiming to deduce new facts from existing facts based on
mined logic rules underlying knowledge graphs (KGs), has become a fast-growing research …

A survey on knowledge graph embeddings for link prediction

M Wang, L Qiu, X Wang - Symmetry, 2021 - mdpi.com
Knowledge graphs (KGs) have been widely used in the field of artificial intelligence, such as
in information retrieval, natural language processing, recommendation systems, etc …