Knowledge solver: Teaching llms to search for domain knowledge from knowledge graphs

C Feng, X Zhang, Z Fei - arXiv preprint arXiv:2309.03118, 2023 - arxiv.org
Large language models (LLMs), such as ChatGPT and GPT-4, are versatile and can solve
different tasks due to their emergent ability and generalizability. However, LLMs sometimes …

Language models are open knowledge graphs

C Wang, X Liu, D Song - arXiv preprint arXiv:2010.11967, 2020 - arxiv.org
This paper shows how to construct knowledge graphs (KGs) from pre-trained language
models (eg, BERT, GPT-2/3), without human supervision. Popular KGs (eg, Wikidata, NELL) …

Graph neural prompting with large language models

Y Tian, H Song, Z Wang, H Wang, Z Hu… - Proceedings of the …, 2024 - ojs.aaai.org
Large language models (LLMs) have shown remarkable generalization capability with
exceptional performance in various language modeling tasks. However, they still exhibit …

Unifying large language models and knowledge graphs: A roadmap

S Pan, L Luo, Y Wang, C Chen… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Large language models (LLMs), such as ChatGPT and GPT4, are making new waves in the
field of natural language processing and artificial intelligence, due to their emergent ability …

Llms for knowledge graph construction and reasoning: Recent capabilities and future opportunities

Y Zhu, X Wang, J Chen, S Qiao, Y Ou, Y Yao… - arXiv preprint arXiv …, 2023 - arxiv.org
This paper presents an exhaustive quantitative and qualitative evaluation of Large
Language Models (LLMs) for Knowledge Graph (KG) construction and reasoning. We …

Learning to walk with dual agents for knowledge graph reasoning

D Zhang, Z Yuan, H Liu, H Xiong - … of the AAAI Conference on artificial …, 2022 - ojs.aaai.org
Graph walking based on reinforcement learning (RL) has shown great success in navigating
an agent to automatically complete various reasoning tasks over an incomplete knowledge …

KG-GPT: A general framework for reasoning on knowledge graphs using large language models

J Kim, Y Kwon, Y Jo, E Choi - arXiv preprint arXiv:2310.11220, 2023 - arxiv.org
While large language models (LLMs) have made considerable advancements in
understanding and generating unstructured text, their application in structured data remains …

[PDF][PDF] Rule-aware reinforcement learning for knowledge graph reasoning

Z Hou, X Jin, Z Li, L Bai - Findings of the Association for …, 2021 - aclanthology.org
Multi-hop reasoning is an effective and explainable approach to predicting missing facts in
Knowledge Graphs (KGs). It usually adopts the Reinforcement Learning (RL) framework and …

SKILL: Structured knowledge infusion for large language models

F Moiseev, Z Dong, E Alfonseca, M Jaggi - arXiv preprint arXiv …, 2022 - arxiv.org
Large language models (LLMs) have demonstrated human-level performance on a vast
spectrum of natural language tasks. However, it is largely unexplored whether they can …

Iterative rule-guided reasoning over sparse knowledge graphs with deep reinforcement learning

Y Xia, M Lan, J Luo, X Chen, G Zhou - Information Processing & …, 2022 - Elsevier
In recent years, reasoning over knowledge graphs (KGs) has been widely adapted to
empower retrieval systems, recommender systems, and question answering systems …