Knowledge graphs meet multi-modal learning: A comprehensive survey

Z Chen, Y Zhang, Y Fang, Y Geng, L Guo… - arXiv preprint arXiv …, 2024 - arxiv.org
Knowledge Graphs (KGs) play a pivotal role in advancing various AI applications, with the
semantic web community's exploration into multi-modal dimensions unlocking new avenues …

Learn from relational correlations and periodic events for temporal knowledge graph reasoning

K Liang, L Meng, M Liu, Y Liu, W Tu, S Wang… - Proceedings of the 46th …, 2023 - dl.acm.org
Reasoning on temporal knowledge graphs (TKGR), aiming to infer missing events along the
timeline, has been widely studied to alleviate incompleteness issues in TKG, which is …

Tmac: Temporal multi-modal graph learning for acoustic event classification

M Liu, K Liang, D Hu, H Yu, Y Liu, L Meng… - Proceedings of the 31st …, 2023 - dl.acm.org
Audiovisual data is everywhere in this digital age, which raises higher requirements for the
deep learning models developed on them. To well handle the information of the multi-modal …

Understanding translationese in cross-lingual summarization

J Wang, F Meng, Y Liang, T Zhang, J Xu, Z Li… - arXiv preprint arXiv …, 2022 - arxiv.org
Given a document in a source language, cross-lingual summarization (CLS) aims at
generating a concise summary in a different target language. Unlike monolingual …

Annotations Are Not All You Need: A Cross-modal Knowledge Transfer Network for Unsupervised Temporal Sentence Grounding

X Fang, D Liu, W Fang, P Zhou, Y Cheng… - Findings of the …, 2023 - aclanthology.org
This paper addresses the task of temporal sentence grounding (TSG). Although many
respectable works have made decent achievements in this important topic, they severely …

Self-supervised opinion summarization with multi-modal knowledge graph

L Jin, J Chen - Journal of Intelligent Information Systems, 2024 - Springer
Multi-modal opinion summarization aims at automatically generating summaries of products
or businesses from multi-modal reviews containing text, image and table to present clear …

Multi-modal knowledge graph transformer framework for multi-modal entity alignment

Q Li, C Ji, S Guo, Z Liang, L Wang, J Li - arXiv preprint arXiv:2310.06365, 2023 - arxiv.org
Multi-Modal Entity Alignment (MMEA) is a critical task that aims to identify equivalent entity
pairs across multi-modal knowledge graphs (MMKGs). However, this task faces challenges …

Universal multi-modal entity alignment via iteratively fusing modality similarity paths

B Zhu, X Liu, X Mao, Z Chen, L Guo, T Gui… - arXiv preprint arXiv …, 2023 - arxiv.org
The objective of Entity Alignment (EA) is to identify equivalent entity pairs from multiple
Knowledge Graphs (KGs) and create a more comprehensive and unified KG. The majority of …

Similarity propagation based semi-supervised entity alignment

Z Yan, R Peng, H Wu - Engineering Applications of Artificial Intelligence, 2024 - Elsevier
Entity alignment aims to identify entities referring to the same real world object among
multiple knowledge graphs. Current embedding based approaches suffer from the lack of …

Towards semantic consistency: Dirichlet energy driven robust multi-modal entity alignment

Y Wang, H Sun, J Wang, J Wang, W Tang, Q Qi… - arXiv preprint arXiv …, 2024 - arxiv.org
In Multi-Modal Knowledge Graphs (MMKGs), Multi-Modal Entity Alignment (MMEA) is crucial
for identifying identical entities across diverse modal attributes. However, semantic …