Kvqa: Knowledge-aware visual question answering

S Shah, A Mishra, N Yadati, PP Talukdar - Proceedings of the AAAI …, 2019 - aaai.org
Proceedings of the AAAI conference on artificial intelligence, 2019aaai.org
Abstract Visual Question Answering (VQA) has emerged as an important problem spanning
Computer Vision, Natural Language Processing and Artificial Intelligence (AI). In
conventional VQA, one may ask questions about an image which can be answered purely
based on its content. For example, given an image with people in it, a typical VQA question
may inquire about the number of people in the image. More recently, there is growing
interest in answering questions which require commonsense knowledge involving common …
Abstract
Visual Question Answering (VQA) has emerged as an important problem spanning Computer Vision, Natural Language Processing and Artificial Intelligence (AI). In conventional VQA, one may ask questions about an image which can be answered purely based on its content. For example, given an image with people in it, a typical VQA question may inquire about the number of people in the image. More recently, there is growing interest in answering questions which require commonsense knowledge involving common nouns (eg, cats, dogs, microphones) present in the image. In spite of this progress, the important problem of answering questions requiring world knowledge about named entities (eg, Barack Obama, White House, United Nations) in the image has not been addressed in prior research. We address this gap in this paper, and introduce KVQA–the first dataset for the task of (world) knowledge-aware VQA. KVQA consists of 183K question-answer pairs involving more than 18K named entities and 24K images. Questions in this dataset require multi-entity, multi-relation, and multi-hop reasoning over large Knowledge Graphs (KG) to arrive at an answer. To the best of our knowledge, KVQA is the largest dataset for exploring VQA over KG. Further, we also provide baseline performances using state-of-the-art methods on KVQA.
aaai.org
以上显示的是最相近的搜索结果。 查看全部搜索结果

Google学术搜索按钮

example.edu/paper.pdf
搜索
获取 PDF 文件
引用
References