Abstract Visual Question Answering (VQA) is a challenging task that has received increasing
attention from both the computer vision and the natural language processing communities …

We consider retrieving a specific temporal segment, or moment, from a video given a natural
language text description. Methods designed to retrieve whole video clips with natural …

This paper focuses on temporal localization of actions from untrimmed videos. Existing
methods typically involve training classifiers for a pre-defined list of actions and applying the …

We introduce GuessWhat?!, a two-player guessing game as a testbed for research on the
interplay of computer vision and dialogue systems. The goal of the game is to locate an …

People often refer to entities in an image in terms of their relationships with other entities. For
example," the black cat sitting under the table" refers to both a" black cat" entity and its …

Referring expressions are natural language constructions used to identify particular objects
within a scene. In this paper, we propose a unified framework for the tasks of referring …

In this paper we are interested in the problem of image segmentation given natural
language descriptions, ie referring expressions. Existing works tackle this problem by first …

Attention mechanisms have recently been introduced in deep learning for various tasks in
natural language processing and computer vision. But despite their popularity …

This paper introduces a novel approach for modeling visual relations between pairs of
objects. We call relation a triplet of the form (subject, predicate, object) where the predicate …

Image captioning, a popular topic in computer vision, has achieved substantial progress in
recent years. However, the distinctiveness of natural descriptions is often overlooked in …