Abstract 3D visual grounding aims to find the object within point clouds mentioned by free-
form natural language descriptions with rich semantic cues. However, existing methods …

Recent methods for embodied instruction following are typically trained end-to-end using
imitation learning. This often requires the use of expert trajectories and low-level language …

Humans, even at a very early age, can learn visual concepts and understand geometry and
layout through active interaction with the environment, and generalize their compositions to …

Egocentric augmented reality devices such as wearable glasses passively capture visual
data as a human wearer tours a home environment. We envision a scenario wherein the …

3D scene representation for robot manipulation should capture three key object properties:
permanency--objects that become occluded over time continue to exist; amodal …

With the recent development of deep learning, AI models are widely used in various
domains. AI models show good performance for definite tasks such as image classification …

We study the problem of novel view synthesis from sparse source observations of a scene
comprised of 3D objects. We propose a simple yet effective approach that is neither …

Abstract 3D visual grounding is the task of localizing the object in a 3D scene which is
referred by a description in natural language. With a wide range of applications ranging from …

Natural language applied to natural 2D images describes a fundamentally 3D world. We
present the Voxel-informed Language Grounder (VLG), a language grounding model that …

Abstract 3D visual grounding aims to localize 3D objects described by free-form language
sentences. Following the detection-then-matching paradigm existing methods mainly focus …