Visual understanding goes well beyond object recognition. With one glance at an image, we
can effortlessly imagine the world beyond the pixels: for instance, we can infer people's …

Commonsense is defined as the knowledge that is shared by everyone. However, certain
types of commonsense knowledge are correlated with culture and geographic locations and …

Even from a single frame of a still image, people can reason about the dynamic story of the
image before, after, and beyond the frame. For example, given an image of a man struggling …

Weird, unusual, and uncanny images pique the curiosity of observers because they
challenge commonsense. For example, an image released during the 2022 world cup …

Commonsense reasoning, aiming at endowing machines with a human-like ability to make
situational presumptions, is extremely challenging to generalize. For someone who barely …

We present the MAC network, a novel fully differentiable neural network architecture,
designed to facilitate explicit and expressive reasoning. MAC moves away from monolithic …

Dramatic progress has been witnessed in basic vision tasks involving low-level perception,
such as object recognition, detection, and tracking. Unfortunately, there is still enormous …

We aim to dismantle the prevalent black-box neural architectures used in complex visual
reasoning tasks, into the proposed eXplainable and eXplicit Neural Modules (XNMs), which …

As humans, we understand events in the visual world contextually, performing multimodal
reasoning across time to make inferences about the past, present, and future. We introduce …

As humans, we navigate a multimodal world, building a holistic understanding from all our
senses. We introduce MERLOT Reserve, a model that represents videos jointly over time …