Sight and hearing are two senses that play a vital role in human communication and scene
understanding. To mimic human perception ability, audio-visual learning, aimed at …

In audio-visual navigation, an agent intelligently travels through a complex, unmapped 3D
environment using both sights and sounds to find a sound source (eg, a phone ringing in …

Room impulse response (RIR) functions capture how the surrounding physical environment
transforms the sounds heard by a listener, with implications for various applications in AR …

Several animal species (eg, bats, dolphins, and whales) and even visually impaired humans
have the remarkable ability to perform echolocation: a biological sonar used to perceive …

Given only a few glimpses of an environment, how much can we infer about its entire
floorplan? Existing methods can map only what is visible or immediately apparent from …

We address the problem of estimating depth with multi modal audio visual data. Inspired by
the ability of animals, such as bats and dolphins, to infer distance of objects with …

Sound can convey significant information for spatial reasoning in our daily lives. To endow
deep networks with such ability, we address the challenge of dense indoor prediction with …

Binaural audio gives the listener an immersive experience and can enhance augmented
and virtual reality. However, recording binaural audio requires specialized setup with a …

Binaural audio provides human listeners with an immersive spatial sound experience, but
most existing videos lack binaural audio recordings. We propose an audio spatialization …

A room's acoustic properties are a product of the room's geometry, the objects within the
room, and their specific positions. A room's acoustic properties can be characterized by its …