Our environment is filled with rich and dynamic acoustic information. When we walk into a
cathedral, the reverberations as much as appearance inform us of the sanctuary's wide open …

Room impulse response (RIR) functions capture how the surrounding physical environment
transforms the sounds heard by a listener, with implications for various applications in AR …

Abstract Accurate estimation of Room Impulse Response (RIR) which captures an
environment's acoustic properties is important for speech processing and AR/VR …

We present a new dataset called Real Acoustic Fields (RAF) that captures real acoustic
room data from multiple modalities. The dataset includes high-quality and densely captured …

The spatial acoustic information of a scene, ie, how sounds emitted from a particular location
in the scene are perceived in another location, is key for immersive scene modeling. Robust …

We present AdVerb, a novel audio-visual dereverberation framework that uses visual cues
in addition to the reverberant sound to estimate clean audio. Although audio-only …

Can machines recording an audio-visual scene produce realistic, matching audio-visual
experiences at novel positions and novel view directions? We answer it by studying a new …

Fully immersive and interactive audio-visual scenes are dynamic such that the listeners and
the sound emitters move and interact with each other. Reconstruction of an immersive sound …

We propose a mesh-based neural network (MESH2IR) to generate acoustic impulse
responses (IRs) for indoor 3D scenes represented using a mesh. The IRs are used to create …

We propose a novel approach for blind room impulse response (RIR) estimation systems in
the context of a downstream application scenario, far-field automatic speech recognition …