Neurbf: A neural fields representation with adaptive radial basis functions
We present a novel type of neural fields that uses general radial bases for signal
representation. State-of-the-art neural fields typically rely on grid-based representations for …
representation. State-of-the-art neural fields typically rely on grid-based representations for …
Self-supervised visual acoustic matching
A Somayazulu, C Chen… - Advances in Neural …, 2024 - proceedings.neurips.cc
Acoustic matching aims to re-synthesize an audio clip to sound as if it were recorded in a
target acoustic environment. Existing methods assume access to paired training data, where …
target acoustic environment. Existing methods assume access to paired training data, where …
STARSS23: An audio-visual dataset of spatial recordings of real scenes with spatiotemporal annotations of sound events
While direction of arrival (DOA) of sound events is generally estimated from multichannel
audio data recorded in a microphone array, sound events usually derive from visually …
audio data recorded in a microphone array, sound events usually derive from visually …
Av-rir: Audio-visual room impulse response estimation
Abstract Accurate estimation of Room Impulse Response (RIR) which captures an
environment's acoustic properties is important for speech processing and AR/VR …
environment's acoustic properties is important for speech processing and AR/VR …
Real acoustic fields: An audio-visual room acoustics dataset and benchmark
We present a new dataset called Real Acoustic Fields (RAF) that captures real acoustic
room data from multiple modalities. The dataset includes high-quality and densely captured …
room data from multiple modalities. The dataset includes high-quality and densely captured …
Av-nerf: Learning neural fields for real-world audio-visual scene synthesis
Can machines recording an audio-visual scene produce realistic, matching audio-visual
experiences at novel positions and novel view directions? We answer it by studying a new …
experiences at novel positions and novel view directions? We answer it by studying a new …
Sound localization from motion: Jointly learning sound direction and camera rotation
The images and sounds that we perceive undergo subtle but geometrically consistent
changes as we rotate our heads. In this paper, we use these cues to solve a problem we call …
changes as we rotate our heads. In this paper, we use these cues to solve a problem we call …
Hearing Anything Anywhere
Recent years have seen immense progress in 3D computer vision and computer graphics
with emerging tools that can virtualize real-world 3D environments for numerous Mixed …
with emerging tools that can virtualize real-world 3D environments for numerous Mixed …
Learning to Jointly Understand Visual and Tactile Signals
Modeling and analyzing object and shape has been well studied in the past. However,
manipulation of these complex tools and articulated objects remains difficult for autonomous …
manipulation of these complex tools and articulated objects remains difficult for autonomous …
Radar Fields: An Extension of Radiance Fields to SAR
Radiance fields have been a major breakthrough in the field of inverse rendering novel view
synthesis and 3D modeling of complex scenes from multi-view image collections. Since their …
synthesis and 3D modeling of complex scenes from multi-view image collections. Since their …