We introduce Ego4D, a massive-scale egocentric video dataset and benchmark suite. It
offers 3,670 hours of daily-life activity video spanning hundreds of scenarios (household …

Audio-based automatic speech recognition (ASR) degrades significantly in noisy
environments and is particularly vulnerable to interfering speech, as the model cannot …

Humans naturally perceive surrounding scenes by unifying sound and sight in a first-person
view. Likewise, machines are advanced to approach human intelligence by learning with …

What will the future be? We wonder! In this survey, we explore the gap between current
research in egocentric vision and the ever-anticipated future, where wearable computing …

Augmented reality devices have the potential to enhance human perception and enable
other assistive functionalities in complex conversational environments. Effectively capturing …

This article proposes a parametric signal-dependent method for the task of encoding
microphone array signals into Ambisonic signals. The proposed method is presented and …

In a noisy conversation environment such as a dinner party, people often exhibit selective
auditory attention, or the ability to focus on a particular speaker while tuning out others …

Prior works on improving speech quality with visual input typically study each type of
auditory distortion separately (eg, separation, inpainting, video-to-speech) and present …

To optimally improve signal-to-noise ratio in noisy environments, a hearing assistance
device must correctly identify what is signal and what is noise. Many of the biosignal-based …

It is well known that microphone arrays can be used to enhance a target speaker in a noisy,
reverberant environment, with both spatial (eg beamforming) and statistical (eg source …