The new era of technology has brought us to the point where it is convenient for people to
share their opinions over an abundance of platforms. These platforms have a provision for …

Depth completion aims to recover a dense depth map from the sparse depth data and the
corresponding single RGB image. The observed pixels provide the significant guidance for …

Dense video captioning is a task of localizing interesting events from an untrimmed video
and producing textual description (captions) for each localized event. Most of the previous …

Audiovisual Event (AVE) localization requires the model to jointly localize an event by
observing audio and visual information. However, in unconstrained videos, both information …

Humans can imagine a scene from a sound. We want machines to do so by using
conditional generative adversarial networks (GANs). By applying the techniques including …

The development of big data, machine learning, and the Internet of Things has led to rapid
advances in the research field of Active and Assisted Living (AAL). A human is placed in the …

Given an input video, its associated audio, and a brief caption, the audio-visual scene aware
dialog (AVSD) task requires an agent to indulge in a question-answer dialog with a human …

Recognizing sounds is a key aspect of computational audio scene analysis and machine
perception. In this paper, we advocate that sound recognition is inherently a multi-modal …

When dealing with signal processing and deep learning for classification, the choice of
inputting whether the raw signal or transforming it into a time-frequency representation (TFR) …

Applying deformable transformer for dense video captioning has achieved great success
recently. However, deformable transformer only explores local-perspective perception by …