Multimodal research in vision and language: A review of current and emerging trends
Deep Learning and its applications have cascaded impactful research and development
with a diverse range of modalities present in the real-world data. More recently, this has …
with a diverse range of modalities present in the real-world data. More recently, this has …
Zero-shot video question answering via frozen bidirectional language models
Video question answering (VideoQA) is a complex task that requires diverse multi-modal
data for training. Manual annotation of question and answers for videos, however, is tedious …
data for training. Manual annotation of question and answers for videos, however, is tedious …
Just ask: Learning to answer questions from millions of narrated videos
Recent methods for visual question answering rely on large-scale annotated datasets.
Manual annotation of questions and answers for videos, however, is tedious, expensive and …
Manual annotation of questions and answers for videos, however, is tedious, expensive and …
Clover: Towards a unified video-language alignment and fusion model
Building a universal video-language model for solving various video understanding tasks
(eg, text-video retrieval, video question answering) is an open challenge to the machine …
(eg, text-video retrieval, video question answering) is an open challenge to the machine …
Tem-adapter: Adapting image-text pretraining for video question answer
Video-language pre-trained models have shown remarkable success in guiding video
question-answering (VideoQA) tasks. However, due to the length of video sequences …
question-answering (VideoQA) tasks. However, due to the length of video sequences …
Occluded prohibited items detection: An x-ray security inspection benchmark and de-occlusion attention module
Security inspection often deals with a piece of baggage or suitcase where objects are
heavily overlapped with each other, resulting in an unsatisfactory performance for prohibited …
heavily overlapped with each other, resulting in an unsatisfactory performance for prohibited …
Structured multi-level interaction network for video moment localization via language query
We address the problem of localizing a specific moment described by a natural language
query. Existing works interact the query with either video frame or moment proposal, and …
query. Existing works interact the query with either video frame or moment proposal, and …
Hierarchical representation network with auxiliary tasks for video captioning and video question answering
Recently, integrating vision and language for in-depth video understanding eg, video
captioning and video question answering, has become a promising direction for artificial …
captioning and video question answering, has become a promising direction for artificial …
Learning from inside: Self-driven siamese sampling and reasoning for video question answering
Recent advances in the video question answering (ie, VideoQA) task have achieved strong
success by following the paradigm of fine-tuning each clip-text pair independently on the …
success by following the paradigm of fine-tuning each clip-text pair independently on the …
Learning to answer visual questions from web videos
Recent methods for visual question answering rely on large-scale annotated datasets.
Manual annotation of questions and answers for videos, however, is tedious, expensive and …
Manual annotation of questions and answers for videos, however, is tedious, expensive and …