EgoCVR: An Egocentric Benchmark for Fine-Grained Composed Video Retrieval
In Composed Video Retrieval, a video and a textual description which modifies the video
content are provided as inputs to the model. The aim is to retrieve the relevant video with the …
content are provided as inputs to the model. The aim is to retrieve the relevant video with the …
VideoEval: Comprehensive Benchmark Suite for Low-Cost Evaluation of Video Foundation Model
With the growth of high-quality data and advancement in visual pre-training paradigms,
Video Foundation Models (VFMs) have made significant progress recently, demonstrating …
Video Foundation Models (VFMs) have made significant progress recently, demonstrating …
Localizing Events in Videos with Multimodal Queries
Video understanding is a pivotal task in the digital era, yet the dynamic and multievent
nature of videos makes them labor-intensive and computationally demanding to process …
nature of videos makes them labor-intensive and computationally demanding to process …
VTG-LLM: Integrating Timestamp Knowledge into Video LLMs for Enhanced Video Temporal Grounding
Video Temporal Grounding (VTG) focuses on accurately identifying event timestamps within
a particular video based on a linguistic query, playing a vital role in downstream tasks such …
a particular video based on a linguistic query, playing a vital role in downstream tasks such …
Foundation Models for Video Understanding: A Survey
Video Foundation Models (ViFMs) aim to learn a general-purpose representation for various
video understanding tasks. Leveraging large-scale datasets and powerful models, ViFMs …
video understanding tasks. Leveraging large-scale datasets and powerful models, ViFMs …
Tarsier: Recipes for Training and Evaluating Large Video Description Models
J Wang, L Yuan, Y Zhang - arXiv preprint arXiv:2407.00634, 2024 - arxiv.org
Generating fine-grained video descriptions is a fundamental challenge in video
understanding. In this work, we introduce Tarsier, a family of large-scale video-language …
understanding. In this work, we introduce Tarsier, a family of large-scale video-language …
Video Foundation Models for Animal Behavior Analysis
Computational approaches leveraging computer vision and machine learning have
transformed the quantification of animal behavior from video. However, existing methods …
transformed the quantification of animal behavior from video. However, existing methods …