A survey on multimodal benchmarks: In the era of large ai models
The rapid evolution of Multimodal Large Language Models (MLLMs) has brought substantial
advancements in artificial intelligence, significantly enhancing the capability to understand …
advancements in artificial intelligence, significantly enhancing the capability to understand …
How and where does CLIP process negation?
Various benchmarks have been proposed to test linguistic understanding in pre-trained
vision\& language (VL) models. Here we build on the existence task from the VALSE …
vision\& language (VL) models. Here we build on the existence task from the VALSE …
Vlm-ad: End-to-end autonomous driving through vision-language model supervision
Human drivers rely on commonsense reasoning to navigate diverse and dynamic real-world
scenarios. Existing end-to-end (E2E) autonomous driving (AD) models are typically …
scenarios. Existing end-to-end (E2E) autonomous driving (AD) models are typically …
Video-Language Understanding: A Survey from Model Architecture, Model Training, and Data Perspectives
Humans use multiple senses to comprehend the environment. Vision and language are two
of the most vital senses since they allow us to easily communicate our thoughts and …
of the most vital senses since they allow us to easily communicate our thoughts and …
CV-Probes: Studying the interplay of lexical and world knowledge in visually grounded verb understanding
This study investigates the ability of various vision-language (VL) models to ground context-
dependent and non-context-dependent verb phrases. To do that, we introduce the CV …
dependent and non-context-dependent verb phrases. To do that, we introduce the CV …