Mitigating object hallucinations in large vision-language models through visual contrastive decoding
Abstract Large Vision-Language Models (LVLMs) have advanced considerably intertwining
visual recognition and language understanding to generate content that is not only coherent …
visual recognition and language understanding to generate content that is not only coherent …
A survey on multimodal large language models for autonomous driving
With the emergence of Large Language Models (LLMs) and Vision Foundation Models
(VFMs), multimodal AI systems benefiting from large models have the potential to equally …
(VFMs), multimodal AI systems benefiting from large models have the potential to equally …
Lmdrive: Closed-loop end-to-end driving with large language models
Despite significant recent progress in the field of autonomous driving modern methods still
struggle and can incur serious accidents when encountering long-tail unforeseen events …
struggle and can incur serious accidents when encountering long-tail unforeseen events …
Drivelm: Driving with graph visual question answering
We study how vision-language models (VLMs) trained on web-scale data can be integrated
into end-to-end driving systems to boost generalization and enable interactivity with human …
into end-to-end driving systems to boost generalization and enable interactivity with human …
LL3DA: Visual Interactive Instruction Tuning for Omni-3D Understanding Reasoning and Planning
Abstract Recent progress in Large Multimodal Models (LMM) has opened up great
possibilities for various applications in the field of human-machine interactions. However …
possibilities for various applications in the field of human-machine interactions. However …
Lampilot: An open benchmark dataset for autonomous driving with language model programs
Autonomous driving (AD) has made significant strides in recent years. However existing
frameworks struggle to interpret and execute spontaneous user instructions such as" …
frameworks struggle to interpret and execute spontaneous user instructions such as" …
On the road with gpt-4v (ision): Early explorations of visual-language model on autonomous driving
The pursuit of autonomous driving technology hinges on the sophisticated integration of
perception, decision-making, and control systems. Traditional approaches, both data-driven …
perception, decision-making, and control systems. Traditional approaches, both data-driven …
Vision language models in autonomous driving and intelligent transportation systems
The applications of Vision-Language Models (VLMs) in the fields of Autonomous Driving
(AD) and Intelligent Transportation Systems (ITS) have attracted widespread attention due to …
(AD) and Intelligent Transportation Systems (ITS) have attracted widespread attention due to …
Towards knowledge-driven autonomous driving
This paper explores the emerging knowledge-driven autonomous driving technologies. Our
investigation highlights the limitations of current autonomous driving systems, in particular …
investigation highlights the limitations of current autonomous driving systems, in particular …
Large language models as traffic signal control agents: Capacity and opportunity
Traffic signal control is crucial for optimizing the efficiency of road network by regulating
traffic light phases. Existing research predominantly focuses on heuristic or reinforcement …
traffic light phases. Existing research predominantly focuses on heuristic or reinforcement …