MAPLM: A Real-World Large-Scale Vision-Language Benchmark for Map and Traffic Scene Understanding
Vision-language generative AI has demonstrated remarkable promise for empowering cross-
modal scene understanding of autonomous driving and high-definition (HD) map systems …
modal scene understanding of autonomous driving and high-definition (HD) map systems …
Drivevlm: The convergence of autonomous driving and large vision-language models
A primary hurdle of autonomous driving in urban environments is understanding complex
and long-tail scenarios, such as challenging road conditions and delicate human behaviors …
and long-tail scenarios, such as challenging road conditions and delicate human behaviors …
Holistic Autonomous Driving Understanding by Bird's-Eye-View Injected Multi-Modal Large Models
The rise of multimodal large language models (MLLMs) has spurred interest in language-
based driving tasks. However existing research typically focuses on limited tasks and often …
based driving tasks. However existing research typically focuses on limited tasks and often …
Hilm-d: Towards high-resolution understanding in multimodal large language models for autonomous driving
Autonomous driving systems generally employ separate models for different tasks resulting
in intricate designs. For the first time, we leverage singular multimodal large language …
in intricate designs. For the first time, we leverage singular multimodal large language …
On the road with gpt-4v (ision): Early explorations of visual-language model on autonomous driving
The pursuit of autonomous driving technology hinges on the sophisticated integration of
perception, decision-making, and control systems. Traditional approaches, both data-driven …
perception, decision-making, and control systems. Traditional approaches, both data-driven …
Automated evaluation of large vision-language models on self-driving corner cases
Large Vision-Language Models (LVLMs), due to the remarkable visual reasoning ability to
understand images and videos, have received widespread attention in the autonomous …
understand images and videos, have received widespread attention in the autonomous …
Talk2BEV: Language-enhanced Bird's-eye View Maps for Autonomous Driving
Talk2BEV is a large vision-language model (LVLM) interface for bird's-eye view (BEV) maps
in autonomous driving contexts. While existing perception systems for autonomous driving …
in autonomous driving contexts. While existing perception systems for autonomous driving …
VLM2Scene: Self-Supervised Image-Text-LiDAR Learning with Foundation Models for Autonomous Driving Scene Understanding
Vision and language foundation models (VLMs) have showcased impressive capabilities in
2D scene understanding. However, their latent potential in elevating the understanding of …
2D scene understanding. However, their latent potential in elevating the understanding of …
Drivegpt4: Interpretable end-to-end autonomous driving via large language model
In the past decade, autonomous driving has experienced rapid development in both
academia and industry. However, its limited interpretability remains a significant unsolved …
academia and industry. However, its limited interpretability remains a significant unsolved …
Embodied understanding of driving scenarios
Embodied scene understanding serves as the cornerstone for autonomous agents to
perceive, interpret, and respond to open driving scenarios. Such understanding is typically …
perceive, interpret, and respond to open driving scenarios. Such understanding is typically …