VLN-Video: Utilizing Driving Videos for Outdoor Vision-and-Language Navigation
Outdoor Vision-and-Language Navigation (VLN) requires an agent to navigate through
realistic 3D outdoor environments based on natural language instructions. The performance …
realistic 3D outdoor environments based on natural language instructions. The performance …
MAPLM: A Real-World Large-Scale Vision-Language Benchmark for Map and Traffic Scene Understanding
Vision-language generative AI has demonstrated remarkable promise for empowering cross-
modal scene understanding of autonomous driving and high-definition (HD) map systems …
modal scene understanding of autonomous driving and high-definition (HD) map systems …
Holistic Autonomous Driving Understanding by Bird's-Eye-View Injected Multi-Modal Large Models
The rise of multimodal large language models (MLLMs) has spurred interest in language-
based driving tasks. However existing research typically focuses on limited tasks and often …
based driving tasks. However existing research typically focuses on limited tasks and often …
Drive as you speak: Enabling human-like interaction with large language models in autonomous vehicles
The future of autonomous vehicles lies in the convergence of human-centric design and
advanced AI capabilities. Autonomous vehicles of the future will not only transport …
advanced AI capabilities. Autonomous vehicles of the future will not only transport …
Lampilot: An open benchmark dataset for autonomous driving with language model programs
Autonomous driving (AD) has made significant strides in recent years. However existing
frameworks struggle to interpret and execute spontaneous user instructions such as" …
frameworks struggle to interpret and execute spontaneous user instructions such as" …
Receive, reason, and react: Drive as you say, with large language models in autonomous vehicles
The fusion of human-centric design and artificial intelligence capabilities has opened up
new possibilities for next-generation autonomous vehicles that go beyond traditional …
new possibilities for next-generation autonomous vehicles that go beyond traditional …
Dolphins: Multimodal language model for driving
The quest for fully autonomous vehicles (AVs) capable of navigating complex real-world
scenarios with human-like understanding and responsiveness. In this paper, we introduce …
scenarios with human-like understanding and responsiveness. In this paper, we introduce …
LLM4Drive: A Survey of Large Language Models for Autonomous Driving
Autonomous driving technology, a catalyst for revolutionizing transportation and urban
mobility, has the tend to transition from rule-based systems to data-driven strategies …
mobility, has the tend to transition from rule-based systems to data-driven strategies …
HiLM-D: Towards High-Resolution Understanding in Multimodal Large Language Models for Autonomous Driving
Autonomous driving systems generally employ separate models for different tasks resulting
in intricate designs. For the first time, we leverage singular multimodal large language …
in intricate designs. For the first time, we leverage singular multimodal large language …
DriveLLM: Charting the path toward full autonomous driving with large language models
Human drivers instinctively reason with commonsense knowledge to predict hazards in
unfamiliar scenarios and to understand the intentions of other road users. However, this …
unfamiliar scenarios and to understand the intentions of other road users. However, this …