Lampilot: An open benchmark dataset for autonomous driving with language model programs
Autonomous driving (AD) has made significant strides in recent years. However existing
frameworks struggle to interpret and execute spontaneous user instructions such as" …
frameworks struggle to interpret and execute spontaneous user instructions such as" …
MAPLM: A Real-World Large-Scale Vision-Language Benchmark for Map and Traffic Scene Understanding
Vision-language generative AI has demonstrated remarkable promise for empowering cross-
modal scene understanding of autonomous driving and high-definition (HD) map systems …
modal scene understanding of autonomous driving and high-definition (HD) map systems …
Exploring Backdoor Attacks against Large Language Model-based Decision Making
Large Language Models (LLMs) have shown significant promise in decision-making tasks
when fine-tuned on specific applications, leveraging their inherent common sense and …
when fine-tuned on specific applications, leveraging their inherent common sense and …
Delving into Multi-modal Multi-task Foundation Models for Road Scene Understanding: From Learning Paradigm Perspectives
Foundation models have indeed made a profound impact on various fields, emerging as
pivotal components that significantly shape the capabilities of intelligent systems. In the …
pivotal components that significantly shape the capabilities of intelligent systems. In the …
From Words to Actions: Unveiling the Theoretical Underpinnings of LLM-Driven Autonomous Systems
J He, S Chen, F Zhang, Z Yang - arXiv preprint arXiv:2405.19883, 2024 - arxiv.org
In this work, from a theoretical lens, we aim to understand why large language model (LLM)
empowered agents are able to solve decision-making problems in the physical world. To …
empowered agents are able to solve decision-making problems in the physical world. To …
Can Vehicle Motion Planning Generalize to Realistic Long-tail Scenarios?
Real-world autonomous driving systems must make safe decisions in the face of rare and
diverse traffic scenarios. Current state-of-the-art planners are mostly evaluated on real-world …
diverse traffic scenarios. Current state-of-the-art planners are mostly evaluated on real-world …
Co-driver: VLM-based Autonomous Driving Assistant with Human-like Behavior and Understanding for Complex Road Scenes
Recent research about Large Language Model based autonomous driving solutions shows
a promising picture in planning and control fields. However, heavy computational resources …
a promising picture in planning and control fields. However, heavy computational resources …