A survey on multimodal large language models for autonomous driving

C Cui, Y Ma, X Cao, W Ye, Y Zhou… - Proceedings of the …, 2024 - openaccess.thecvf.com
With the emergence of Large Language Models (LLMs) and Vision Foundation Models
(VFMs), multimodal AI systems benefiting from large models have the potential to equally …

Lampilot: An open benchmark dataset for autonomous driving with language model programs

Y Ma, C Cui, X Cao, W Ye, P Liu, J Lu… - Proceedings of the …, 2024 - openaccess.thecvf.com
Autonomous driving (AD) has made significant strides in recent years. However existing
frameworks struggle to interpret and execute spontaneous user instructions such as" …

Drive as you speak: Enabling human-like interaction with large language models in autonomous vehicles

C Cui, Y Ma, X Cao, W Ye… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
The future of autonomous vehicles lies in the convergence of human-centric design and
advanced AI capabilities. Autonomous vehicles of the future will not only transport …

Trends and challenges of real-time learning in large language models: A critical review

M Jovanovic, P Voss - arXiv preprint arXiv:2404.18311, 2024 - arxiv.org
Real-time learning concerns the ability of learning systems to acquire knowledge over time,
enabling their adaptation and generalization to novel tasks. It is a critical ability for …

A survey of large language models for autonomous driving

Z Yang, X Jia, H Li, J Yan - arXiv preprint arXiv:2311.01043, 2023 - arxiv.org
Autonomous driving technology, a catalyst for revolutionizing transportation and urban
mobility, has the tend to transition from rule-based systems to data-driven strategies …

Flashdecoding++: Faster large language model inference on gpus

K Hong, G Dai, J Xu, Q Mao, X Li, J Liu, K Chen… - arXiv preprint arXiv …, 2023 - arxiv.org
As the Large Language Model (LLM) becomes increasingly important in various domains.
However, the following challenges still remain unsolved in accelerating LLM inference:(1) …

Towards knowledge-driven autonomous driving

X Li, Y Bai, P Cai, L Wen, D Fu, B Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
This paper explores the emerging knowledge-driven autonomous driving technologies. Our
investigation highlights the limitations of current autonomous driving systems, in particular …

Human-centric autonomous systems with llms for user command reasoning

Y Yang, Q Zhang, C Li, DS Marta… - Proceedings of the …, 2024 - openaccess.thecvf.com
The evolution of autonomous driving has made remarkable advancements in recent years,
evolving into a tangible reality. However, a human-centric large-scale adoption hinges on …

Feedback-Guided Autonomous Driving

J Zhang, Z Huang, A Ray… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
While behavior cloning has recently emerged as a highly successful paradigm for
autonomous driving humans rarely learn to perform complex tasks such as driving via …

LC-LLM: Explainable Lane-Change Intention and Trajectory Predictions with Large Language Models

M Peng, X Guo, X Chen, M Zhu, K Chen… - arXiv preprint arXiv …, 2024 - arxiv.org
To ensure safe driving in dynamic environments, autonomous vehicles should possess the
capability to accurately predict the lane change intentions of surrounding vehicles in …