Vision language models in autonomous driving: A survey and outlook

X Zhou, M Liu, E Yurtsever, BL Zagar… - IEEE Transactions …, 2024 - ieeexplore.ieee.org
The applications of Vision-Language Models (VLMs) in the field of Autonomous Driving (AD)
have attracted widespread attention due to their outstanding performance and the ability to …

VistaRAG: Toward Safe and Trustworthy Autonomous Driving Through Retrieval-Augmented Generation

X Dai, C Guo, Y Tang, H Li, Y Wang… - IEEE Transactions …, 2024 - ieeexplore.ieee.org
Autonomous driving based on foundation models has recently garnered widespread
attention. However, the risk of hallucinations inherent in foundation models could …

Large Language Models in Wargaming: Methodology Application and Robustness

Y Chen, S Chu - Proceedings of the IEEE/CVF Conference …, 2024 - openaccess.thecvf.com
Traditional artificial intelligence (AI) has contributed strategic enhancements to wargaming
but often encounters difficulties in dynamically complex environments and in adapting to …

MAPLM: A Real-World Large-Scale Vision-Language Benchmark for Map and Traffic Scene Understanding

X Cao, T Zhou, Y Ma, W Ye, C Cui… - Proceedings of the …, 2024 - openaccess.thecvf.com
Vision-language generative AI has demonstrated remarkable promise for empowering cross-
modal scene understanding of autonomous driving and high-definition (HD) map systems …

Feedback-Guided Autonomous Driving

J Zhang, Z Huang, A Ray… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
While behavior cloning has recently emerged as a highly successful paradigm for
autonomous driving humans rarely learn to perform complex tasks such as driving via …

A survey on the memory mechanism of large language model based agents

Z Zhang, X Bo, C Ma, R Li, X Chen, Q Dai, J Zhu… - arXiv preprint arXiv …, 2024 - arxiv.org
Large language model (LLM) based agents have recently attracted much attention from the
research and industry communities. Compared with original LLMs, LLM-based agents are …

Summary and Reflections on Pedestrian Trajectory Prediction in the Field of Autonomous Driving

Z Fu, K Jiang, C Xie, Y Xu, J Huang… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Pedestrian trajectory prediction is a classic and challenging scientific task that involves
complex engineering science and human factors. These challenges have spurred a …

DrPlanner: Diagnosis and Repair of Motion Planners Using Large Language Models

Y Lin, C Li, M Ding, M Tomizuka, W Zhan… - arXiv preprint arXiv …, 2024 - arxiv.org
Motion planners are essential for the safe operation of automated vehicles across various
scenarios. However, no motion planning algorithm has achieved perfection in the literature …

Traj-LLM: A New Exploration for Empowering Trajectory Prediction with Pre-trained Large Language Models

Z Lan, H Li, L Liu, B Fan, Y Lv, Y Ren, Z Cui - arXiv preprint arXiv …, 2024 - arxiv.org
Predicting the future trajectories of dynamic traffic actors is a cornerstone task in
autonomous driving. Though existing notable efforts have resulted in impressive …

Integration of Mixture of Experts and Multimodal Generative AI in Internet of Vehicles: A Survey

M Xu, D Niyato, J Kang, Z Xiong, A Jamalipour… - arXiv preprint arXiv …, 2024 - arxiv.org
Generative AI (GAI) can enhance the cognitive, reasoning, and planning capabilities of
intelligent modules in the Internet of Vehicles (IoV) by synthesizing augmented datasets …