A survey on multimodal large language models for autonomous driving
With the emergence of Large Language Models (LLMs) and Vision Foundation Models
(VFMs), multimodal AI systems benefiting from large models have the potential to equally …
(VFMs), multimodal AI systems benefiting from large models have the potential to equally …
End-to-end autonomous driving: Challenges and frontiers
The autonomous driving community has witnessed a rapid growth in approaches that
embrace an end-to-end algorithm framework, utilizing raw sensor input to generate vehicle …
embrace an end-to-end algorithm framework, utilizing raw sensor input to generate vehicle …
Language-conditioned learning for robotic manipulation: A survey
Language-conditioned robotic manipulation represents a cutting-edge area of research,
enabling seamless communication and cooperation between humans and robotic agents …
enabling seamless communication and cooperation between humans and robotic agents …
Dme-driver: Integrating human decision logic and 3d scene perception in autonomous driving
In the field of autonomous driving, two important features of autonomous driving car systems
are the explainability of decision logic and the accuracy of environmental perception. This …
are the explainability of decision logic and the accuracy of environmental perception. This …
Ground then navigate: Language-guided navigation in dynamic scenes
We investigate the Vision-and-Language Navigation (VLN) problem in the context of
autonomous driving in outdoor settings. We solve the problem by explicitly grounding the …
autonomous driving in outdoor settings. We solve the problem by explicitly grounding the …
Vision language models in autonomous driving: A survey and outlook
The applications of Vision-Language Models (VLMs) in the field of Autonomous Driving (AD)
have attracted widespread attention due to their outstanding performance and the ability to …
have attracted widespread attention due to their outstanding performance and the ability to …
LASO: Language-guided Affordance Segmentation on 3D Object
Segmenting affordance in 3D data is key for bridging perception and action in robots.
Existing efforts mostly focus on the visual side and overlook the affordance knowledge from …
Existing efforts mostly focus on the visual side and overlook the affordance knowledge from …
Prospective Role of Foundation Models in Advancing Autonomous Vehicles
J Wu, B Gao, J Gao, J Yu, H Chu, Q Yu, X Gong… - Research, 2024 - spj.science.org
With the development of artificial intelligence and breakthroughs in deep learning, large-
scale foundation models (FMs), such as generative pre-trained transformer (GPT), Sora, etc …
scale foundation models (FMs), such as generative pre-trained transformer (GPT), Sora, etc …
Applications of large scale foundation models for autonomous driving
Y Huang, Y Chen, Z Li - arXiv preprint arXiv:2311.12144, 2023 - arxiv.org
Since DARPA Grand Challenges (rural) in 2004/05 and Urban Challenges in 2007,
autonomous driving has been the most active field of AI applications. Recently powered by …
autonomous driving has been the most active field of AI applications. Recently powered by …
Talk2Car: Predicting physical trajectories for natural language commands
In recent years, there has been an increased interest in giving verbal commands to self-
driving cars. Even though multiple companies have showcased progress towards fully …
driving cars. Even though multiple companies have showcased progress towards fully …