Planning-oriented autonomous driving

Y Hu, J Yang, L Chen, K Li, C Sima… - Proceedings of the …, 2023 - openaccess.thecvf.com
Modern autonomous driving system is characterized as modular tasks in sequential order,
ie, perception, prediction, and planning. In order to perform a wide diversity of tasks and …

Query-centric trajectory prediction

Z Zhou, J Wang, YH Li… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Predicting the future trajectories of surrounding agents is essential for autonomous vehicles
to operate safely. This paper presents QCNet, a modeling framework toward pushing the …

Lmdrive: Closed-loop end-to-end driving with large language models

H Shao, Y Hu, L Wang, G Song… - Proceedings of the …, 2024 - openaccess.thecvf.com
Despite significant recent progress in the field of autonomous driving modern methods still
struggle and can incur serious accidents when encountering long-tail unforeseen events …

Motionlm: Multi-agent motion forecasting as language modeling

A Seff, B Cera, D Chen, M Ng, A Zhou… - Proceedings of the …, 2023 - openaccess.thecvf.com
Reliable forecasting of the future behavior of road agents is a critical component to safe
planning in autonomous vehicles. Here, we represent continuous trajectories as sequences …

Think twice before driving: Towards scalable decoders for end-to-end autonomous driving

X Jia, P Wu, L Chen, J Xie, C He… - Proceedings of the …, 2023 - openaccess.thecvf.com
End-to-end autonomous driving has made impressive progress in recent years. Existing
methods usually adopt the decoupled encoder-decoder paradigm, where the encoder …

Unitr: A unified and efficient multi-modal transformer for bird's-eye-view representation

H Wang, H Tang, S Shi, A Li, Z Li… - Proceedings of the …, 2023 - openaccess.thecvf.com
Jointly processing information from multiple sensors is crucial to achieving accurate and
robust perception for reliable autonomous driving systems. However, current 3D perception …

Mtr++: Multi-agent motion prediction with symmetric scene modeling and guided intention querying

S Shi, L Jiang, D Dai, B Schiele - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
Motion prediction is crucial for autonomous driving systems to understand complex driving
scenarios and make informed decisions. However, this task is challenging due to the diverse …

Gameformer: Game-theoretic modeling and learning of transformer-based interactive prediction and planning for autonomous driving

Z Huang, H Liu, C Lv - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
Autonomous vehicles operating in complex real-world environments require accurate
predictions of interactive behaviors between traffic participants. This paper tackles the …

Standing between past and future: Spatio-temporal modeling for multi-camera 3d multi-object tracking

Z Pang, J Li, P Tokmakov, D Chen… - Proceedings of the …, 2023 - openaccess.thecvf.com
This work proposes an end-to-end multi-camera 3D multi-object tracking (MOT) framework. It
emphasizes spatio-temporal continuity and integrates both past and future reasoning for …

Rethinking integration of prediction and planning in deep learning-based automated driving systems: a review

S Hagedorn, M Hallgarten, M Stoll… - arXiv preprint arXiv …, 2023 - arxiv.org
Automated driving has the potential to revolutionize personal, public, and freight mobility.
Besides the enormous challenge of perception, ie accurately perceiving the environment …