Multi-modal motion prediction with transformer-based neural network for autonomous driving

Z Huang, X Mo, C Lv - 2022 International Conference on …, 2022 - ieeexplore.ieee.org
… of motion prediction, we propose a multimodal attention Transformer encoder, which modifies
the multihead attention mechanism to multi-modal attention, and each predictedmotion

Recoat: A deep learning-based framework for multi-modal motion prediction in autonomous driving application

Z Huang, X Mo, C Lv - 2022 IEEE 25th International …, 2022 - ieeexplore.ieee.org
multi-modal motion prediction. The framework consists of three parts: recurrent neural network
to process target agent’s motion … real-world driving dataset, Waymo open motion dataset, …

LiCaNet: Further enhancement of joint perception and motion prediction based on multi-modal fusion

YH Khalil, HT Mouftah - IEEE Open Journal of Intelligent …, 2022 - ieeexplore.ieee.org
… In this section, we review the existing prominent literature on perception and motion
prediction in the field of autonomous vehicles. Research works have established various method…

Multi-modal fusion transformer for end-to-end autonomous driving

A Prakash, K Chitta, A Geiger - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
… To overcome this limitation, we propose an attention-based Multi-Modal Fusion Transformer
that incorporates global contextual reasoning and achieves superior driving performance. …

Multi-modal trajectory prediction for autonomous driving with semantic map and dynamic graph attention network

B Dong, H Liu, Y Bai, J Lin, Z Xu, X Xu… - arXiv preprint arXiv …, 2021 - arxiv.org
… in the planning and control of the autonomous driving car. … In this paper, we present a
multi-modal trajectory prediction method … to achieve multi-modal predictions with considering traffic

Multimodal trajectory predictions for autonomous driving using deep convolutional networks

H Cui, V Radosavljevic, FC Chou… - … on robotics and …, 2019 - ieeexplore.ieee.org
… in the self-driving industry. Then, we discuss machine learning approaches for movement
prediction, … Deo and MM Trivedi, “Multi-modal trajectory prediction of surrounding vehicles with …

Shared cross-modal trajectory prediction for autonomous driving

C Choi, JH Choi, J Li, S Malla - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
autonomous vehicles, we propose a crossmodal embedding framework that demonstrates
the efficacy of the use of multiple sensor data for motion prediction… For multi-modal prediction, …

Probabilistic multi-modal trajectory prediction with lane attention for autonomous vehicles

C Luo, L Sun, D Dabiri, A Yuille - 2020 IEEE/RSJ international …, 2020 - ieeexplore.ieee.org
prediction to cover all the possibilities for the future. Our method unifies intention based and
multi-modal trajectory prediction. We evaluate our method on a large realworld urban driving

Probabilistic 3D multi-modal, multi-object tracking for autonomous driving

H Chiu, J Li, R Ambruş, J Bohg - 2021 IEEE international …, 2021 - ieeexplore.ieee.org
… We propose a probabilistic, multi-modal, multiobject tracking system consisting of … of motion
prediction. For objects that are hard to predict precisely, eg pedestrians, motorcycles or cars

Exploiting multi-modal fusion for urban autonomous driving using latent deep reinforcement learning

YH Khalil, HT Mouftah - IEEE Transactions on Vehicular …, 2022 - ieeexplore.ieee.org
predictions to train a latent DRL has not been targeted yet. To that end, we propose enhancing
urban autonomous driving using multi-modal … perception and motion prediction. These …