Deep learning for image and point cloud fusion in autonomous driving: A review

Y Cui, R Chen, W Chu, L Chen, D Tian… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Autonomous vehicles were experiencing rapid development in the past few years. However,
achieving full autonomy is not a trivial task, due to the nature of the complex and dynamic …

Deep depth completion from extremely sparse data: A survey

J Hu, C Bao, M Ozay, C Fan, Q Gao… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Depth completion aims at predicting dense pixel-wise depth from an extremely sparse map
captured from a depth sensor, eg, LiDARs. It plays an essential role in various applications …

Multimodal virtual point 3d detection

T Yin, X Zhou, P Krähenbühl - Advances in Neural …, 2021 - proceedings.neurips.cc
Lidar-based sensing drives current autonomous vehicles. Despite rapid progress, current
Lidar sensors still lag two decades behind traditional color cameras in terms of resolution …

The temporal opportunist: Self-supervised multi-frame monocular depth

J Watson, O Mac Aodha, V Prisacariu… - Proceedings of the …, 2021 - openaccess.thecvf.com
Self-supervised monocular depth estimation networks are trained to predict scene depth
using nearby frames as a supervision signal during training. However, for many …

Penet: Towards precise and efficient image guided depth completion

M Hu, S Wang, B Li, S Ning, L Fan… - 2021 IEEE International …, 2021 - ieeexplore.ieee.org
Image guided depth completion is the task of generating a dense depth map from a sparse
depth map and a high quality image. In this task, how to fuse the color and depth modalities …

Depthformer: Exploiting long-range correlation and local information for accurate monocular depth estimation

Z Li, Z Chen, X Liu, J Jiang - Machine Intelligence Research, 2023 - Springer
This paper aims to address the problem of supervised monocular depth estimation. We start
with a meticulous pilot study to demonstrate that the long-range correlation is essential for …

Monovit: Self-supervised monocular depth estimation with a vision transformer

C Zhao, Y Zhang, M Poggi, F Tosi… - … conference on 3D …, 2022 - ieeexplore.ieee.org
Self-supervised monocular depth estimation is an attractive solution that does not require
hard-to-source depth la-bels for training. Convolutional neural networks (CNNs) have …

Non-local spatial propagation network for depth completion

J Park, K Joo, Z Hu, CK Liu, I So Kweon - Computer Vision–ECCV 2020 …, 2020 - Springer
In this paper, we propose a robust and efficient end-to-end non-local spatial propagation
network for depth completion. The proposed network takes RGB and sparse depth images …

Towards robust monocular depth estimation: Mixing datasets for zero-shot cross-dataset transfer

R Ranftl, K Lasinger, D Hafner… - IEEE transactions on …, 2020 - ieeexplore.ieee.org
The success of monocular depth estimation relies on large and diverse training sets. Due to
the challenges associated with acquiring dense ground-truth depth across different …

Self-supervised monocular depth estimation: Solving the dynamic object problem by semantic guidance

M Klingner, JA Termöhlen, J Mikolajczyk… - Computer Vision–ECCV …, 2020 - Springer
Self-supervised monocular depth estimation presents a powerful method to obtain 3D scene
information from single camera images, which is trainable on arbitrary image sequences …