Multi-frame self-supervised depth with transformers

V Guizilini, R Ambruș, D Chen… - Proceedings of the …, 2022 - openaccess.thecvf.com
Multi-frame depth estimation improves over single-frame approaches by also leveraging
geometric relationships between images via feature matching, in addition to learning …

Self-supervised monocular depth estimation for gastrointestinal endoscopy

Y Liu, S Zuo - Computer Methods and Programs in Biomedicine, 2023 - Elsevier
Background and objective: Gastrointestinal (GI) endoscopy represents a promising tool for
GI cancer screening. However, the limited field of view and uneven skills of endoscopists …

Learning optical flow, depth, and scene flow without real-world labels

V Guizilini, KH Lee, R Ambruş… - IEEE Robotics and …, 2022 - ieeexplore.ieee.org
Self-supervised monocular depth estimation enables robots to learn 3D perception from raw
video streams. This scalable approach leverages projective geometry and ego-motion to …

Deep geometry-aware camera self-calibration from video

A Hagemann, M Knorr, C Stiller - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Accurate intrinsic calibration is essential for camera-based 3D perception, yet, it typically
requires targets of well-known geometry. Here, we propose a camera self-calibration …

Cameras as rays: Pose estimation via ray diffusion

JY Zhang, A Lin, M Kumar, TH Yang… - arXiv preprint arXiv …, 2024 - arxiv.org
Estimating camera poses is a fundamental task for 3D reconstruction and remains
challenging given sparsely sampled views (< 10). In contrast to existing approaches that …

Attentive and contrastive learning for joint depth and motion field estimation

S Lee, F Rameau, F Pan… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Estimating the motion of the camera together with the 3D structure of the scene from a
monocular vision system is a complex task that often relies on the so-called scene rigidity …

Geometric unsupervised domain adaptation for semantic segmentation

V Guizilini, J Li, R Ambruș… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Simulators can efficiently generate large amounts of labeled synthetic data with perfect
supervision for hard-to-label tasks like semantic segmentation. However, they introduce a …

Full surround monodepth from multiple cameras

V Guizilini, I Vasiljevic, R Ambrus… - IEEE Robotics and …, 2022 - ieeexplore.ieee.org
Self-supervised monocular depth and ego-motion estimation is a promising approach to
replace or supplement expensive depth sensors such as LiDAR for robotics applications like …

Depth field networks for generalizable multi-view scene representation

V Guizilini, I Vasiljevic, J Fang, R Ambru… - … on Computer Vision, 2022 - Springer
Modern 3D computer vision leverages learning to boost geometric reasoning, mapping
image data to classical structures such as cost volumes or epipolar constraints to improve …

DualRefine: Self-supervised depth and pose estimation through iterative epipolar sampling and refinement toward equilibrium

A Bangunharcana, A Magd… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Self-supervised multi-frame depth estimation achieves high accuracy by computing
matching costs of pixel correspondences between adjacent frames, injecting geometric …