State of the Art in Dense Monocular Non‐Rigid 3D Reconstruction

E Tretschk, N Kairanda, M BR, R Dabral… - Computer Graphics …, 2023 - Wiley Online Library
Abstract 3D reconstruction of deformable (or non‐rigid) scenes from a set of monocular 2D
image observations is a long‐standing and actively researched area of computer vision and …

Tracking everything everywhere all at once

Q Wang, YY Chang, R Cai, Z Li… - Proceedings of the …, 2023 - openaccess.thecvf.com
We present a new test-time optimization method for estimating dense and long-range motion
from a video sequence. Prior optical flow or particle video tracking algorithms typically …

Reconstructing animatable categories from videos

G Yang, C Wang, ND Reddy… - Proceedings of the …, 2023 - openaccess.thecvf.com
Building animatable 3D models is challenging due to the need for 3D scans, laborious
registration, and manual rigging. Recently, differentiable rendering provides a pathway to …

Distilling neural fields for real-time articulated shape reconstruction

J Tan, G Yang, D Ramanan - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
We present a method for reconstructing articulated 3D models from videos in real-time,
without test-time optimization or manual 3D supervision at training time. Prior work often …

3d human keypoints estimation from point clouds in the wild without human labels

Z Weng, AS Gorban, J Ji, M Najibi… - Proceedings of the …, 2023 - openaccess.thecvf.com
Training a 3D human keypoint detector from point clouds in a supervised manner requires
large volumes of high quality labels. While it is relatively easy to capture large amounts of …

Physical Property Understanding from Language-Embedded Feature Fields

AJ Zhai, Y Shen, EY Chen, GX Wang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Can computers perceive the physical properties of objects solely through vision? Research
in cognitive science and vision science has shown that humans excel at identifying materials …

Occupancy planes for single-view rgb-d human reconstruction

X Zhao, YT Hu, Z Ren, AG Schwing - … of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
Single-view RGB-D human reconstruction with implicit functions is often formulated as per-
point classification. Specifically, a set of 3D locations within the view-frustum of the camera …

Building rearticulable models for arbitrary 3d objects from 4d point clouds

S Liu, S Gupta, S Wang - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
We build rearticulable models for arbitrary everyday man-made objects containing an
arbitrary number of parts that are connected together in arbitrary ways via 1-degree-of …

Bayesian Diffusion Models for 3D Shape Reconstruction

H Xu, Y Lei, Z Chen, X Zhang… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract We present Bayesian Diffusion Models (BDM) a prediction algorithm that performs
effective Bayesian inference by tightly coupling the top-down (prior) information with the …

Camm: Building category-agnostic and animatable 3d models from monocular videos

T Kuai, A Karthikeyan, Y Kant… - Proceedings of the …, 2023 - openaccess.thecvf.com
Animating an object in 3D often requires an articulated structure, eg a kinematic chain or
skeleton of the manipulated object with proper skinning weights, to obtain smooth …