Decomposing nerf for editing via feature field distillation

S Kobayashi, E Matsumoto… - Advances in Neural …, 2022 - proceedings.neurips.cc
Emerging neural radiance fields (NeRF) are a promising scene representation for computer
graphics, enabling high-quality 3D reconstruction and novel view synthesis from image …

Panoptic neural fields: A semantic object-aware neural scene representation

A Kundu, K Genova, X Yin, A Fathi… - Proceedings of the …, 2022 - openaccess.thecvf.com
We present PanopticNeRF, an object-aware neural scene representation that decomposes
a scene into a set of objects (things) and background (stuff). Each object is represented by a …

Diffrf: Rendering-guided 3d radiance field diffusion

N Müller, Y Siddiqui, L Porzi, SR Bulo… - Proceedings of the …, 2023 - openaccess.thecvf.com
We introduce DiffRF, a novel approach for 3D radiance field synthesis based on denoising
diffusion probabilistic models. While existing diffusion-based methods operate on images …

Scannet++: A high-fidelity dataset of 3d indoor scenes

C Yeshwanth, YC Liu, M Nießner… - Proceedings of the …, 2023 - openaccess.thecvf.com
We present ScanNet++, a large-scale dataset that couples together capture of high-quality
and commodity-level geometry and color of indoor scenes. Each scene is captured with a …

Suds: Scalable urban dynamic scenes

H Turki, JY Zhang, F Ferroni… - Proceedings of the …, 2023 - openaccess.thecvf.com
We extend neural radiance fields (NeRFs) to dynamic large-scale urban scenes. Prior work
tends to reconstruct single video clips of short durations (up to 10 seconds). Two reasons …

Gaussianavatar: Towards realistic human avatar modeling from a single video via animatable 3d gaussians

L Hu, H Zhang, Y Zhang, B Zhou… - Proceedings of the …, 2024 - openaccess.thecvf.com
We present GaussianAvatar an efficient approach to creating realistic human avatars with
dynamic 3D appearances from a single video. We start by introducing animatable 3D …

Panoptic lifting for 3d scene understanding with neural fields

Y Siddiqui, L Porzi, SR Buló, N Müller… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract We propose Panoptic Lifting, a novel approach for learning panoptic 3D volumetric
representations from images of in-the-wild scenes. Once trained, our model can render color …

Segment anything in 3d with nerfs

J Cen, Z Zhou, J Fang, W Shen, L Xie… - Advances in …, 2023 - proceedings.neurips.cc
Abstract Recently, the Segment Anything Model (SAM) emerged as a powerful vision
foundation model which is capable to segment anything in 2D images. This paper aims to …

Neural feature fusion fields: 3d distillation of self-supervised 2d image representations

V Tschernezki, I Laina, D Larlus… - … Conference on 3D …, 2022 - ieeexplore.ieee.org
We present Neural Feature Fusion Fields (N3F),\a method that improves dense 2D image
feature extractors when the latter are applied to the analysis of multiple images …

Nerf-det: Learning geometry-aware volumetric representation for multi-view 3d object detection

C Xu, B Wu, J Hou, S Tsai, R Li… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract We present NeRF-Det, a novel method for indoor 3D detection with posed RGB
images as input. Unlike existing indoor 3D detection methods that struggle to model scene …