Nerfiller: Completing scenes via generative 3d inpainting

E Weber, A Holynski, V Jampani… - Proceedings of the …, 2024 - openaccess.thecvf.com
We propose NeRFiller an approach that completes missing portions of a 3D capture via
generative 3D inpainting using off-the-shelf 2D visual generative models. Often parts of a …

Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Review

TAQ Nguyen, A Bourki, M Macudzinski… - arXiv preprint arXiv …, 2024 - arxiv.org
This review thoroughly examines the role of semantically-aware Neural Radiance Fields
(NeRFs) in visual scene understanding, covering an analysis of over 250 scholarly papers. It …

Watch your steps: Local image and scene editing by text instructions

A Mirzaei, T Aumentado-Armstrong… - arXiv preprint arXiv …, 2023 - arxiv.org
Denoising diffusion models have enabled high-quality image generation and editing. We
present a method to localize the desired edit region implicit in a text instruction. We leverage …

invs: Repurposing diffusion inpainters for novel view synthesis

Y Kant, A Siarohin, M Vasilkovsky, RA Guler… - SIGGRAPH Asia 2023 …, 2023 - dl.acm.org
In this paper, we present a method for generating consistent novel views from a single
source image. Our approach focuses on maximizing the reuse of visible pixels from the …

MVIP-NeRF: Multi-view 3D Inpainting on NeRF Scenes via Diffusion Prior

H Chen, CC Loy, X Pan - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
Despite the emergence of successful NeRF inpainting methods built upon explicit RGB and
depth 2D inpainting supervisions these methods are inherently constrained by the …

Luciddreaming: Controllable object-centric 3d generation

Z Wang, M Li, C Chen - arXiv preprint arXiv:2312.00588, 2023 - arxiv.org
With the recent development of generative models, Text-to-3D generations have also seen
significant growth. Nonetheless, achieving precise control over 3D generation continues to …

InFusion: Inpainting 3D Gaussians via Learning Depth Completion from Diffusion Prior

Z Liu, H Ouyang, Q Wang, KL Cheng, J Xiao… - arXiv preprint arXiv …, 2024 - arxiv.org
3D Gaussians have recently emerged as an efficient representation for novel view synthesis.
This work studies its editability with a particular focus on the inpainting task, which aims to …

Reconstructive latent-space neural radiance fields for efficient 3d scene representations

T Aumentado-Armstrong, A Mirzaei… - arXiv preprint arXiv …, 2023 - arxiv.org
Neural Radiance Fields (NeRFs) have proven to be powerful 3D representations, capable of
high quality novel view synthesis of complex scenes. While NeRFs have been applied to …

GO-NeRF: Generating Virtual Objects in Neural Radiance Fields

P Dai, F Tan, X Yu, Y Zhang, X Qi - arXiv preprint arXiv:2401.05750, 2024 - arxiv.org
Despite advances in 3D generation, the direct creation of 3D objects within an existing 3D
scene represented as NeRF remains underexplored. This process requires not only high …

GScream: Learning 3D Geometry and Feature Consistent Gaussian Splatting for Object Removal

Y Wang, Q Wu, G Zhang, D Xu - arXiv preprint arXiv:2404.13679, 2024 - arxiv.org
This paper tackles the intricate challenge of object removal to update the radiance field
using the 3D Gaussian Splatting. The main challenges of this task lie in the preservation of …