Multimodal image synthesis and editing: A survey and taxonomy

F Zhan, Y Yu, R Wu, J Zhang, S Lu, L Liu… - … on Pattern Analysis …, 2023 - ieeexplore.ieee.org
As information exists in various modalities in real world, effective interaction and fusion
among multimodal information plays a key role for the creation and perception of multimodal …

SPIn-NeRF: Multiview segmentation and perceptual inpainting with neural radiance fields

A Mirzaei, T Aumentado-Armstrong… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Neural Radiance Fields (NeRFs) have emerged as a popular approach for novel
view synthesis. While NeRFs are quickly being adapted for a wider set of applications …

Nerfiller: Completing scenes via generative 3d inpainting

E Weber, A Holynski, V Jampani… - Proceedings of the …, 2024 - openaccess.thecvf.com
We propose NeRFiller an approach that completes missing portions of a 3D capture via
generative 3D inpainting using off-the-shelf 2D visual generative models. Often parts of a …

Pie-nerf: Physics-based interactive elastodynamics with nerf

Y Feng, Y Shang, X Li, T Shao… - Proceedings of the …, 2024 - openaccess.thecvf.com
We show that physics-based simulations can be seamlessly integrated with NeRF to
generate high-quality elastodynamics of real-world objects. Unlike existing methods we …

Perf: Panoramic neural radiance field from a single panorama

G Wang, P Wang, Z Chen, W Wang, CC Loy… - arXiv preprint arXiv …, 2023 - arxiv.org
Neural Radiance Field (NeRF) has achieved substantial progress in novel view synthesis
given multi-view images. Recently, some works have attempted to train a NeRF from a …

Semantically-aware Neural Radiance Fields for Visual Scene Understanding: A Comprehensive Review

TAQ Nguyen, A Bourki, M Macudzinski… - arXiv preprint arXiv …, 2024 - arxiv.org
This review thoroughly examines the role of semantically-aware Neural Radiance Fields
(NeRFs) in visual scene understanding, covering an analysis of over 250 scholarly papers. It …

Watch your steps: Local image and scene editing by text instructions

A Mirzaei, T Aumentado-Armstrong… - arXiv preprint arXiv …, 2023 - arxiv.org
Denoising diffusion models have enabled high-quality image generation and editing. We
present a method to localize the desired edit region implicit in a text instruction. We leverage …

Language-driven Object Fusion into Neural Radiance Fields with Pose-Conditioned Dataset Updates

KC Shum, J Kim, BS Hua… - Proceedings of the …, 2024 - openaccess.thecvf.com
Neural radiance field (NeRF) is an emerging technique for 3D scene reconstruction and
modeling. However current NeRF-based methods are limited in the capabilities of adding or …

Point'n Move: Interactive scene object manipulation on Gaussian splatting radiance fields

J Huang, H Yu, J Zhang, H Nait‐Charif - IET Image Processing, 2023 - Wiley Online Library
The authors propose Point'n Move, a method that achieves interactive scene object
manipulation with exposed region inpainting. Interactivity here further comes from intuitive …

SHAP-EDITOR: Instruction-guided Latent 3D Editing in Seconds

M Chen, J Xie, I Laina… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
We propose a novel feed-forward 3D editing framework called Shap-Editor. Prior research
on editing 3D objects primarily concentrated on editing individual objects by leveraging off …