SPIn-NeRF: Multiview segmentation and perceptual inpainting with neural radiance fields

A Mirzaei, T Aumentado-Armstrong… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Neural Radiance Fields (NeRFs) have emerged as a popular approach for novel
view synthesis. While NeRFs are quickly being adapted for a wider set of applications …

Reference-guided controllable inpainting of neural radiance fields

A Mirzaei, T Aumentado-Armstrong… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract The popularity of Neural Radiance Fields (NeRFs) for view synthesis has led to a
desire for NeRF editing tools. Here, we focus on inpainting regions in a view-consistent and …

Keys to better image inpainting: Structure and texture go hand in hand

J Jain, Y Zhou, N Yu, H Shi - Proceedings of the IEEE/CVF …, 2023 - openaccess.thecvf.com
Deep image inpainting has made impressive progress with recent advances in image
generation and processing algorithms. We claim that the performance of inpainting …

Consistent video inpainting using axial attention-based style transformer

MS Junayed, MB Islam - IEEE Transactions on Multimedia, 2022 - ieeexplore.ieee.org
Maintaining spatial and temporal consistency in the inpainted video area of the video is a
challenging problem. Recent research focuses on flow information for synthesizing …

SR-DeblurUGAN: An end-to-end super-resolution and deblurring model with high performance

Y Xiao, J Zhang, W Chen, Y Wang, J You, Q Wang - Drones, 2022 - mdpi.com
In this paper, we consider the difference in the abstraction level of features extracted by
different perceptual layers and use a weighted perceptual loss-based generative adversarial …

Reference-based painterly inpainting via diffusion: Crossing the wild reference domain gap

D Xu, X Xu, W Cong, H Shi, Z Wang - arXiv preprint arXiv:2307.10584, 2023 - arxiv.org
Have you ever imagined how it would look if we placed new objects into paintings? For
example, what would it look like if we placed a basketball into Claude Monet's``Water Lilies …

LeftRefill: Filling Right Canvas based on Left Reference through Generalized Text-to-Image Diffusion Model

C Cao, Y Cai, Q Dong, Y Wang… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
This paper introduces LeftRefill an innovative approach to efficiently harness large Text-to-
Image (T2I) diffusion models for reference-guided image synthesis. As the name implies …

Generating high-quality texture via panoramic feature aggregation for large mask inpainting

B Wang, J Peng, H Li, H Wang - Knowledge-Based Systems, 2024 - Elsevier
With the development of image generation and processing techniques, image inpainting
techniques based on deep learning have achieved impressive results. Especially the …

3dfill: Reference-guided image inpainting by self-supervised 3d image alignment

L Zhao, X Zhao, H Ma, X Zhang, L Zeng - arXiv preprint arXiv:2211.04831, 2022 - arxiv.org
Most existing image inpainting algorithms are based on a single view, struggling with large
holes or the holes containing complicated scenes. Some reference-guided algorithms fill the …

Towards Unified Keyframe Propagation Models

P Esser, P Michael, S Sengupta - arXiv preprint arXiv:2205.09731, 2022 - arxiv.org
Many video editing tasks such as rotoscoping or object removal require the propagation of
context across frames. While transformers and other attention-based approaches that …