Generating diverse structure for image inpainting with hierarchical VQ-VAE

J Peng, D Liu, S Xu, H Li - … of the IEEE/CVF conference on …, 2021 - openaccess.thecvf.com
… • We propose a multiple-solution image inpainting method based on hierarchical VQ-VAE.
The method has two distinctions from previous multiple-solution methods: first, the model …

Visual prompting via image inpainting

A Bar, Y Gandelsman, T Darrell… - Advances in Neural …, 2022 - proceedings.neurips.cc
… We turn to describe how to perform visual prompting using Image Inpainting models. In
Section 3.1, we describe our proposed inpainting model, which is a combination of MAE and VQ

Reduce information loss in transformers for pluralistic image inpainting

Q Liu, Z Tan, D Chen, Q Chu, X Dai… - Proceedings of the …, 2022 - openaccess.thecvf.com
… Recently, based on the similar quantization mechanism with VQ-VAEinpainted images,
there are two different types of definition for image inpainting task: deterministic image inpainting

NUWA-LIP: language-guided image inpainting with defect-free VQGAN

M Ni, X Li, W Zuo - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
… Generating diverse structure for image inpainting with hierarchical vq-vae. In Proceedings
of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pages 10775–…

[PDF][PDF] Generating Diverse Structure for Image Inpainting With Hierarchical VQ-VAE (Supplementary Material)

J Peng, D Liu, S Xu, H Li - openaccess.thecvf.com
… The hyperparameters used for training the hierarchical VQ-VAE … We train the hierarchical
VQ-VAE and the texture generator on … Training the hierarchical VQ-VAE takes roughly 8 hours. …

Hierarchical Vector-Quantized Variational Autoencoder and Vector Credibility Mechanism for High-Quality Image Inpainting

C Li, D Xu, K Chen - Electronics, 2024 - mdpi.com
… , we propose an image inpainting method based on a hierarchical VQ-VAE with a vector …
the hierarchical VQVAE inpainting module with ground truth images are image generation and …

Autoregressive image generation using residual quantization

D Lee, C Kim, S Kim, M Cho… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
… Thus, to further reduce (H, W) to (H/2, W/2) but preserve the reconstruction quality, VQVAE
requires the codebook of size K4. However, VQ-VAE with a large codebook is inefficient due …

[PDF][PDF] Text to Image, Image to Image and Inpainting via the Latent Diffusion

A Liu, X Wang - researchgate.net
… The fundamental difference between a VAE and Vector Quantized-Variational AutoEncoder
(VQ-VAE) is that VAE learns a continuous latent representation, while VQVAE learns a …

Image inpainting with semantic-aware transformer

S Chen, W Yu, Q Wang, J Gong… - ICASSP 2023-2023 IEEE …, 2023 - ieeexplore.ieee.org
… The reason for using all vectors instead of selecting through the semantic selector like in
VQ-VAE is that we expect the transformer to model the relationship with the whole QSVM and …

An Analysis of Generative Methods for Multiple-Image Inpainting

C Ballester, A Bugeau, S Hurault, S Parisotto… - … of Mathematical Models …, 2022 - Springer
Image inpainting refers to the restoration of an image with missing regions in a way that is not
detectable by the observer. The inpainting … In this work, we focus on learning-based image