Smartbrush: Text and shape guided object inpainting with diffusion model

S Xie, Z Zhang, Z Lin, T Hinz… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Generic image inpainting aims to complete a corrupted image by borrowing surrounding
information, which barely generates novel content. By contrast, multi-modal inpainting …

SmartMask: Context Aware High-Fidelity Mask Generation for Fine-grained Object Insertion and Layout Control

J Singh, J Zhang, Q Liu, C Smith… - Proceedings of the …, 2024 - openaccess.thecvf.com
The field of generative image inpainting and object insertion has made significant progress
with the recent advent of latent diffusion models. Utilizing a precise object mask can greatly …

Brush2Prompt: Contextual Prompt Generator for Object Inpainting

MT Chiu, Y Zhou, L Zhang, Z Lin… - Proceedings of the …, 2024 - openaccess.thecvf.com
Object inpainting is a task that involves adding objects to real images and seamlessly
compositing them. With the recent commercialization of products like Stable Diffusion and …

Shape-guided diffusion with inside-outside attention

DH Park, G Luo, C Toste, S Azadi… - Proceedings of the …, 2024 - openaccess.thecvf.com
We introduce precise object silhouette as a new form of user control in text-to-image
diffusion models, which we dub Shape-Guided Diffusion. Our training-free method uses an …

Large Occluded Human Image Completion via Image-Prior Cooperating

H Zhao, Y Zeng, H Lu, L Wang - … of the AAAI Conference on Artificial …, 2024 - ojs.aaai.org
The completion of large occluded human body images poses a unique challenge for
general image completion methods. The complex shape variations of human bodies make it …

Outline-Guided Object Inpainting with Diffusion Models

M Pobitzer, F Janicki, M Rigotti, C Malossi - arXiv preprint arXiv …, 2024 - arxiv.org
Instance segmentation datasets play a crucial role in training accurate and robust computer
vision models. However, obtaining accurate mask annotations to produce high-quality …

Efficient Layout-Guided Image Inpainting for Mobile Use

W Li, Y Wei, Y Shen, H Jin - Proceedings of the IEEE/CVF …, 2024 - openaccess.thecvf.com
The layout guidance, which specifies the pixel-wise object distribution, is beneficial to
preserving the object boundaries in image inpainting while not hurting model's …

Sketch-guided Image Inpainting with Partial Discrete Diffusion Process

N Sharma, A Tripathi, A Chakraborty… - arXiv preprint arXiv …, 2024 - arxiv.org
In this work, we study the task of sketch-guided image inpainting. Unlike the well-explored
natural language-guided image inpainting, which excels in capturing semantic details, the …

[PDF][PDF] Image augmentation based on diffusion models

M Pobitzer - 2023 - research-collection.ethz.ch
Instance segmentation datasets play a crucial role in training accurate and robust computer
vision models. However, obtaining accurate mask annotations to produce high-quality …

[图书][B] Vision and Language Understanding Through Generative Modeling

DHS Park - 2023 - search.proquest.com
Abstract Language is such a powerful representation for capturing the knowledge and
information about our world. It excels at expressing discrete concepts such as objects and …