Clip for all things zero-shot sketch-based image retrieval, fine-grained or not

A Sain, AK Bhunia, PN Chowdhury… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this paper, we leverage CLIP for zero-shot sketch based image retrieval (ZS-SBIR). We
are largely inspired by recent advances on foundation models and the unparalleled …

What can human sketches do for object detection?

PN Chowdhury, AK Bhunia, A Sain… - Proceedings of the …, 2023 - openaccess.thecvf.com
Sketches are highly expressive, inherently capturing subjective and fine-grained visual
cues. The exploration of such innate properties of human sketches has, however, been …

Picture that sketch: Photorealistic image generation from abstract sketches

S Koley, AK Bhunia, A Sain… - Proceedings of the …, 2023 - openaccess.thecvf.com
Given an abstract, deformed, ordinary sketch from untrained amateurs like you and me, this
paper turns it into a photorealistic image-just like those shown in Fig. 1 (a), all non-cherry …

Sketch2Saliency: learning to detect salient objects from human drawings

AK Bhunia, S Koley, A Kumar, A Sain… - Proceedings of the …, 2023 - openaccess.thecvf.com
Human sketch has already proved its worth in various visual understanding tasks (eg,
retrieval, segmentation, image-captioning, etc). In this paper, we reveal a new trait of …

Democratising 2D Sketch to 3D Shape Retrieval Through Pivoting

PN Chowdhury, AK Bhunia, A Sain… - Proceedings of the …, 2023 - openaccess.thecvf.com
This paper studies the problem of 2D sketch to 3D shape retrieval, but with a focus on
democratising the process. We would like this democratisation to happen on two fronts:(i) to …

SceneTrilogy: On Human Scene-Sketch and its Complementarity with Photo and Text

PN Chowdhury, AK Bhunia, A Sain… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this paper, we extend scene understanding to include that of human sketch. The result is a
complete trilogy of scene representation from three diverse and complementary modalities …

You'll Never Walk Alone: A Sketch and Text Duet for Fine-Grained Image Retrieval

S Koley, AK Bhunia, A Sain, PN Chowdhury… - arXiv preprint arXiv …, 2024 - arxiv.org
Two primary input modalities prevail in image retrieval: sketch and text. While text is widely
used for inter-category retrieval tasks, sketches have been established as the sole preferred …

Text-to-Image Diffusion Models are Great Sketch-Photo Matchmakers

S Koley, AK Bhunia, A Sain, PN Chowdhury… - arXiv preprint arXiv …, 2024 - arxiv.org
This paper, for the first time, explores text-to-image diffusion models for Zero-Shot Sketch-
based Image Retrieval (ZS-SBIR). We highlight a pivotal discovery: the capacity of text-to …

It's All About Your Sketch: Democratising Sketch Control in Diffusion Models

S Koley, AK Bhunia, D Sekhri, A Sain… - arXiv preprint arXiv …, 2024 - arxiv.org
This paper unravels the potential of sketches for diffusion models, addressing the deceptive
promise of direct sketch control in generative AI. We importantly democratise the process …

How to Handle Sketch-Abstraction in Sketch-Based Image Retrieval?

S Koley, AK Bhunia, A Sain, PN Chowdhury… - arXiv preprint arXiv …, 2024 - arxiv.org
In this paper, we propose a novel abstraction-aware sketch-based image retrieval
framework capable of handling sketch abstraction at varied levels. Prior works had mainly …