Clip for all things zero-shot sketch-based image retrieval, fine-grained or not

A Sain, AK Bhunia, PN Chowdhury… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this paper, we leverage CLIP for zero-shot sketch based image retrieval (ZS-SBIR). We
are largely inspired by recent advances on foundation models and the unparalleled …

What can human sketches do for object detection?

PN Chowdhury, AK Bhunia, A Sain… - Proceedings of the …, 2023 - openaccess.thecvf.com
Sketches are highly expressive, inherently capturing subjective and fine-grained visual
cues. The exploration of such innate properties of human sketches has, however, been …

How many unicorns are in this image? a safety evaluation benchmark for vision llms

H Tu, C Cui, Z Wang, Y Zhou, B Zhao, J Han… - arXiv preprint arXiv …, 2023 - arxiv.org
This work focuses on the potential of Vision LLMs (VLLMs) in visual reasoning. Different
from prior studies, we shift our focus from evaluating standard performance to introducing a …

How to Handle Sketch-Abstraction in Sketch-Based Image Retrieval?

S Koley, AK Bhunia, A Sain… - Proceedings of the …, 2024 - openaccess.thecvf.com
In this paper we propose a novel abstraction-aware sketch-based image retrieval framework
capable of handling sketch abstraction at varied levels. Prior works had mainly focused on …

Sketch2Saliency: learning to detect salient objects from human drawings

AK Bhunia, S Koley, A Kumar, A Sain… - Proceedings of the …, 2023 - openaccess.thecvf.com
Human sketch has already proved its worth in various visual understanding tasks (eg,
retrieval, segmentation, image-captioning, etc). In this paper, we reveal a new trait of …

Exploiting unlabelled photos for stronger fine-grained SBIR

A Sain, AK Bhunia, S Koley… - Proceedings of the …, 2023 - openaccess.thecvf.com
This paper advances the fine-grained sketch-based image retrieval (FG-SBIR) literature by
putting forward a strong baseline that overshoots prior state-of-the art by 11%. This is not via …

Text-to-Image Diffusion Models are Great Sketch-Photo Matchmakers

S Koley, AK Bhunia, A Sain… - Proceedings of the …, 2024 - openaccess.thecvf.com
This paper for the first time explores text-to-image diffusion models for Zero-Shot Sketch-
based Image Retrieval (ZS-SBIR). We highlight a pivotal discovery: the capacity of text-to …

You'll Never Walk Alone: A Sketch and Text Duet for Fine-Grained Image Retrieval

S Koley, AK Bhunia, A Sain… - Proceedings of the …, 2024 - openaccess.thecvf.com
Two primary input modalities prevail in image retrieval: sketch and text. While text is widely
used for inter-category retrieval tasks sketches have been established as the sole preferred …

It's All About Your Sketch: Democratising Sketch Control in Diffusion Models

S Koley, AK Bhunia, D Sekhri, A Sain… - Proceedings of the …, 2024 - openaccess.thecvf.com
This paper unravels the potential of sketches for diffusion models addressing the deceptive
promise of direct sketch control in generative AI. We importantly democratise the process …

Sketchinr: A first look into sketches as implicit neural representations

H Bandyopadhyay, AK Bhunia… - Proceedings of the …, 2024 - openaccess.thecvf.com
We propose SketchINR to advance the representation of vector sketches with implicit neural
models. A variable length vector sketch is compressed into a latent space of fixed dimension …