Open-vocabulary semantic segmentation with mask-adapted clip

F Liang, B Wu, X Dai, K Li, Y Zhao… - Proceedings of the …, 2023 - openaccess.thecvf.com
Open-vocabulary semantic segmentation aims to segment an image into semantic regions
according to text descriptions, which may not have been seen during training. Recent two …

Cat-seg: Cost aggregation for open-vocabulary semantic segmentation

S Cho, H Shin, S Hong, A Arnab… - Proceedings of the …, 2024 - openaccess.thecvf.com
Open-vocabulary semantic segmentation presents the challenge of labeling each pixel
within an image based on a wide range of text descriptions. In this work we introduce a …

Open-vocabulary semantic segmentation with decoupled one-pass network

C Han, Y Zhong, D Li, K Han… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Recently, the open-vocabulary semantic segmentation problem has attracted increasing
attention and the best performing methods are based on two-stream networks: one stream …

Sed: A simple encoder-decoder for open-vocabulary semantic segmentation

B Xie, J Cao, J Xie, FS Khan… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Open-vocabulary semantic segmentation strives to distinguish pixels into different semantic
groups from an open set of categories. Most existing methods explore utilizing pre-trained …

Side adapter network for open-vocabulary semantic segmentation

M Xu, Z Zhang, F Wei, H Hu… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
This paper presents a new framework for open-vocabulary semantic segmentation with the
pre-trained vision-language model, named SAN. Our approach models the semantic …

Learning open-vocabulary semantic segmentation models from natural language supervision

J Xu, J Hou, Y Zhang, R Feng… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this paper, we consider the problem of open-vocabulary semantic segmentation (OVS),
which aims to segment objects of arbitrary classes instead of pre-defined, closed-set …

Segclip: Patch aggregation with learnable centers for open-vocabulary semantic segmentation

H Luo, J Bao, Y Wu, X He, T Li - International Conference on …, 2023 - proceedings.mlr.press
Recently, the contrastive language-image pre-training, eg, CLIP, has demonstrated
promising results on various downstream tasks. The pre-trained model can capture enriched …

Open-vocabulary universal image segmentation with maskclip

Z Ding, J Wang, Z Tu - arXiv preprint arXiv:2208.08984, 2022 - arxiv.org
In this paper, we tackle an emerging computer vision task, open-vocabulary universal image
segmentation, that aims to perform semantic/instance/panoptic segmentation (background …

Convolutions die hard: Open-vocabulary segmentation with single frozen convolutional clip

Q Yu, J He, X Deng, X Shen… - Advances in Neural …, 2024 - proceedings.neurips.cc
Open-vocabulary segmentation is a challenging task requiring segmenting and recognizing
objects from an open set of categories in diverse environments. One way to address this …

SAN: Side adapter network for open-vocabulary semantic segmentation

M Xu, Z Zhang, F Wei, H Hu… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
This article concentrates on open-vocabulary semantic segmentation, where a well
optimized model is able to segment arbitrary categories that appear in an image. To achieve …