Survey on self-supervised learning: auxiliary pretext tasks and contrastive learning methods in imaging

S Albelwi - Entropy, 2022 - mdpi.com
Although deep learning algorithms have achieved significant progress in a variety of
domains, they require costly annotations on huge datasets. Self-supervised learning (SSL) …

Medclip: Contrastive learning from unpaired medical images and text

Z Wang, Z Wu, D Agarwal, J Sun - arXiv preprint arXiv:2210.10163, 2022 - arxiv.org
Existing vision-text contrastive learning like CLIP aims to match the paired image and
caption embeddings while pushing others apart, which improves representation …

Simmatch: Semi-supervised learning with similarity matching

M Zheng, S You, L Huang, F Wang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Learning with few labeled data has been a longstanding problem in the computer vision and
machine learning research community. In this paper, we introduced a new semi-supervised …

RetCCL: Clustering-guided contrastive learning for whole-slide image retrieval

X Wang, Y Du, S Yang, J Zhang, M Wang, J Zhang… - Medical image …, 2023 - Elsevier
Benefiting from the large-scale archiving of digitized whole-slide images (WSIs), computer-
aided diagnosis has been well developed to assist pathologists in decision-making. Content …

Dynamic conceptional contrastive learning for generalized category discovery

N Pu, Z Zhong, N Sebe - … of the IEEE/CVF conference on …, 2023 - openaccess.thecvf.com
Generalized category discovery (GCD) is a recently proposed open-world problem, which
aims to automatically cluster partially labeled data. The main challenge is that the unlabeled …

Learning visual representations via language-guided sampling

M El Banani, K Desai… - Proceedings of the ieee …, 2023 - openaccess.thecvf.com
Although an object may appear in numerous contexts, we often describe it in a limited
number of ways. Language allows us to abstract away visual variation to represent and …

Pseudo-label guided contrastive learning for semi-supervised medical image segmentation

H Basak, Z Yin - Proceedings of the IEEE/CVF conference …, 2023 - openaccess.thecvf.com
Although recent works in semi-supervised learning (SemiSL) have accomplished significant
success in natural image segmentation, the task of learning discriminative representations …

Promptcal: Contrastive affinity learning via auxiliary prompts for generalized novel category discovery

S Zhang, S Khan, Z Shen, M Naseer… - Proceedings of the …, 2023 - openaccess.thecvf.com
Although existing semi-supervised learning models achieve remarkable success in learning
with unannotated in-distribution data, they mostly fail to learn on unlabeled data sampled …

Green hierarchical vision transformer for masked image modeling

L Huang, S You, M Zheng, F Wang… - Advances in …, 2022 - proceedings.neurips.cc
We present an efficient approach for Masked Image Modeling (MIM) with hierarchical Vision
Transformers (ViTs), allowing the hierarchical ViTs to discard masked patches and operate …

Ressl: Relational self-supervised learning with weak augmentation

M Zheng, S You, F Wang, C Qian… - Advances in …, 2021 - proceedings.neurips.cc
Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved
great success in learning visual representations without data annotations. However, most of …