Supervision accelerates pre-training in contrastive semi-supervised learning of visual representations

M Assran, N Ballas, L Castrejon, M Rabbat - arXiv preprint arXiv …, 2020 - arxiv.org
… a semi-supervised loss, SuNCEt, based on noise-contrastivesemi-supervised learning
accuracy of previous contrastive approaches while using less than half the amount of pre-training

A simple framework for contrastive learning of visual representations

T Chen, S Kornblith, M Norouzi… - … on machine learning, 2020 - proceedings.mlr.press
… By combining these findings, we are able to considerably outperform previous methods for
self-supervised and semi-supervised learning on ImageNet. A linear classifier trained on self-…

When does contrastive visual representation learning work?

E Cole, X Yang, K Wilber… - … on Computer Vision …, 2022 - openaccess.thecvf.com
… As a first step in this direction, we study contrastive selfsupervised learning on four diverse
large-scale datasets. By looking through the lenses of data quantity, data domain, data quality…

Contrastive regularization for semi-supervised learning

D Lee, S Kim, I Kim, Y Cheon… - … on computer vision …, 2022 - openaccess.thecvf.com
… during training by the well-clustered features. On benchmarks of semi-supervised learning
tasks, our contrastive … A simple framework for contrastive learning of visual representations. In …

Comatch: Semi-supervised learning with contrastive graph regularization

J Li, C Xiong, SCH Hoi - … conference on computer vision, 2021 - openaccess.thecvf.com
… We propose CoMatch, a new semi-supervised learning … CoMatch jointly learns two
representations of the training data… framework for contrastive learning of visual representations. …

Supervised contrastive learning

P Khosla, P Teterwak, C Wang… - Advances in neural …, 2020 - proceedings.neurips.cc
… of our paper and CCLP is a promising direction for semi-supervised learning research. …
Momentum contrast for unsupervised visual representation learning. arXiv preprint arXiv:…

UniMoCo: unsupervised, semi-supervised and fully-supervised visual representation learning

Z Dai, B Cai, J Chen - … on Systems, Man, and Cybernetics (SMC …, 2022 - ieeexplore.ieee.org
visual representation learning. However, there are a lot of supervised and semi-supervised
To fully utilize the label annotations, we propose Unified Momentum Contrast (UniMoCo), …

Vi2clr: Video and image for visual contrastive learning of representation

A Diba, V Sharma, R Safdari, D Lotfi… - … on computer vision, 2021 - openaccess.thecvf.com
… a joint self-supervised contrastive visual representation learning for videos and images…
semi-supervised learning. In Proceedings of the IEEE international conference on computer vision

Understand and improve contrastive learning methods for visual representation: A review

R Liu - arXiv preprint arXiv:2106.03259, 2021 - arxiv.org
contrastive learning method SimCLR [7] and in section 4.2 we introduce attempts to improve
contrastive … In the supervised learning field and semi-supervised learning field, several …

Revisiting contrastive methods for unsupervised learning of visual representations

W Van Gansbeke, S Vandenhende… - Advances in …, 2021 - proceedings.neurips.cc
… 44] or semi-supervised learning [6]. Recent self-supervised methods [4… is to study and
improve contrastive self-supervised methods for learning visual representations. Self-supervised …