Revisiting contrastive methods for unsupervised learning of visual representations

W Van Gansbeke, S Vandenhende… - Advances in …, 2021 - proceedings.neurips.cc
… 39], our results indicate that contrastive self-supervised methods do not suffer from pretraining
… and improve contrastive self-supervised methods for learning visual representations. Self-…

Understand and improve contrastive learning methods for visual representation: A review

R Liu - arXiv preprint arXiv:2106.03259, 2021 - arxiv.org
contrastive learning method SimCLR [7] and in section 4.2 we introduce attempts to improve
contrastive methods … Section 5.1 presents the model bias [44] in contrastive learning, and is …

Multimodal contrastive training for visual representation learning

X Yuan, Z Lin, J Kuen, J Zhang… - Proceedings of the …, 2021 - openaccess.thecvf.com
… Our method shares the same spirit with these methods, in that we both use contrastive visual
representation … paths to better align the visual features with additional semantic information. …

A simple framework for contrastive learning of visual representations

T Chen, S Kornblith, M Norouzi… - … conference on machine …, 2020 - proceedings.mlr.press
methods. We are able to use standard networks to obtain substantially better results compared
to previous methods … the comparisons of our results against recent methods (Zhai et al., …

Contrastive learning of medical visual representations from paired images and text

Y Zhang, H Jiang, Y Miura… - Machine Learning …, 2022 - proceedings.mlr.press
… However, as we will show, applying these image view–based contrastive methods to medical
… In this work, we introduce a new method to improve visual representation learning on …

With a little help from my friends: Nearest-neighbor contrastive learning of visual representations

D Dwibedi, Y Aytar, J Tompson… - Proceedings of the …, 2021 - openaccess.thecvf.com
method. We make the following contributions: (i) We introduce NNCLR to learn self-supervised
representations … increases the performance of contrastive learning methods (eg SimCLR […

When does contrastive visual representation learning work?

E Cole, X Yang, K Wilber… - Proceedings of the …, 2022 - openaccess.thecvf.com
… can degrade a self-supervised representation to the point of unusability … method. We focus
on SimCLR because it reflects the essence of state-of-the-art contrastive learning methods

A broad study on the transferability of visual representations with contrastive learning

A Islam, CFR Chen, R Panda… - Proceedings of the …, 2021 - openaccess.thecvf.com
… We examine five different methods to analyze the effectiveness of contrastive learning in
tranferability, namely, CE, SelfSupCon, SupCon, CE+SelfSupCon, and SupCon+SelfSupCon. …

What should not be contrastive in contrastive learning

T Xiao, X Wang, AA Efros, T Darrell - arXiv preprint arXiv:2008.05659, 2020 - arxiv.org
… Current self-supervised contrastive learning methods assume implicit knowledge of … to
learn visual representations which capture individual factors of variation in a contrastive learning …

Vi2clr: Video and image for visual contrastive learning of representation

A Diba, V Sharma, R Safdari, D Lotfi… - Proceedings of the …, 2021 - openaccess.thecvf.com
… In this paper, we introduce a novel self-supervised visual representation learning method
which understands both images and videos in a joint learning fashion. The proposed neural …