A simple framework for contrastive learning of visual representations

T Chen, S Kornblith, M Norouzi… - … on machine learning, 2020 - proceedings.mlr.press
contrastive learning of visual representations. We simplify recently proposed contrastive
selfsupervised learning … enables the contrastive prediction tasks to learn useful representations, …

[PDF][PDF] Mixco: Mix-up contrastive learning for visual representation

S Kim, G Lee, S Bae, SY Yun - arXiv preprint arXiv:2010.06300, 2020 - researchgate.net
… To validate the efficacy of MixCo, it is applied to recent popular representation learning
extended the concept of contrastive loss for visual representation learning to semi-positive …

Multimodal contrastive training for visual representation learning

X Yuan, Z Lin, J Kuen, J Zhang… - Proceedings of the …, 2021 - openaccess.thecvf.com
… Our objective is to learn visual representation from multimodal data in a unified training
framework. … We aim to learn high-quality visual features, which benefit from not only the additional …

Vi2clr: Video and image for visual contrastive learning of representation

A Diba, V Sharma, R Safdari, D Lotfi… - Proceedings of the …, 2021 - openaccess.thecvf.com
… -supervised visual representation learning method … contrastive learning of representation
(Vi2CLR) pipeline using clustering and instance discrimination objective in a contrastive learn

What should not be contrastive in contrastive learning

T Xiao, X Wang, AA Efros, T Darrell - arXiv preprint arXiv:2008.05659, 2020 - arxiv.org
… Current self-supervised contrastive learning methods assume implicit knowledge of … to
learn visual representations which capture individual factors of variation in a contrastive learning

When does contrastive visual representation learning work?

E Cole, X Yang, K Wilber… - Proceedings of the …, 2022 - openaccess.thecvf.com
representation learning techniques have largely closed the gap between supervised and
unsupervised learning … direction, we study contrastive selfsupervised learning on four diverse …

Mutual contrastive learning for visual representation learning

C Yang, Z An, L Cai, Y Xu - Proceedings of the AAAI Conference on …, 2022 - ojs.aaai.org
learning method called Mutual Contrastive Learning (MCL) for general visual representation
learning… The core idea of MCL is to perform mutual interaction and transfer of contrastive

Understand and improve contrastive learning methods for visual representation: A review

R Liu - arXiv preprint arXiv:2106.03259, 2021 - arxiv.org
contrastive learning method SimCLR [7] and in section 4.2 we introduce attempts to improve
contrastive … Section 5.1 presents the model bias [44] in contrastive learning, and is followed …

A broad study on the transferability of visual representations with contrastive learning

A Islam, CFR Chen, R Panda… - Proceedings of the …, 2021 - openaccess.thecvf.com
… that make representations from contrastive learning more transferable … representations of
contrastive learning are much different than the cross-entropy model; in particular, contrastive

Supervised contrastive learning

P Khosla, P Teterwak, C Wang… - Advances in neural …, 2020 - proceedings.neurips.cc
… 48], connections are made of the contrastive loss to … propose a loss for supervised learning
that builds on the contrastive self-… framework for contrastive learning of visual representations. …