Un-mix: Rethinking image mixtures for unsupervised visual representation learning

Z Shen, Z Liu, Z Liu, M Savvides, T Darrell… - Proceedings of the AAAI …, 2022 - ojs.aaai.org
The recently advanced unsupervised learning approaches use the siamese-like framework
to compare two" views" from the same image for learning representations. Making the two …

Jigsaw clustering for unsupervised visual representation learning

P Chen, S Liu, J Jia - … of the IEEE/CVF conference on …, 2021 - openaccess.thecvf.com
Unsupervised representation learning with contrastive learning achieves great success
recently. However, these methods have to duplicate each training batch to construct …

Hallucination improves the performance of unsupervised visual representation learning

J Wu, J Hobbs, N Hovakimyan - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Contrastive learning models based on Siamese structure have demonstrated remarkable
performance in self-supervised learning. Such a success of contrastive learning relies on …

Delving into inter-image invariance for unsupervised visual representations

J Xie, X Zhan, Z Liu, YS Ong, CC Loy - International Journal of Computer …, 2022 - Springer
Contrastive learning has recently shown immense potential in unsupervised visual
representation learning. Existing studies in this track mainly focus on intra-image invariance …

Co2: Consistent contrast for unsupervised visual representation learning

C Wei, H Wang, W Shen, A Yuille - arXiv preprint arXiv:2010.02217, 2020 - arxiv.org
Contrastive learning has been adopted as a core method for unsupervised visual
representation learning. Without human annotation, the common practice is to perform an …

Mixed autoencoder for self-supervised visual representation learning

K Chen, Z Liu, L Hong, H Xu, Z Li… - Proceedings of the …, 2023 - openaccess.thecvf.com
Masked Autoencoder (MAE) has demonstrated superior performance on various vision tasks
via randomly masking image patches and reconstruction. However, effective data …

Beyond supervised vs. unsupervised: Representative benchmarking and analysis of image representation learning

M Gwilliam, A Shrivastava - … of the IEEE/CVF Conference on …, 2022 - openaccess.thecvf.com
By leveraging contrastive learning, clustering, and other pretext tasks, unsupervised
methods for learning image representations have reached impressive results on standard …

Propagate yourself: Exploring pixel-level consistency for unsupervised visual representation learning

Z Xie, Y Lin, Z Zhang, Y Cao… - Proceedings of the …, 2021 - openaccess.thecvf.com
Contrastive learning methods for unsupervised visual representation learning have reached
remarkable levels of transfer performance. We argue that the power of contrastive learning …

A simple framework for contrastive learning of visual representations

T Chen, S Kornblith, M Norouzi… - … conference on machine …, 2020 - proceedings.mlr.press
This paper presents SimCLR: a simple framework for contrastive learning of visual
representations. We simplify recently proposed contrastive self-supervised learning …

Understanding dimensional collapse in contrastive self-supervised learning

L Jing, P Vincent, Y LeCun, Y Tian - arXiv preprint arXiv:2110.09348, 2021 - arxiv.org
Self-supervised visual representation learning aims to learn useful representations without
relying on human annotations. Joint embedding approach bases on maximizing the …