Beyond supervised vs. unsupervised: Representative benchmarking and analysis of image representation learning

M Gwilliam, A Shrivastava - … of the IEEE/CVF Conference on …, 2022 - openaccess.thecvf.com
By leveraging contrastive learning, clustering, and other pretext tasks, unsupervised
methods for learning image representations have reached impressive results on standard …

Jigsaw clustering for unsupervised visual representation learning

P Chen, S Liu, J Jia - … of the IEEE/CVF conference on …, 2021 - openaccess.thecvf.com
Unsupervised representation learning with contrastive learning achieves great success
recently. However, these methods have to duplicate each training batch to construct …

Propagate yourself: Exploring pixel-level consistency for unsupervised visual representation learning

Z Xie, Y Lin, Z Zhang, Y Cao… - Proceedings of the …, 2021 - openaccess.thecvf.com
Contrastive learning methods for unsupervised visual representation learning have reached
remarkable levels of transfer performance. We argue that the power of contrastive learning …

Exploring simple siamese representation learning

X Chen, K He - Proceedings of the IEEE/CVF conference on …, 2021 - openaccess.thecvf.com
Siamese networks have become a common structure in various recent models for
unsupervised visual representation learning. These models maximize the similarity between …

Unsupervised visual representation learning by online constrained k-means

Q Qian, Y Xu, J Hu, H Li, R Jin - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Cluster discrimination is an effective pretext task for unsupervised representation learning,
which often consists of two phases: clustering and discrimination. Clustering is to assign …

Watching the world go by: Representation learning from unlabeled videos

D Gordon, K Ehsani, D Fox, A Farhadi - arXiv preprint arXiv:2003.07990, 2020 - arxiv.org
Recent single image unsupervised representation learning techniques show remarkable
success on a variety of tasks. The basic principle in these works is instance discrimination …

Byol works even without batch statistics

PH Richemond, JB Grill, F Altché, C Tallec… - arXiv preprint arXiv …, 2020 - arxiv.org
Bootstrap Your Own Latent (BYOL) is a self-supervised learning approach for image
representation. From an augmented view of an image, BYOL trains an online network to …

Un-mix: Rethinking image mixtures for unsupervised visual representation learning

Z Shen, Z Liu, Z Liu, M Savvides, T Darrell… - Proceedings of the AAAI …, 2022 - ojs.aaai.org
The recently advanced unsupervised learning approaches use the siamese-like framework
to compare two" views" from the same image for learning representations. Making the two …

With a little help from my friends: Nearest-neighbor contrastive learning of visual representations

D Dwibedi, Y Aytar, J Tompson… - Proceedings of the …, 2021 - openaccess.thecvf.com
Self-supervised learning algorithms based on instance discrimination train encoders to be
invariant to pre-defined transformations of the same instance. While most methods treat …

[PDF][PDF] Supervised representation learning: Transfer learning with deep autoencoders

F Zhuang, X Cheng, P Luo, SJ Pan… - Twenty-fourth international …, 2015 - cse.cuhk.edu.hk
Transfer learning has attracted a lot of attention in the past decade. One crucial research
issue in transfer learning is how to find a good representation for instances of different …