Dense semantic contrast for self-supervised visual representation learning

X Li, Y Zhou, Y Zhang, A Zhang, W Wang… - Proceedings of the 29th …, 2021 - dl.acm.org
Self-supervised representation learning for visual pre-training has achieved remarkable
success with sample (instance or pixel) discrimination and semantics discovery of instance …

Self-supervised visual representation learning with semantic grouping

X Wen, B Zhao, A Zheng… - Advances in neural …, 2022 - proceedings.neurips.cc
In this paper, we tackle the problem of learning visual representations from unlabeled scene-
centric data. Existing works have demonstrated the potential of utilizing the underlying …

Unsupervised learning of dense visual representations

PO O Pinheiro, A Almahairi… - Advances in …, 2020 - proceedings.neurips.cc
Contrastive self-supervised learning has emerged as a promising approach to unsupervised
visual representation learning. In general, these methods learn global (image-level) …

Scaling and benchmarking self-supervised visual representation learning

P Goyal, D Mahajan, A Gupta… - Proceedings of the ieee …, 2019 - openaccess.thecvf.com
Self-supervised learning aims to learn representations from the data itself without explicit
manual supervision. Existing efforts ignore a crucial aspect of self-supervised learning-the …

Self-supervised visual representations learning by contrastive mask prediction

Y Zhao, G Wang, C Luo, W Zeng… - Proceedings of the …, 2021 - openaccess.thecvf.com
Advanced self-supervised visual representation learning methods rely on the instance
discrimination (ID) pretext task. We point out that the ID task has an implicit semantic …

Propagate yourself: Exploring pixel-level consistency for unsupervised visual representation learning

Z Xie, Y Lin, Z Zhang, Y Cao… - Proceedings of the …, 2021 - openaccess.thecvf.com
Contrastive learning methods for unsupervised visual representation learning have reached
remarkable levels of transfer performance. We argue that the power of contrastive learning …

Revisiting contrastive methods for unsupervised learning of visual representations

W Van Gansbeke, S Vandenhende… - Advances in …, 2021 - proceedings.neurips.cc
Contrastive self-supervised learning has outperformed supervised pretraining on many
downstream tasks like segmentation and object detection. However, current methods are …

Multimodal contrastive training for visual representation learning

X Yuan, Z Lin, J Kuen, J Zhang… - Proceedings of the …, 2021 - openaccess.thecvf.com
We develop an approach to learning visual representations that embraces multimodal data,
driven by a combination of intra-and inter-modal similarity preservation objectives. Unlike …

Mosaic representation learning for self-supervised visual pre-training

Z Wang, Z Chen, Y Li, Y Guo, J Yu… - The Eleventh …, 2023 - openreview.net
Self-supervised learning has achieved significant success in learning visual representations
without the need for manual annotation. To obtain generalizable representations, a …

Siamese image modeling for self-supervised vision representation learning

C Tao, X Zhu, W Su, G Huang, B Li… - Proceedings of the …, 2023 - openaccess.thecvf.com
Self-supervised learning (SSL) has delivered superior performance on a variety of
downstream vision tasks. Two main-stream SSL frameworks have been proposed, ie …