Byol works even without batch statistics

PH Richemond, JB Grill, F Altché, C Tallec… - arXiv preprint arXiv …, 2020 - arxiv.org
Bootstrap Your Own Latent (BYOL) is a self-supervised learning approach for image
representation. From an augmented view of an image, BYOL trains an online network to …

Ae2-nets: Autoencoder in autoencoder networks

C Zhang, Y Liu, H Fu - … of the IEEE/CVF conference on …, 2019 - openaccess.thecvf.com
Learning on data represented with multiple views (eg, multiple types of descriptors or
modalities) is a rapidly growing direction in machine learning and computer vision. Although …

Towards efficient and effective self-supervised learning of visual representations

S Addepalli, K Bhogale, P Dey, RV Babu - European Conference on …, 2022 - Springer
Self-supervision has emerged as a propitious method for visual representation learning after
the recent paradigm shift from handcrafted pretext tasks to instance-similarity based …

Adaptive soft contrastive learning

C Feng, I Patras - 2022 26th International Conference on …, 2022 - ieeexplore.ieee.org
Self-supervised learning has recently achieved great success in representation learning
without human annotations. The dominant method–that is contrastive learning, is generally …

Dense semantic contrast for self-supervised visual representation learning

X Li, Y Zhou, Y Zhang, A Zhang, W Wang… - Proceedings of the 29th …, 2021 - dl.acm.org
Self-supervised representation learning for visual pre-training has achieved remarkable
success with sample (instance or pixel) discrimination and semantics discovery of instance …

When does contrastive visual representation learning work?

E Cole, X Yang, K Wilber… - Proceedings of the …, 2022 - openaccess.thecvf.com
Recent self-supervised representation learning techniques have largely closed the gap
between supervised and unsupervised learning on ImageNet classification. While the …

Difficulty-based sampling for debiased contrastive representation learning

T Jang, X Wang - Proceedings of the IEEE/CVF Conference …, 2023 - openaccess.thecvf.com
Contrastive learning is a self-supervised representation learning method that achieves
milestone performance in various classification tasks. However, due to its unsupervised …

Unsupervised image classification for deep representation learning

W Chen, S Pu, D Xie, S Yang, Y Guo, L Lin - Computer Vision–ECCV 2020 …, 2020 - Springer
Deep clustering against self-supervised learning (SSL) is a very important and promising
direction for unsupervised visual representation learning since it requires little domain …

Contrastive learning of image representations with cross-video cycle-consistency

H Wu, X Wang - Proceedings of the IEEE/CVF International …, 2021 - openaccess.thecvf.com
Recent works have advanced the performance of self-supervised representation learning by
a large margin. The core among these methods is intra-image invariance learning. Two …

Local aggregation for unsupervised learning of visual embeddings

C Zhuang, AL Zhai, D Yamins - Proceedings of the IEEE …, 2019 - openaccess.thecvf.com
Unsupervised approaches to learning in neural networks are of substantial interest for
furthering artificial intelligence, both because they would enable the training of networks …