Equimod: An equivariance module to improve visual instance discrimination

A Devillers, M Lefort - International Conference on Learning …, 2023 - hal.science
Recent self-supervised visual representation methods are closing the gap with supervised
learning performance. Most of these successful methods rely on maximizing the similarity …

Wave-vit: Unifying wavelet and transformers for visual representation learning

T Yao, Y Pan, Y Li, CW Ngo, T Mei - European Conference on Computer …, 2022 - Springer
Abstract Multi-scale Vision Transformer (ViT) has emerged as a powerful backbone for
computer vision tasks, while the self-attention computation in Transformer scales …

Joint unsupervised learning of deep representations and image clusters

J Yang, D Parikh, D Batra - … of the IEEE conference on computer …, 2016 - cv-foundation.org
In this paper, we propose a recurrent framework for joint unsupervised learning of deep
representations and image clusters. In our framework, successive operations in a clustering …

Masked contrastive representation learning

Y Yao, N Desai, M Palaniswami - arXiv preprint arXiv:2211.06012, 2022 - arxiv.org
Masked image modelling (eg, Masked AutoEncoder) and contrastive learning (eg,
Momentum Contrast) have shown impressive performance on unsupervised visual …

Neural clustering based visual representation learning

G Chen, X Li, Y Yang, W Wang - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
We investigate a fundamental aspect of machine vision: the measurement of features by
revisiting clustering one of the most classic approaches in machine learning and data …

A large-scale study of representation learning with the visual task adaptation benchmark

X Zhai, J Puigcerver, A Kolesnikov, P Ruyssen… - arXiv preprint arXiv …, 2019 - arxiv.org
Representation learning promises to unlock deep learning for the long tail of vision tasks
without expensive labelled datasets. Yet, the absence of a unified evaluation for general …

Semantics-consistent feature search for self-supervised visual representation learning

K Song, S Zhang, Z Luo, T Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
In contrastive self-supervised learning, the common way to learn discriminative
representation is to pull different augmented" views" of the same image closer while pushing …

Instance similarity learning for unsupervised feature representation

Z Wang, Y Wang, Z Wu, J Lu… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
In this paper, we propose an instance similarity learning (ISL) method for unsupervised
feature representation. Conventional methods assign close instance pairs in the feature …

[PDF][PDF] Openmixup: Open mixup toolbox and benchmark for visual representation learning

S Li, Z Wang, Z Liu, D Wu, SZ Li - arXiv preprint arXiv:2209.04851, 2022 - researchgate.net
With the remarkable progress of deep neural networks in computer vision, data mixing
augmentation techniques are widely studied to alleviate problems of degraded …

Unsupervised representation learning by predicting image rotations

S Gidaris, P Singh, N Komodakis - arXiv preprint arXiv:1803.07728, 2018 - arxiv.org
Over the last years, deep convolutional neural networks (ConvNets) have transformed the
field of computer vision thanks to their unparalleled capacity to learn high level semantic …