Self-supervised learning in remote sensing: A review

Y Wang, CM Albrecht, NAA Braham… - IEEE Geoscience and …, 2022 - ieeexplore.ieee.org
In deep learning research, self-supervised learning (SSL) has received great attention,
triggering interest within both the computer vision and remote sensing communities. While …

Self-supervised learning: A succinct review

V Rani, ST Nabi, M Kumar, A Mittal, K Kumar - Archives of Computational …, 2023 - Springer
Abstract Machine learning has made significant advances in the field of image processing.
The foundation of this success is supervised learning, which necessitates annotated labels …

Satmae: Pre-training transformers for temporal and multi-spectral satellite imagery

Y Cong, S Khanna, C Meng, P Liu… - Advances in …, 2022 - proceedings.neurips.cc
Unsupervised pre-training methods for large vision models have shown to enhance
performance on downstream supervised tasks. Developing similar techniques for satellite …

Self-supervised learning of pretext-invariant representations

I Misra, L Maaten - … of the IEEE/CVF conference on …, 2020 - openaccess.thecvf.com
The goal of self-supervised learning from images is to construct image representations that
are semantically meaningful via pretext tasks that do not require semantic annotations. Many …

Disentangled representation learning

X Wang, H Chen, S Tang, Z Wu, W Zhu - arXiv preprint arXiv:2211.11695, 2022 - arxiv.org
Disentangled Representation Learning (DRL) aims to learn a model capable of identifying
and disentangling the underlying factors hidden in the observable data in representation …

Charting the right manifold: Manifold mixup for few-shot learning

P Mangla, N Kumari, A Sinha… - Proceedings of the …, 2020 - openaccess.thecvf.com
Few-shot learning algorithms aim to learn model parameters capable of adapting to unseen
classes with the help of only a few labeled examples. A recent regularization technique …

Audio-visual instance discrimination with cross-modal agreement

P Morgado, N Vasconcelos… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
We present a self-supervised learning approach to learn audio-visual representations from
video and audio. Our method uses contrastive learning for cross-modal discrimination of …

Seed: Self-supervised distillation for visual representation

Z Fang, J Wang, L Wang, L Zhang, Y Yang… - arXiv preprint arXiv …, 2021 - arxiv.org
This paper is concerned with self-supervised learning for small models. The problem is
motivated by our empirical studies that while the widely used contrastive self-supervised …

Equivariant contrastive learning

R Dangovski, L Jing, C Loh, S Han… - arXiv preprint arXiv …, 2021 - arxiv.org
In state-of-the-art self-supervised learning (SSL) pre-training produces semantically good
representations by encouraging them to be invariant under meaningful transformations …

Self-supervised attentive generative adversarial networks for video anomaly detection

C Huang, J Wen, Y Xu, Q Jiang, J Yang… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
Video anomaly detection (VAD) refers to the discrimination of unexpected events in videos.
The deep generative model (DGM)-based method learns the regular patterns on normal …