Self-supervised learning for time series analysis: Taxonomy, progress, and prospects

K Zhang, Q Wen, C Zhang, R Cai, M Jin… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
Self-supervised learning (SSL) has recently achieved impressive performance on various
time series tasks. The most prominent advantage of SSL is that it reduces the dependence …

Self-supervised remote sensing feature learning: Learning paradigms, challenges, and future works

C Tao, J Qi, M Guo, Q Zhu, H Li - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Deep learning has achieved great success in learning features from massive remote
sensing images (RSIs). To better understand the connection between three feature learning …

Spectral feature augmentation for graph contrastive learning and beyond

Y Zhang, H Zhu, Z Song, P Koniusz… - Proceedings of the AAAI …, 2023 - ojs.aaai.org
Although augmentations (eg, perturbation of graph edges, image crops) boost the efficiency
of Contrastive Learning (CL), feature level augmentation is another plausible …

Chaos is a ladder: A new theoretical understanding of contrastive learning via augmentation overlap

Y Wang, Q Zhang, Y Wang, J Yang, Z Lin - arXiv preprint arXiv …, 2022 - arxiv.org
Recently, contrastive learning has risen to be a promising approach for large-scale self-
supervised learning. However, theoretical understanding of how it works is still unclear. In …

Empowering collaborative filtering with principled adversarial contrastive loss

A Zhang, L Sheng, Z Cai, X Wang… - Advances in Neural …, 2024 - proceedings.neurips.cc
Contrastive Learning (CL) has achieved impressive performance in self-supervised learning
tasks, showing superior generalization ability. Inspired by the success, adopting CL into …

Firerisk: A remote sensing dataset for fire risk assessment with benchmarks using supervised and self-supervised learning

S Shen, S Seneviratne, X Wanyan… - … Conference on Digital …, 2023 - ieeexplore.ieee.org
In recent decades, wildfires have caused tremendous property losses, fatalities, and
extensive damage to forest ecosystems. Inspired by the abundance of publicly available …

Understanding multimodal contrastive learning and incorporating unpaired data

R Nakada, HI Gulluk, Z Deng, W Ji… - International …, 2023 - proceedings.mlr.press
Abstract Language-supervised vision models have recently attracted great attention in
computer vision. A common approach to build such models is to use contrastive learning on …

The mechanism of prediction head in non-contrastive self-supervised learning

Z Wen, Y Li - Advances in Neural Information Processing …, 2022 - proceedings.neurips.cc
The surprising discovery of the BYOL method shows the negative samples can be replaced
by adding the prediction head to the network. It is mysterious why even when there exist …

Contranorm: A contrastive learning perspective on oversmoothing and beyond

X Guo, Y Wang, T Du, Y Wang - arXiv preprint arXiv:2303.06562, 2023 - arxiv.org
Oversmoothing is a common phenomenon in a wide range of Graph Neural Networks
(GNNs) and Transformers, where performance worsens as the number of layers increases …

Action++: Improving semi-supervised medical image segmentation with adaptive anatomical contrast

C You, W Dai, Y Min, L Staib, J Sekhon… - … Conference on Medical …, 2023 - Springer
Medical data often exhibits long-tail distributions with heavy class imbalance, which
naturally leads to difficulty in classifying the minority classes (ie, boundary regions or rare …