Self-supervised remote sensing feature learning: Learning paradigms, challenges, and future works

C Tao, J Qi, M Guo, Q Zhu, H Li - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Deep learning has achieved great success in learning features from massive remote
sensing images (RSIs). To better understand the connection between three feature learning …

Contrast with reconstruct: Contrastive 3d representation learning guided by generative pretraining

Z Qi, R Dong, G Fan, Z Ge, X Zhang… - … on Machine Learning, 2023 - proceedings.mlr.press
Mainstream 3D representation learning approaches are built upon contrastive or generative
modeling pretext tasks, where great improvements in performance on various downstream …

DiffCSE: Difference-based contrastive learning for sentence embeddings

YS Chuang, R Dangovski, H Luo, Y Zhang… - arXiv preprint arXiv …, 2022 - arxiv.org
We propose DiffCSE, an unsupervised contrastive learning framework for learning sentence
embeddings. DiffCSE learns sentence embeddings that are sensitive to the difference …

Let invariant rationale discovery inspire graph contrastive learning

S Li, X Wang, A Zhang, Y Wu, X He… - … on machine learning, 2022 - proceedings.mlr.press
Leading graph contrastive learning (GCL) methods perform graph augmentations in two
fashions:(1) randomly corrupting the anchor graph, which could cause the loss of semantic …

Learning equivariant segmentation with instance-unique querying

W Wang, J Liang, D Liu - Advances in Neural Information …, 2022 - proceedings.neurips.cc
Prevalent state-of-the-art instance segmentation methods fall into a query-based scheme, in
which instance masks are derived by querying the image feature using a set of instance …

Equivariant similarity for vision-language foundation models

T Wang, K Lin, L Li, CC Lin, Z Yang… - Proceedings of the …, 2023 - openaccess.thecvf.com
This study explores the concept of equivariance in vision-language foundation models
(VLMs), focusing specifically on the multimodal similarity function that is not only the major …

Understanding masked image modeling via learning occlusion invariant feature

X Kong, X Zhang - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Abstract Recently, Masked Image Modeling (MIM) achieves great success in self-supervised
visual recognition. However, as a reconstruction-based framework, it is still an open …

Max pooling with vision transformers reconciles class and shape in weakly supervised semantic segmentation

S Rossetti, D Zappia, M Sanzari, M Schaerf… - European conference on …, 2022 - Springer
Abstract Weakly Supervised Semantic Segmentation (WSSS) research has explored many
directions to improve the typical pipeline CNN plus class activation maps (CAM) plus …

Firerisk: A remote sensing dataset for fire risk assessment with benchmarks using supervised and self-supervised learning

S Shen, S Seneviratne, X Wanyan… - … Conference on Digital …, 2023 - ieeexplore.ieee.org
In recent decades, wildfires have caused tremendous property losses, fatalities, and
extensive damage to forest ecosystems. Inspired by the abundance of publicly available …

Uncertainty-guided voxel-level supervised contrastive learning for semi-supervised medical image segmentation

Y Hua, X Shu, Z Wang, L Zhang - International journal of neural …, 2022 - World Scientific
Semi-supervised learning reduces overfitting and facilitates medical image segmentation by
regularizing the learning of limited well-annotated data with the knowledge provided by a …