A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends

J Gui, T Chen, J Zhang, Q Cao, Z Sun… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Deep supervised learning algorithms typically require a large volume of labeled data to
achieve satisfactory performance. However, the process of collecting and labeling such data …

Open-world machine learning: applications, challenges, and opportunities

J Parmar, S Chouhan, V Raychoudhury… - ACM Computing …, 2023 - dl.acm.org
Traditional machine learning, mainly supervised learning, follows the assumptions of closed-
world learning, ie, for each testing class, a training class is available. However, such …

Simmatch: Semi-supervised learning with similarity matching

M Zheng, S You, L Huang, F Wang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Learning with few labeled data has been a longstanding problem in the computer vision and
machine learning research community. In this paper, we introduced a new semi-supervised …

Pre-training molecular graph representation with 3d geometry

S Liu, H Wang, W Liu, J Lasenby, H Guo… - arXiv preprint arXiv …, 2021 - arxiv.org
Molecular graph representation learning is a fundamental problem in modern drug and
material discovery. Molecular graphs are typically modeled by their 2D topological …

Semi-supervised and unsupervised deep visual learning: A survey

Y Chen, M Mancini, X Zhu… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
State-of-the-art deep learning models are often trained with a large amount of costly labeled
training data. However, requiring exhaustive manual annotations may degrade the model's …

On feature decorrelation in self-supervised learning

T Hua, W Wang, Z Xue, S Ren… - Proceedings of the …, 2021 - openaccess.thecvf.com
In self-supervised representation learning, a common idea behind most of the state-of-the-
art approaches is to enforce the robustness of the representations to predefined …

Contrastive learning with stronger augmentations

X Wang, GJ Qi - IEEE transactions on pattern analysis and …, 2022 - ieeexplore.ieee.org
Representation learning has significantly been developed with the advance of contrastive
learning methods. Most of those methods are benefited from various data augmentations …

Exploring patch-wise semantic relation for contrastive learning in image-to-image translation tasks

C Jung, G Kwon, JC Ye - … of the IEEE/CVF conference on …, 2022 - openaccess.thecvf.com
Recently, contrastive learning-based image translation methods have been proposed, which
contrasts different spatial locations to enhance the spatial correspondence. However, the …

Ressl: Relational self-supervised learning with weak augmentation

M Zheng, S You, F Wang, C Qian… - Advances in …, 2021 - proceedings.neurips.cc
Self-supervised Learning (SSL) including the mainstream contrastive learning has achieved
great success in learning visual representations without data annotations. However, most of …

Hcsc: Hierarchical contrastive selective coding

Y Guo, M Xu, J Li, B Ni, X Zhu… - Proceedings of the …, 2022 - openaccess.thecvf.com
Hierarchical semantic structures naturally exist in an image dataset, in which several
semantically relevant image clusters can be further integrated into a larger cluster with …