A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends

J Gui, T Chen, J Zhang, Q Cao, Z Sun… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Deep supervised learning algorithms typically require a large volume of labeled data to
achieve satisfactory performance. However, the process of collecting and labeling such data …

A survey on deep semi-supervised learning

X Yang, Z Song, I King, Z Xu - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Deep semi-supervised learning is a fast-growing field with a range of practical applications.
This paper provides a comprehensive survey on both fundamentals and recent advances in …

Towards a general-purpose foundation model for computational pathology

RJ Chen, T Ding, MY Lu, DFK Williamson, G Jaume… - Nature Medicine, 2024 - nature.com
Quantitative evaluation of tissue images is crucial for computational pathology (CPath) tasks,
requiring the objective characterization of histopathological entities from whole-slide images …

Freematch: Self-adaptive thresholding for semi-supervised learning

Y Wang, H Chen, Q Heng, W Hou, Y Fan, Z Wu… - arXiv preprint arXiv …, 2022 - arxiv.org
Pseudo labeling and consistency regularization approaches with confidence-based
thresholding have made great progress in semi-supervised learning (SSL). In this paper, we …

Scaling vision transformers

X Zhai, A Kolesnikov, N Houlsby… - Proceedings of the …, 2022 - openaccess.thecvf.com
Attention-based neural networks such as the Vision Transformer (ViT) have recently attained
state-of-the-art results on many computer vision benchmarks. Scale is a primary ingredient …

Simmatch: Semi-supervised learning with similarity matching

M Zheng, S You, L Huang, F Wang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Learning with few labeled data has been a longstanding problem in the computer vision and
machine learning research community. In this paper, we introduced a new semi-supervised …

Convit: Improving vision transformers with soft convolutional inductive biases

S d'Ascoli, H Touvron, ML Leavitt… - International …, 2021 - proceedings.mlr.press
Convolutional architectures have proven extremely successful for vision tasks. Their hard
inductive biases enable sample-efficient learning, but come at the cost of a potentially lower …

Barlow twins: Self-supervised learning via redundancy reduction

J Zbontar, L Jing, I Misra, Y LeCun… - … on machine learning, 2021 - proceedings.mlr.press
Self-supervised learning (SSL) is rapidly closing the gap with supervised methods on large
computer vision benchmarks. A successful approach to SSL is to learn embeddings which …

Knowledge tracing: A survey

G Abdelrahman, Q Wang, B Nunes - ACM Computing Surveys, 2023 - dl.acm.org
Humans' ability to transfer knowledge through teaching is one of the essential aspects for
human intelligence. A human teacher can track the knowledge of students to customize the …

St++: Make self-training work better for semi-supervised semantic segmentation

L Yang, W Zhuo, L Qi, Y Shi… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Self-training via pseudo labeling is a conventional, simple, and popular pipeline to leverage
unlabeled data. In this work, we first construct a strong baseline of self-training (namely ST) …