A comprehensive survey on pretrained foundation models: A history from bert to chatgpt

C Zhou, Q Li, C Li, J Yu, Y Liu, G Wang… - arXiv preprint arXiv …, 2023 - arxiv.org
Pretrained Foundation Models (PFMs) are regarded as the foundation for various
downstream tasks with different data modalities. A PFM (eg, BERT, ChatGPT, and GPT-4) is …

A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends

J Gui, T Chen, J Zhang, Q Cao, Z Sun… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Deep supervised learning algorithms typically require a large volume of labeled data to
achieve satisfactory performance. However, the process of collecting and labeling such data …

Self-supervised learning in remote sensing: A review

Y Wang, CM Albrecht, NAA Braham… - IEEE Geoscience and …, 2022 - ieeexplore.ieee.org
In deep learning research, self-supervised learning (SSL) has received great attention,
triggering interest within both the computer vision and remote sensing communities. While …

Unsupervised degradation representation learning for blind super-resolution

L Wang, Y Wang, X Dong, Q Xu… - Proceedings of the …, 2021 - openaccess.thecvf.com
Most existing CNN-based super-resolution (SR) methods are developed based on an
assumption that the degradation is fixed and known (eg, bicubic downsampling). However …

Patch svdd: Patch-level svdd for anomaly detection and segmentation

J Yi, S Yoon - Proceedings of the Asian conference on …, 2020 - openaccess.thecvf.com
In this paper, we address the problem of image anomaly detection and segmentation.
Anomaly detection involves making a binary decision as to whether an input image contains …

Self-supervised learning of pretext-invariant representations

I Misra, L Maaten - … of the IEEE/CVF conference on …, 2020 - openaccess.thecvf.com
The goal of self-supervised learning from images is to construct image representations that
are semantically meaningful via pretext tasks that do not require semantic annotations. Many …

Scan: Learning to classify images without labels

W Van Gansbeke, S Vandenhende… - European conference on …, 2020 - Springer
Can we automatically group images into semantically meaningful clusters when ground-
truth annotations are absent? The task of unsupervised image classification remains an …

Unsupervised semantic segmentation by contrasting object mask proposals

W Van Gansbeke, S Vandenhende… - Proceedings of the …, 2021 - openaccess.thecvf.com
Being able to learn dense semantic representations of images without supervision is an
important problem in computer vision. However, despite its significance, this problem …

Contrastive multiview coding

Y Tian, D Krishnan, P Isola - Computer Vision–ECCV 2020: 16th European …, 2020 - Springer
Humans view the world through many sensory channels, eg, the long-wavelength light
channel, viewed by the left eye, or the high-frequency vibrations channel, heard by the right …

Semi-supervised and unsupervised deep visual learning: A survey

Y Chen, M Mancini, X Zhu… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
State-of-the-art deep learning models are often trained with a large amount of costly labeled
training data. However, requiring exhaustive manual annotations may degrade the model's …