A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trends

J Gui, T Chen, J Zhang, Q Cao, Z Sun… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Deep supervised learning algorithms typically require a large volume of labeled data to
achieve satisfactory performance. However, the process of collecting and labeling such data …

Scaling self-supervised learning for histopathology with masked image modeling

A Filiot, R Ghermi, A Olivier, P Jacob, L Fidon… - medRxiv, 2023 - medrxiv.org
Computational pathology is revolutionizing the field of pathology by integrating advanced
computer vision and machine learning technologies into diagnostic workflows. It offers …

Firerisk: A remote sensing dataset for fire risk assessment with benchmarks using supervised and self-supervised learning

S Shen, S Seneviratne, X Wanyan… - … Conference on Digital …, 2023 - ieeexplore.ieee.org
In recent decades, wildfires have caused tremendous property losses, fatalities, and
extensive damage to forest ecosystems. Inspired by the abundance of publicly available …

A large-scale examination of inductive biases shaping high-level visual representation in brains and machines

C Conwell, JS Prince, KN Kay, GA Alvarez… - Nature …, 2024 - nature.com
The rapid release of high-performing computer vision models offers new potential to study
the impact of different inductive biases on the emergent brain alignment of learned …

The ssl interplay: Augmentations, inductive bias, and generalization

V Cabannes, B Kiani, R Balestriero… - International …, 2023 - proceedings.mlr.press
Self-supervised learning (SSL) has emerged as a powerful framework to learn
representations from raw data without supervision. Yet in practice, engineers face issues …

On the stepwise nature of self-supervised learning

JB Simon, M Knutins, L Ziyin, D Geisz… - International …, 2023 - proceedings.mlr.press
We present a simple picture of the training process of self-supervised learning methods with
dual deep networks. In our picture, these methods learn their high-dimensional embeddings …

Speech self-supervised representation benchmarking: Are we doing it right?

S Zaiem, Y Kemiche, T Parcollet, S Essid… - arXiv preprint arXiv …, 2023 - arxiv.org
Self-supervised learning (SSL) has recently allowed leveraging large datasets of unlabeled
speech signals to reach impressive performance on speech tasks using only small amounts …

Hest-1k: A dataset for spatial transcriptomics and histology image analysis

G Jaume, P Doucet, AH Song, MY Lu… - arXiv preprint arXiv …, 2024 - arxiv.org
Spatial transcriptomics enables interrogating the molecular composition of tissue with ever-
increasing resolution and sensitivity. However, costs, rapidly evolving technology, and lack …

Multistain pretraining for slide representation learning in pathology

G Jaume, A Vaidya, A Zhang, A H. Song… - … on Computer Vision, 2024 - Springer
Developing self-supervised learning (SSL) models that can learn universal and transferable
representations of H&E gigapixel whole-slide images (WSIs) is becoming increasingly …

What can 1.8 billion regressions tell us about the pressures shaping high-level visual representation in brains and machines?

C Conwell, JS Prince, KN Kay, GA Alvarez, T Konkle - BioRxiv, 2022 - biorxiv.org
The rapid development and open-source release of highly performant computer vision
models offers new potential for examining how different inductive biases impact …