No representation rules them all in category discovery

S Vaze, A Vedaldi, A Zisserman - Advances in Neural …, 2024 - proceedings.neurips.cc
In this paper we tackle the problem of Generalized Category Discovery (GCD). Specifically,
given a dataset with labelled and unlabelled images, the task is to cluster all images in the …

Meta omnium: A benchmark for general-purpose learning-to-learn

O Bohdal, Y Tian, Y Zong, R Chavhan… - Proceedings of the …, 2023 - openaccess.thecvf.com
Meta-learning and other approaches to few-shot learning are widely studied for image
recognition, and are increasingly applied to other vision tasks such as pose estimation and …

Quality Diversity for Visual Pre-Training

R Chavhan, H Gouk, D Li… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Models pre-trained on large datasets such as ImageNet provide the de-facto
standard for transfer learning, with both supervised and self-supervised approaches proving …

[HTML][HTML] Augmentation-aware self-supervised learning with conditioned projector

M Przewięźlikowski, M Pyla, B Zieliński… - Knowledge-Based …, 2024 - Elsevier
Self-supervised learning (SSL) is a powerful technique for learning from unlabeled data. By
learning to remain invariant to applied data augmentations, methods such as SimCLR and …

MT-SLVR: Multi-Task Self-Supervised Learning for Transformation In (Variant) Representations

C Heggan, T Hospedales, S Budgett… - arXiv preprint arXiv …, 2023 - arxiv.org
Contrastive self-supervised learning has gained attention for its ability to create high-quality
representations from large unlabelled data sets. A key reason that these powerful features …

Beyond [cls]: Exploring the true potential of Masked Image Modeling representations

M Przewięźlikowski, R Balestriero, W Jasiński… - arXiv preprint arXiv …, 2024 - arxiv.org
Masked Image Modeling (MIM) has emerged as a popular method for Self-Supervised
Learning (SSL) of visual representations. However, for high-level perception tasks, MIM …

[PDF][PDF] Self-Supervised Learning for Transferable Representations

L Ericsson - 2024 - core.ac.uk
Abstract Machine learning has undeniably achieved remarkable advances thanks to large
labelled datasets and supervised learning. However, this progress is constrained by the …

Opportunities and risks of stochastic deep learning

P Eustratiadis - 2024 - era.ed.ac.uk
This thesis studies opportunities and risks associated with stochasticity in deep learning that
specifically manifest in the context of adversarial robustness and neural architecture search …

Meta-learning algorithms and applications

O Bohdal - 2024 - era.ed.ac.uk
Meta-learning in the broader context concerns how an agent learns about their own
learning, allowing them to improve their learning process. Learning how to learn is not only …

Contrastive-Equivariant Self-Supervised Learning Improves Alignment with Primate Visual Area IT

TE Yerxa, J Feather, EP Simoncelli… - The Thirty-eighth Annual … - openreview.net
Models trained with self-supervised learning objectives have recently matched or surpassed
models trained with traditional supervised object recognition in their ability to predict neural …