You never cluster alone

Y Shen, Z Shen, M Wang, J Qin… - Advances in Neural …, 2021 - proceedings.neurips.cc
Recent advances in self-supervised learning with instance-level contrastive objectives
facilitate unsupervised clustering. However, a standalone datum is not perceiving the …

Contrastive clustering

Y Li, P Hu, Z Liu, D Peng, JT Zhou… - Proceedings of the AAAI …, 2021 - ojs.aaai.org
In this paper, we propose an online clustering method called Contrastive Clustering (CC)
which explicitly performs the instance-and cluster-level contrastive learning. To be specific …

Data-efficient contrastive self-supervised learning: Most beneficial examples for supervised learning contribute the least

S Joshi, B Mirzasoleiman - International conference on …, 2023 - proceedings.mlr.press
Self-supervised learning (SSL) learns high-quality representations from large pools of
unlabeled training data. As datasets grow larger, it becomes crucial to identify the examples …

HyperMatch: Noise-tolerant semi-supervised learning via relaxed contrastive constraint

B Zhou, J Lu, K Liu, Y Xu… - Proceedings of the …, 2023 - openaccess.thecvf.com
Recent developments of the application of Contrastive Learning in Semi-Supervised
Learning (SSL) have demonstrated significant advancements, as a result of its exceptional …

Chaos is a ladder: A new theoretical understanding of contrastive learning via augmentation overlap

Y Wang, Q Zhang, Y Wang, J Yang, Z Lin - arXiv preprint arXiv …, 2022 - arxiv.org
Recently, contrastive learning has risen to be a promising approach for large-scale self-
supervised learning. However, theoretical understanding of how it works is still unclear. In …

Temperature schedules for self-supervised contrastive methods on long-tail data

A Kukleva, M Böhle, B Schiele, H Kuehne… - arXiv preprint arXiv …, 2023 - arxiv.org
Most approaches for self-supervised learning (SSL) are optimised on curated balanced
datasets, eg ImageNet, despite the fact that natural data usually exhibits long-tail …

Effective sample pairs based contrastive learning for clustering

J Yin, H Wu, S Sun - Information Fusion, 2023 - Elsevier
As an indispensable branch of unsupervised learning, deep clustering is rapidly emerging
along with the growth of deep neural networks. Recently, contrastive learning paradigm has …

Towards the generalization of contrastive self-supervised learning

W Huang, M Yi, X Zhao, Z Jiang - arXiv preprint arXiv:2111.00743, 2021 - arxiv.org
Recently, self-supervised learning has attracted great attention, since it only requires
unlabeled data for model training. Contrastive learning is one popular method for self …

Contrastive self-supervised learning: a survey on different architectures

A Khan, S AlBarri, MA Manzoor - 2022 2nd International …, 2022 - ieeexplore.ieee.org
Self-Supervised Learning (SSL) has enhanced the learning process of semantic
representations from images. SSL has reduced the need for annotating or labelling the data …

A theoretical study of inductive biases in contrastive learning

JZ HaoChen, T Ma - arXiv preprint arXiv:2211.14699, 2022 - arxiv.org
Understanding self-supervised learning is important but challenging. Previous theoretical
works study the role of pretraining losses, and view neural networks as general black boxes …