Sustainable ai: Environmental implications, challenges and opportunities

CJ Wu, R Raghavendra, U Gupta… - Proceedings of …, 2022 - proceedings.mlsys.org
This paper explores the environmental impact of the super-linear growth trends for AI from a
holistic perspective, spanning Data, Algorithms, and System Hardware. We characterize the …

Self-supervised learning from images with a joint-embedding predictive architecture

M Assran, Q Duval, I Misra… - Proceedings of the …, 2023 - openaccess.thecvf.com
This paper demonstrates an approach for learning highly semantic image representations
without relying on hand-crafted data-augmentations. We introduce the Image-based Joint …

Masked siamese networks for label-efficient learning

M Assran, M Caron, I Misra, P Bojanowski… - … on Computer Vision, 2022 - Springer
Abstract We propose Masked Siamese Networks (MSN), a self-supervised learning
framework for learning image representations. Our approach matches the representation of …

Simmatch: Semi-supervised learning with similarity matching

M Zheng, S You, L Huang, F Wang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Learning with few labeled data has been a longstanding problem in the computer vision and
machine learning research community. In this paper, we introduced a new semi-supervised …

No representation rules them all in category discovery

S Vaze, A Vedaldi, A Zisserman - Advances in Neural …, 2024 - proceedings.neurips.cc
In this paper we tackle the problem of Generalized Category Discovery (GCD). Specifically,
given a dataset with labelled and unlabelled images, the task is to cluster all images in the …

Are large-scale datasets necessary for self-supervised pre-training?

A El-Nouby, G Izacard, H Touvron, I Laptev… - arXiv preprint arXiv …, 2021 - arxiv.org
Pre-training models on large scale datasets, like ImageNet, is a standard practice in
computer vision. This paradigm is especially effective for tasks with small training sets, for …

Debiased learning from naturally imbalanced pseudo-labels

X Wang, Z Wu, L Lian, SX Yu - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
This work studies the bias issue of pseudo-labeling, a natural phenomenon that widely
occurs but often overlooked by prior research. Pseudo-labels are generated when a …

How to exploit hyperspherical embeddings for out-of-distribution detection?

Y Ming, Y Sun, O Dia, Y Li - arXiv preprint arXiv:2203.04450, 2022 - arxiv.org
Out-of-distribution (OOD) detection is a critical task for reliable machine learning. Recent
advances in representation learning give rise to distance-based OOD detection, where …

Debiased self-training for semi-supervised learning

B Chen, J Jiang, X Wang, P Wan… - Advances in Neural …, 2022 - proceedings.neurips.cc
Deep neural networks achieve remarkable performances on a wide range of tasks with the
aid of large-scale labeled datasets. Yet these datasets are time-consuming and labor …

Semi-supervised vision transformers at scale

Z Cai, A Ravichandran, P Favaro… - Advances in …, 2022 - proceedings.neurips.cc
We study semi-supervised learning (SSL) for vision transformers (ViT), an under-explored
topic despite the wide adoption of the ViT architectures to different tasks. To tackle this …