Supervised masked knowledge distillation for few-shot transformers

H Lin, G Han, J Ma, S Huang, X Lin… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Vision Transformers (ViTs) emerge to achieve impressive performance on many
data-abundant computer vision tasks by capturing long-range dependencies among local …

Class-aware patch embedding adaptation for few-shot image classification

F Hao, F He, L Liu, F Wu, D Tao… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract" A picture is worth a thousand words", significantly beyond mere a categorization.
Accompanied by that, many patches of the image could have completely irrelevant …

小样本图像分类研究综述.

安胜彪, 郭昱岐, 白宇, 王腾博 - Journal of Frontiers of …, 2023 - search.ebscohost.com
近年来, 借助大规模数据集和庞大的计算资源, 以深度学习为代表的人工智能算法在诸多领域
取得成功. 其中计算机视觉领域的图像分类技术蓬勃发展, 并涌现出许多成熟的视觉任务分类 …

Strong Baselines for Parameter-Efficient Few-Shot Fine-Tuning

S Basu, S Hu, D Massiceti, S Feizi - … of the AAAI Conference on Artificial …, 2024 - ojs.aaai.org
Few-shot classification (FSC) entails learning novel classes given only a few examples per
class after a pre-training (or meta-training) phase on a set of base classes. Recent works …

Masking strategies for background bias removal in computer vision models

A Aniraj, CF Dantas, D Ienco… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Models for fine-grained image classification tasks, where the difference between
some classes can be extremely subtle and the number of samples per class tends to be low …

Focus your attention when few-shot classification

H Wang, S Jie, Z Deng - Advances in Neural Information …, 2024 - proceedings.neurips.cc
Since many pre-trained vision transformers emerge and provide strong representation for
various downstream tasks, we aim to adapt them to few-shot image classification tasks in …

ViTFSL-Baseline: A Simple Baseline of Vision Transformer Network for Few-Shot Image Classification

G Wang, Y Wang, Z Pan, X Wang, J Zhang… - IEEE Access, 2024 - ieeexplore.ieee.org
Few-shot image classification, whose goal is to generalize to unseen tasks with scarce
labeled data, has developed rapidly over the years. However, in traditional few-shot learning …

When hard negative sampling meets supervised contrastive learning

Z Long, G Killick, R McCreadie, GA Camarasa… - arXiv preprint arXiv …, 2023 - arxiv.org
State-of-the-art image models predominantly follow a two-stage strategy: pre-training on
large datasets and fine-tuning with cross-entropy loss. Many studies have shown that using …

Simple Semantic-Aided Few-Shot Learning

H Zhang, J Xu, S Jiang, Z He - Proceedings of the IEEE/CVF …, 2024 - openaccess.thecvf.com
Learning from a limited amount of data namely Few-Shot Learning stands out as a
challenging computer vision task. Several works exploit semantics and design complicated …

Discriminative Sample-Guided and Parameter-Efficient Feature Space Adaptation for Cross-Domain Few-Shot Learning

R Perera, S Halgamuge - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
In this paper we look at cross-domain few-shot classification which presents the challenging
task of learning new classes in previously unseen domains with few labelled examples …