Scaling vision transformers to 22 billion parameters

M Dehghani, J Djolonga, B Mustafa… - International …, 2023 - proceedings.mlr.press
The scaling of Transformers has driven breakthrough capabilities for language models. At
present, the largest large language models (LLMs) contain upwards of 100B parameters …

Pushing the limits of simple pipelines for few-shot learning: External data and fine-tuning make a difference

SX Hu, D Li, J Stühmer, M Kim… - Proceedings of the …, 2022 - openaccess.thecvf.com
Few-shot learning (FSL) is an important and topical problem in computer vision that has
motivated extensive research into numerous methods spanning from sophisticated meta …

Cross-domain few-shot learning with task-specific adapters

WH Li, X Liu, H Bilen - … of the IEEE/CVF conference on …, 2022 - openaccess.thecvf.com
In this paper, we look at the problem of cross-domain few-shot classification that aims to
learn a classifier from previously unseen classes and domains with few labeled samples …

Head2toe: Utilizing intermediate representations for better transfer learning

U Evci, V Dumoulin, H Larochelle… - … on Machine Learning, 2022 - proceedings.mlr.press
Transfer-learning methods aim to improve performance in a data-scarce target domain using
a model pretrained on a data-rich source domain. A cost-efficient strategy, linear probing …

Deep learning for cross-domain few-shot visual recognition: A survey

H Xu, S Zhi, S Sun, VM Patel, L Liu - arXiv preprint arXiv:2303.08557, 2023 - arxiv.org
Deep learning has been highly successful in computer vision with large amounts of labeled
data, but struggles with limited labeled training data. To address this, Few-shot learning …

Meta learning with graph attention networks for low-data drug discovery

Q Lv, G Chen, Z Yang, W Zhong… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Finding candidate molecules with favorable pharmacological activity, low toxicity, and
proper pharmacokinetic properties is an important task in drug discovery. Deep neural …

Few‐shot learning for plant disease recognition: A review

J Sun, W Cao, X Fu, S Ochi, T Yamanaka - Agronomy Journal, 2024 - Wiley Online Library
Monitoring plant diseases is essential for farmers to secure crop quantity and quality. Deep
learning has recently been applied to plant disease recognition to help farmers take prompt …

Context-enriched molecule representations improve few-shot drug discovery

J Schimunek, P Seidl, L Friedrich, D Kuhn… - arXiv preprint arXiv …, 2023 - arxiv.org
A central task in computational drug discovery is to construct models from known active
molecules to find further promising molecules for subsequent screening. However, typically …

Knowledge transduction for cross-domain few-shot learning

P Li, F Liu, L Jiao, S Li, L Li, X Liu, X Huang - Pattern Recognition, 2023 - Elsevier
Abstract Cross-Domain Few-Shot Learning (CDFSL) aims to classify new categories from
new domains with few samples. It confronts a greater domain shift than Few-Shot Learning …

ConfeSS: A framework for single source cross-domain few-shot learning

D Das, S Yun, F Porikli - International Conference on Learning …, 2022 - openreview.net
Most current few-shot learning methods train a model from abundantly labeled base
category data and then transfer and adapt the model to sparsely labeled novel category …