Meta-learning in neural networks: A survey

T Hospedales, A Antoniou, P Micaelli… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
The field of meta-learning, or learning-to-learn, has seen a dramatic rise in interest in recent
years. Contrary to conventional approaches to AI where tasks are solved from scratch using …

Free lunch for few-shot learning: Distribution calibration

S Yang, L Liu, M Xu - arXiv preprint arXiv:2101.06395, 2021 - arxiv.org
Learning from a limited number of samples is challenging since the learned model can
easily become overfitted based on the biased distribution formed by only a few training …

Self-supervision can be a good few-shot learner

Y Lu, L Wen, J Liu, Y Liu, X Tian - European conference on computer …, 2022 - Springer
Existing few-shot learning (FSL) methods rely on training with a large labeled dataset, which
prevents them from leveraging abundant unlabeled data. From an information-theoretic …

Unsupervised meta-learning for few-shot image classification

S Khodadadeh, L Boloni… - Advances in neural …, 2019 - proceedings.neurips.cc
Few-shot or one-shot learning of classifiers requires a significant inductive bias towards the
type of task to be learned. One way to acquire this is by meta-learning on tasks similar to the …

Meta-learning requires meta-augmentation

J Rajendran, A Irpan, E Jang - Advances in Neural …, 2020 - proceedings.neurips.cc
Meta-learning algorithms aim to learn two components: a model that predicts targets for a
task, and a base learner that updates that model when given examples from a new task. This …

Data augmentation for meta-learning

R Ni, M Goldblum, A Sharaf, K Kong… - … on Machine Learning, 2021 - proceedings.mlr.press
Conventional image classifiers are trained by randomly sampling mini-batches of images.
To achieve state-of-the-art performance, practitioners use sophisticated data augmentation …

What can knowledge bring to machine learning?—a survey of low-shot learning for structured data

Y Hu, A Chapman, G Wen, DW Hall - ACM Transactions on Intelligent …, 2022 - dl.acm.org
Supervised machine learning has several drawbacks that make it difficult to use in many
situations. Drawbacks include heavy reliance on massive training data, limited …

Few-shot learning with visual distribution calibration and cross-modal distribution alignment

R Wang, H Zheng, X Duan, J Liu, Y Lu… - Proceedings of the …, 2023 - openaccess.thecvf.com
Pre-trained vision-language models have inspired much research on few-shot learning.
However, with only a few training images, there exist two crucial problems:(1) the visual …

Unsupervised meta-learning for reinforcement learning

A Gupta, B Eysenbach, C Finn, S Levine - arXiv preprint arXiv:1806.04640, 2018 - arxiv.org
Meta-learning algorithms use past experience to learn to quickly solve new tasks. In the
context of reinforcement learning, meta-learning algorithms acquire reinforcement learning …

Fine-grained angular contrastive learning with coarse labels

G Bukchin, E Schwartz, K Saenko… - Proceedings of the …, 2021 - openaccess.thecvf.com
Few-shot learning methods offer pre-training techniques optimized for easier later
adaptation of the model to new classes (unseen during training) using one or a few …