Advances and challenges in meta-learning: A technical review

A Vettoruzzo, MR Bouguelia… - … on Pattern Analysis …, 2024 - ieeexplore.ieee.org
Meta-learning empowers learning systems with the ability to acquire knowledge from
multiple tasks, enabling faster adaptation and generalization to new tasks. This review …

Rethinking generalization in few-shot classification

M Hiller, R Ma, M Harandi… - Advances in Neural …, 2022 - proceedings.neurips.cc
Single image-level annotations only correctly describe an often small subset of an image's
content, particularly when complex real-world scenes are depicted. While this might be …

Meta-learning with a geometry-adaptive preconditioner

S Kang, D Hwang, M Eo, T Kim… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Model-agnostic meta-learning (MAML) is one of the most successful meta-learning
algorithms. It has a bi-level optimization structure where the outer-loop process learns a …

Gradient-based bi-level optimization for deep learning: A survey

C Chen, X Chen, C Ma, Z Liu, X Liu - arXiv preprint arXiv:2207.11719, 2022 - arxiv.org
Bi-level optimization, especially the gradient-based category, has been widely used in the
deep learning community including hyperparameter optimization and meta-knowledge …

SHOT: suppressing the hessian along the optimization trajectory for gradient-based meta-learning

JH Lee, J Yoo, N Kwak - Advances in Neural Information …, 2023 - proceedings.neurips.cc
In this paper, we hypothesize that gradient-based meta-learning (GBML) implicitly
suppresses the Hessian along the optimization trajectory in the inner loop. Based on this …

Adaptive attribute distribution similarity for few-shot learning

A Cai, L Chen, Y Chen, Z He, S Tao, C Zhou - Image and Vision Computing, 2024 - Elsevier
Modern deep learning has many drawbacks, including a heavy reliance on labeled data.
One of the key strategies for solving this problem is few-shot learning (FSL). With just a few …

Meta-Learning With Versatile Loss Geometries for Fast Adaptation Using Mirror Descent

Y Zhang, B Li, GB Giannakis - ICASSP 2024-2024 IEEE …, 2024 - ieeexplore.ieee.org
Utilizing task-invariant prior knowledge extracted from related tasks, meta-learning is a
principled framework that empowers learning a new task especially when data records are …

GAML: geometry-aware meta-learning via a fully adaptive preconditioner

S Kang, D Hwang, M Eo, T Kim, W Rhee - openreview.net
Model-Agnostic Meta-Learning (MAML) is one of the most successful meta-learning
algorithms. It has a bi-level optimization structure, where the outer-loop process learns the …