Meta-learning in neural networks: A survey

T Hospedales, A Antoniou, P Micaelli… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
The field of meta-learning, or learning-to-learn, has seen a dramatic rise in interest in recent
years. Contrary to conventional approaches to AI where tasks are solved from scratch using …

Unbiased gradient estimation in unrolled computation graphs with persistent evolution strategies

P Vicol, L Metz, J Sohl-Dickstein - … Conference on Machine …, 2021 - proceedings.mlr.press
Unrolled computation graphs arise in many scenarios, including training RNNs, tuning
hyperparameters through unrolled optimization, and training learned optimizers. Current …

Evograd: Efficient gradient-based meta-learning and hyperparameter optimization

O Bohdal, Y Yang… - Advances in neural …, 2021 - proceedings.neurips.cc
Gradient-based meta-learning and hyperparameter optimization have seen significant
progress recently, enabling practical end-to-end training of neural networks together with …

Population-based evolution optimizes a meta-learning objective

K Frans, O Witkowski - arXiv preprint arXiv:2103.06435, 2021 - arxiv.org
Meta-learning models, or models that learn to learn, have been a long-desired target for
their ability to quickly solve new tasks. Traditional meta-learning methods can require …

A unified framework for gradient-based hyperparameter optimization and meta-learning

L Franceschi - 2021 - discovery.ucl.ac.uk
Machine learning algorithms and systems are progressively becoming part of our societies,
leading to a growing need of building a vast multitude of accurate, reliable and interpretable …