[HTML][HTML] Embracing change: Continual learning in deep neural networks

R Hadsell, D Rao, AA Rusu, R Pascanu - Trends in cognitive sciences, 2020 - cell.com
Artificial intelligence research has seen enormous progress over the past few decades, but it
predominantly relies on fixed datasets and stationary environments. Continual learning is an …

Inductive biases for deep learning of higher-level cognition

A Goyal, Y Bengio - Proceedings of the Royal Society A, 2022 - royalsocietypublishing.org
A fascinating hypothesis is that human and animal intelligence could be explained by a few
principles (rather than an encyclopaedic list of heuristics). If that hypothesis was correct, we …

A definition of continual reinforcement learning

D Abel, A Barreto, B Van Roy… - Advances in …, 2023 - proceedings.neurips.cc
In a standard view of the reinforcement learning problem, an agent's goal is to efficiently
identify a policy that maximizes long-term reward. However, this perspective is based on a …

Towards continual reinforcement learning: A review and perspectives

K Khetarpal, M Riemer, I Rish, D Precup - Journal of Artificial Intelligence …, 2022 - jair.org
In this article, we aim to provide a literature review of different formulations and approaches
to continual reinforcement learning (RL), also known as lifelong or non-stationary RL. We …

Curriculum learning for reinforcement learning domains: A framework and survey

S Narvekar, B Peng, M Leonetti, J Sinapov… - Journal of Machine …, 2020 - jmlr.org
Reinforcement learning (RL) is a popular paradigm for addressing sequential decision tasks
in which the agent has only limited environmental feedback. Despite many advances over …

Efficient lifelong learning with a-gem

A Chaudhry, MA Ranzato, M Rohrbach… - arXiv preprint arXiv …, 2018 - arxiv.org
In lifelong learning, the learner is presented with a sequence of tasks, incrementally building
a data-driven prior which may be leveraged to speed up learning of a new task. In this work …

Experience replay for continual learning

D Rolnick, A Ahuja, J Schwarz… - Advances in neural …, 2019 - proceedings.neurips.cc
Interacting with a complex world involves continual learning, in which tasks and data
distributions change over time. A continual learning system should demonstrate both …

Gradient projection memory for continual learning

G Saha, I Garg, K Roy - arXiv preprint arXiv:2103.09762, 2021 - arxiv.org
The ability to learn continually without forgetting the past tasks is a desired attribute for
artificial learning systems. Existing approaches to enable such learning in artificial neural …

[HTML][HTML] Continual lifelong learning with neural networks: A review

GI Parisi, R Kemker, JL Part, C Kanan, S Wermter - Neural networks, 2019 - Elsevier
Humans and animals have the ability to continually acquire, fine-tune, and transfer
knowledge and skills throughout their lifespan. This ability, referred to as lifelong learning, is …

On tiny episodic memories in continual learning

A Chaudhry, M Rohrbach, M Elhoseiny… - arXiv preprint arXiv …, 2019 - arxiv.org
In continual learning (CL), an agent learns from a stream of tasks leveraging prior
experience to transfer knowledge to future tasks. It is an ideal framework to decrease the …