Biological underpinnings for lifelong learning machines

D Kudithipudi, M Aguilar-Simon, J Babb… - Nature Machine …, 2022 - nature.com
Biological organisms learn from interactions with their environment throughout their lifetime.
For artificial systems to successfully act and adapt in the real world, it is desirable to similarly …

[HTML][HTML] Embracing change: Continual learning in deep neural networks

R Hadsell, D Rao, AA Rusu, R Pascanu - Trends in cognitive sciences, 2020 - cell.com
Artificial intelligence research has seen enormous progress over the past few decades, but it
predominantly relies on fixed datasets and stationary environments. Continual learning is an …

Continual learning for robotics: Definition, framework, learning strategies, opportunities and challenges

T Lesort, V Lomonaco, A Stoian, D Maltoni, D Filliat… - Information fusion, 2020 - Elsevier
Continual learning (CL) is a particular machine learning paradigm where the data
distribution and learning objective change through time, or where all the training data and …

[HTML][HTML] Continual lifelong learning with neural networks: A review

GI Parisi, R Kemker, JL Part, C Kanan, S Wermter - Neural networks, 2019 - Elsevier
Humans and animals have the ability to continually acquire, fine-tune, and transfer
knowledge and skills throughout their lifespan. This ability, referred to as lifelong learning, is …

Selective amnesia: A continual learning approach to forgetting in deep generative models

A Heng, H Soh - Advances in Neural Information Processing …, 2024 - proceedings.neurips.cc
The recent proliferation of large-scale text-to-image models has led to growing concerns that
such models may be misused to generate harmful, misleading, and inappropriate content …

Orthogonal gradient descent for continual learning

M Farajtabar, N Azizan, A Mott… - … Conference on Artificial …, 2020 - proceedings.mlr.press
Neural networks are achieving state of the art and sometimes super-human performance on
learning tasks across a variety of domains. Whenever these problems require learning in a …

Measuring catastrophic forgetting in neural networks

R Kemker, M McClure, A Abitino, T Hayes… - Proceedings of the AAAI …, 2018 - ojs.aaai.org
Deep neural networks are used in many state-of-the-art systems for machine perception.
Once a network is trained to do a specific task, eg, bird classification, it cannot easily be …

Continual unsupervised representation learning

D Rao, F Visin, A Rusu, R Pascanu… - Advances in neural …, 2019 - proceedings.neurips.cc
Continual learning aims to improve the ability of modern learning systems to deal with non-
stationary distributions, typically by attempting to learn a series of tasks sequentially. Prior art …

Replay in deep learning: Current approaches and missing biological elements

TL Hayes, GP Krishnan, M Bazhenov… - Neural …, 2021 - ieeexplore.ieee.org
Replay is the reactivation of one or more neural patterns that are similar to the activation
patterns experienced during past waking experiences. Replay was first observed in …

Testing deep neural networks

Y Sun, X Huang, D Kroening, J Sharp, M Hill… - arXiv preprint arXiv …, 2018 - arxiv.org
Deep neural networks (DNNs) have a wide range of applications, and software employing
them must be thoroughly tested, especially in safety-critical domains. However, traditional …