[HTML][HTML] Continual lifelong learning with neural networks: A review

GI Parisi, R Kemker, JL Part, C Kanan, S Wermter - Neural networks, 2019 - Elsevier
Humans and animals have the ability to continually acquire, fine-tune, and transfer
knowledge and skills throughout their lifespan. This ability, referred to as lifelong learning, is …

Continual learning for robotics: Definition, framework, learning strategies, opportunities and challenges

T Lesort, V Lomonaco, A Stoian, D Maltoni, D Filliat… - Information fusion, 2020 - Elsevier
Continual learning (CL) is a particular machine learning paradigm where the data
distribution and learning objective change through time, or where all the training data and …

A continual learning survey: Defying forgetting in classification tasks

M De Lange, R Aljundi, M Masana… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Artificial neural networks thrive in solving the classification problem for a particular rigid task,
acquiring knowledge through generalized learning behaviour from a distinct training phase …

Dualnet: Continual learning, fast and slow

Q Pham, C Liu, S Hoi - Advances in Neural Information …, 2021 - proceedings.neurips.cc
Abstract According to Complementary Learning Systems (CLS) theory~\cite
{mcclelland1995there} in neuroscience, humans do effective\emph {continual learning} …

A theoretical study on solving continual learning

G Kim, C Xiao, T Konishi, Z Ke… - Advances in neural …, 2022 - proceedings.neurips.cc
Continual learning (CL) learns a sequence of tasks incrementally. There are two popular CL
settings, class incremental learning (CIL) and task incremental learning (TIL). A major …

The natural language decathlon: Multitask learning as question answering

B McCann, NS Keskar, C Xiong, R Socher - arXiv preprint arXiv …, 2018 - arxiv.org
Deep learning has improved performance on many natural language processing (NLP)
tasks individually. However, general NLP models cannot emerge within a paradigm that …

[HTML][HTML] A dynamic ensemble learning algorithm for neural networks

KMR Alam, N Siddique, H Adeli - Neural Computing and Applications, 2020 - Springer
This paper presents a novel dynamic ensemble learning (DEL) algorithm for designing
ensemble of neural networks (NNs). DEL algorithm determines the size of ensemble, the …

Measuring catastrophic forgetting in neural networks

R Kemker, M McClure, A Abitino, T Hayes… - Proceedings of the AAAI …, 2018 - ojs.aaai.org
Deep neural networks are used in many state-of-the-art systems for machine perception.
Once a network is trained to do a specific task, eg, bird classification, it cannot easily be …

[图书][B] Lifelong machine learning

Z Chen, B Liu - 2022 - books.google.com
Lifelong Machine Learning, Second Edition is an introduction to an advanced machine
learning paradigm that continuously learns by accumulating past knowledge that it then …

Replay in deep learning: Current approaches and missing biological elements

TL Hayes, GP Krishnan, M Bazhenov… - Neural …, 2021 - ieeexplore.ieee.org
Replay is the reactivation of one or more neural patterns that are similar to the activation
patterns experienced during past waking experiences. Replay was first observed in …