A comprehensive survey of continual learning: theory, method and application

L Wang, X Zhang, H Su, J Zhu - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …

Continual learning: Applications and the road forward

E Verwimp, S Ben-David, M Bethge, A Cossu… - arXiv preprint arXiv …, 2023 - arxiv.org
Continual learning is a sub-field of machine learning, which aims to allow machine learning
models to continuously learn on new data, by accumulating knowledge without forgetting …

Re-evaluating continual learning scenarios: A categorization and case for strong baselines

YC Hsu, YC Liu, A Ramasamy, Z Kira - arXiv preprint arXiv:1810.12488, 2018 - arxiv.org
Continual learning has received a great deal of attention recently with several approaches
being proposed. However, evaluations involve a diverse set of scenarios making meaningful …

Continual learning in neural networks

R Aljundi - arXiv preprint arXiv:1910.02718, 2019 - arxiv.org
Artificial neural networks have exceeded human-level performance in accomplishing
several individual tasks (eg voice recognition, object recognition, and video games) …

Continual learning by using information of each class holistically

W Hu, Q Qin, M Wang, J Ma, B Liu - … of the AAAI Conference on Artificial …, 2021 - ojs.aaai.org
Continual learning (CL) incrementally learns a sequence of tasks while solving the
catastrophic forgetting (CF) problem. Existing methods mainly try to deal with CF directly. In …

The ideal continual learner: An agent that never forgets

L Peng, P Giampouras, R Vidal - … Conference on Machine …, 2023 - proceedings.mlr.press
The goal of continual learning is to find a model that solves multiple learning tasks which are
presented sequentially to the learner. A key challenge in this setting is that the learner may" …

Towards robust evaluations of continual learning

S Farquhar, Y Gal - arXiv preprint arXiv:1805.09733, 2018 - arxiv.org
Experiments used in current continual learning research do not faithfully assess
fundamental challenges of learning continually. Instead of assessing performance on …

A theoretical study on solving continual learning

G Kim, C Xiao, T Konishi, Z Ke… - Advances in neural …, 2022 - proceedings.neurips.cc
Continual learning (CL) learns a sequence of tasks incrementally. There are two popular CL
settings, class incremental learning (CIL) and task incremental learning (TIL). A major …

Architecture matters in continual learning

SI Mirzadeh, A Chaudhry, D Yin, T Nguyen… - arXiv preprint arXiv …, 2022 - arxiv.org
A large body of research in continual learning is devoted to overcoming the catastrophic
forgetting of neural networks by designing new algorithms that are robust to the distribution …

[PDF][PDF] Continual learning: A comparative study on how to defy forgetting in classification tasks

M De Lange, R Aljundi, M Masana… - arXiv preprint arXiv …, 2019 - homes.esat.kuleuven.be
Artificial neural networks thrive in solving the classification problem for a particular rigid task,
where the network resembles a static entity of knowledge, acquired through generalized …