Continual learning and catastrophic forgetting

Z Chen, B Liu - Lifelong Machine Learning, 2018 - Springer
In the recent years, lifelong learning (LL) has attracted a great deal of attention in the deep
learning community, where it is often called continual learning. Though it is well-known that …

Continual learning beyond a single model

T Doan, SI Mirzadeh… - Conference on Lifelong …, 2023 - proceedings.mlr.press
A growing body of research in continual learning focuses on the catastrophic forgetting
problem. While many attempts have been made to alleviate this problem, the majority of the …

Continual learning with dual regularizations

X Han, Y Guo - Machine Learning and Knowledge Discovery in …, 2021 - Springer
Continual learning (CL) has received a great amount of attention in recent years and a
multitude of continual learning approaches arose. In this paper, we propose a continual …

Three scenarios for continual learning

GM Van de Ven, AS Tolias - arXiv preprint arXiv:1904.07734, 2019 - arxiv.org
Standard artificial neural networks suffer from the well-known issue of catastrophic
forgetting, making continual or lifelong learning difficult for machine learning. In recent years …

Continual learning with adaptive weights (claw)

T Adel, H Zhao, RE Turner - arXiv preprint arXiv:1911.09514, 2019 - arxiv.org
Approaches to continual learning aim to successfully learn a set of related tasks that arrive in
an online manner. Recently, several frameworks have been developed which enable deep …

Continual learning by using information of each class holistically

W Hu, Q Qin, M Wang, J Ma, B Liu - … of the AAAI Conference on Artificial …, 2021 - ojs.aaai.org
Continual learning (CL) incrementally learns a sequence of tasks while solving the
catastrophic forgetting (CF) problem. Existing methods mainly try to deal with CF directly. In …

Helpful or harmful: Inter-task association in continual learning

H Jin, E Kim - European Conference on Computer Vision, 2022 - Springer
When optimizing sequentially incoming tasks, deep neural networks generally suffer from
catastrophic forgetting due to their lack of ability to maintain knowledge from old tasks. This …

Lifelong learning gets better with MixUp and unsupervised continual representation

P Kumar, D Toshniwal - Applied Intelligence, 2024 - Springer
Continual learning enables learning systems to adapt to evolving data distributions by
sequentially acquiring knowledge from a series of tasks. Unsupervised lifelong learning …

The ideal continual learner: An agent that never forgets

L Peng, P Giampouras, R Vidal - … Conference on Machine …, 2023 - proceedings.mlr.press
The goal of continual learning is to find a model that solves multiple learning tasks which are
presented sequentially to the learner. A key challenge in this setting is that the learner may" …

How Efficient Are Today's Continual Learning Algorithms?

MY Harun, J Gallardo, TL Hayes… - Proceedings of the …, 2023 - openaccess.thecvf.com
Supervised Continual learning involves updating a deep neural network (DNN) from an ever-
growing stream of labeled data. While most work has focused on overcoming catastrophic …