A closer look at rehearsal-free continual learning

JS Smith, J Tian, S Halbe, YC Hsu… - Proceedings of the …, 2023 - openaccess.thecvf.com
Continual learning is a setting where machine learning models learn novel concepts from
continuously shifting training data, while simultaneously avoiding degradation of knowledge …

Continual learning by using information of each class holistically

W Hu, Q Qin, M Wang, J Ma, B Liu - … of the AAAI Conference on Artificial …, 2021 - ojs.aaai.org
Continual learning (CL) incrementally learns a sequence of tasks while solving the
catastrophic forgetting (CF) problem. Existing methods mainly try to deal with CF directly. In …

A multi-head model for continual learning via out-of-distribution replay

G Kim, B Liu, Z Ke - Conference on Lifelong Learning …, 2022 - proceedings.mlr.press
This paper studies class incremental learning (CIL) of continual learning (CL). Many
approaches have been proposed to deal with catastrophic forgetting (CF) in CIL. Most …

Meta-consolidation for continual learning

J KJ, VN Balasubramanian - Advances in Neural …, 2020 - proceedings.neurips.cc
The ability to continuously learn and adapt itself to new tasks, without losing grasp of already
acquired knowledge is a hallmark of biological learning systems, which current deep …

Retrospective adversarial replay for continual learning

L Kumari, S Wang, T Zhou… - Advances in neural …, 2022 - proceedings.neurips.cc
Continual learning is an emerging research challenge in machine learning that addresses
the problem where models quickly fit the most recently trained-on data but suffer from …

A theoretical study on solving continual learning

G Kim, C Xiao, T Konishi, Z Ke… - Advances in neural …, 2022 - proceedings.neurips.cc
Continual learning (CL) learns a sequence of tasks incrementally. There are two popular CL
settings, class incremental learning (CIL) and task incremental learning (TIL). A major …

Generative replay with feedback connections as a general strategy for continual learning

GM Van de Ven, AS Tolias - arXiv preprint arXiv:1809.10635, 2018 - arxiv.org
A major obstacle to developing artificial intelligence applications capable of true lifelong
learning is that artificial neural networks quickly or catastrophically forget previously learned …

Prototype-sample relation distillation: towards replay-free continual learning

N Asadi, MR Davari, S Mudur… - International …, 2023 - proceedings.mlr.press
In Continual learning (CL) balancing effective adaptation while combating catastrophic
forgetting is a central challenge. Many of the recent best-performing methods utilize various …

In defense of the learning without forgetting for task incremental learning

G Oren, L Wolf - Proceedings of the IEEE/CVF International …, 2021 - openaccess.thecvf.com
Catastrophic forgetting is one of the major challenges on the road for continual learning
systems, which are presented with an on-line stream of tasks. The field has attracted …

Continual learning with guarantees via weight interval constraints

M Wołczyk, K Piczak, B Wójcik… - International …, 2022 - proceedings.mlr.press
We introduce a new training paradigm that enforces interval constraints on neural network
parameter space to control forgetting. Contemporary Continual Learning (CL) methods focus …