A comprehensive survey of forgetting in deep learning beyond continual learning

Z Wang, E Yang, L Shen… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Forgetting refers to the loss or deterioration of previously acquired knowledge. While
existing surveys on forgetting have primarily focused on continual learning, forgetting is a …

Revisiting class-incremental learning with pre-trained models: Generalizability and adaptivity are all you need

DW Zhou, ZW Cai, HJ Ye, DC Zhan, Z Liu - arXiv preprint arXiv …, 2023 - arxiv.org
Class-incremental learning (CIL) aims to adapt to emerging new classes without forgetting
old ones. Traditional CIL models are trained from scratch to continually acquire knowledge …

Online continual learning through mutual information maximization

Y Guo, B Liu, D Zhao - International conference on machine …, 2022 - proceedings.mlr.press
This paper proposed a new online continual learning approach called OCM based on
mutual information (MI) maximization. It achieves two objectives that are critical in dealing …

Class-incremental learning: A survey

DW Zhou, QW Wang, ZH Qi, HJ Ye… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Deep models, eg, CNNs and Vision Transformers, have achieved impressive achievements
in many vision tasks in the closed world. However, novel classes emerge from time to time in …

A theoretical study on solving continual learning

G Kim, C Xiao, T Konishi, Z Ke… - Advances in neural …, 2022 - proceedings.neurips.cc
Continual learning (CL) learns a sequence of tasks incrementally. There are two popular CL
settings, class incremental learning (CIL) and task incremental learning (TIL). A major …

Dealing with cross-task class discrimination in online continual learning

Y Guo, B Liu, D Zhao - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Existing continual learning (CL) research regards catastrophic forgetting (CF) as almost the
only challenge. This paper argues for another challenge in class-incremental learning (CIL) …

The ideal continual learner: An agent that never forgets

L Peng, P Giampouras, R Vidal - … Conference on Machine …, 2023 - proceedings.mlr.press
The goal of continual learning is to find a model that solves multiple learning tasks which are
presented sequentially to the learner. A key challenge in this setting is that the learner may" …

Lifelong person re-identification via knowledge refreshing and consolidation

C Yu, Y Shi, Z Liu, S Gao, J Wang - … of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
Lifelong person re-identification (LReID) is in significant demand for real-world development
as a large amount of ReID data is captured from diverse locations over time and cannot be …

Class incremental learning with less forgetting direction and equilibrium point

H Wen, H Qiu, L Wang, H Cheng… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Catastrophic forgetting is the core problem of class incremental learning (CIL). Existing work
mainly adopts memory replay, knowledge distillation, and dynamic architecture to alleviate …

Continual learning with scaled gradient projection

G Saha, K Roy - Proceedings of the AAAI Conference on Artificial …, 2023 - ojs.aaai.org
In neural networks, continual learning results in gradient interference among sequential
tasks, leading to catastrophic forgetting of old tasks while learning new ones. This issue is …