A comprehensive survey of continual learning: Theory, method and application

L Wang, X Zhang, H Su, J Zhu - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …

A comprehensive study of class incremental learning algorithms for visual tasks

E Belouadah, A Popescu, I Kanellos - Neural Networks, 2021 - Elsevier
The ability of artificial agents to increment their capabilities when confronted with new data is
an open challenge in artificial intelligence. The main challenge faced in such cases is …

Dytox: Transformers for continual learning with dynamic token expansion

A Douillard, A Ramé, G Couairon… - Proceedings of the …, 2022 - openaccess.thecvf.com
Deep network architectures struggle to continually learn new tasks without forgetting the
previous tasks. A recent trend indicates that dynamic architectures based on an expansion …

Forward compatible few-shot class-incremental learning

DW Zhou, FY Wang, HJ Ye, L Ma… - Proceedings of the …, 2022 - openaccess.thecvf.com
Novel classes frequently arise in our dynamically changing world, eg, new users in the
authentication system, and a machine learning model should recognize new classes without …

Der: Dynamically expandable representation for class incremental learning

S Yan, J Xie, X He - … of the IEEE/CVF conference on …, 2021 - openaccess.thecvf.com
We address the problem of class incremental learning, which is a core step towards
achieving adaptive vision intelligence. In particular, we consider the task setting of …

Class-incremental learning by knowledge distillation with adaptive feature consolidation

M Kang, J Park, B Han - … of the IEEE/CVF conference on …, 2022 - openaccess.thecvf.com
We present a novel class incremental learning approach based on deep neural networks,
which continually learns new tasks with limited memory for storing examples in the previous …

Prototype augmentation and self-supervision for incremental learning

F Zhu, XY Zhang, C Wang, F Yin… - Proceedings of the …, 2021 - openaccess.thecvf.com
Despite the impressive performance in many individual tasks, deep neural networks suffer
from catastrophic forgetting when learning new tasks incrementally. Recently, various …

Online continual learning in image classification: An empirical survey

Z Mai, R Li, J Jeong, D Quispe, H Kim, S Sanner - Neurocomputing, 2022 - Elsevier
Online continual learning for image classification studies the problem of learning to classify
images from an online stream of data and tasks, where tasks may include new classes …

Gdumb: A simple approach that questions our progress in continual learning

A Prabhu, PHS Torr, PK Dokania - … , Glasgow, UK, August 23–28, 2020 …, 2020 - Springer
We discuss a general formulation for the Continual Learning (CL) problem for classification—
a learning task where a stream provides samples to a learner and the goal of the learner …

Foster: Feature boosting and compression for class-incremental learning

FY Wang, DW Zhou, HJ Ye, DC Zhan - European conference on computer …, 2022 - Springer
The ability to learn new concepts continually is necessary in this ever-changing world.
However, deep neural networks suffer from catastrophic forgetting when learning new …