A comprehensive survey of continual learning: theory, method and application

L Wang, X Zhang, H Su, J Zhu - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …

A comprehensive survey of forgetting in deep learning beyond continual learning

Z Wang, E Yang, L Shen… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Forgetting refers to the loss or deterioration of previously acquired knowledge. While
existing surveys on forgetting have primarily focused on continual learning, forgetting is a …

Computationally budgeted continual learning: What does matter?

A Prabhu, HA Al Kader Hammoud… - Proceedings of the …, 2023 - openaccess.thecvf.com
Continual Learning (CL) aims to sequentially train models on streams of incoming data that
vary in distribution by preserving previous knowledge while adapting to new data. Current …

Real-time evaluation in online continual learning: A new hope

Y Ghunaim, A Bibi, K Alhamoud… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Current evaluations of Continual Learning (CL) methods typically assume that there
is no constraint on training time and computation. This is an unrealistic assumption for any …

Task-free continual learning via online discrepancy distance learning

F Ye, AG Bors - Advances in Neural Information Processing …, 2022 - proceedings.neurips.cc
Learning from non-stationary data streams, also called Task-Free Continual Learning
(TFCL) remains challenging due to the absence of explicit task information in most …

The ideal continual learner: An agent that never forgets

L Peng, P Giampouras, R Vidal - … Conference on Machine …, 2023 - proceedings.mlr.press
The goal of continual learning is to find a model that solves multiple learning tasks which are
presented sequentially to the learner. A key challenge in this setting is that the learner may" …

Online continual learning without the storage constraint

A Prabhu, Z Cai, P Dokania, P Torr, V Koltun… - arXiv preprint arXiv …, 2023 - arxiv.org
Traditional online continual learning (OCL) research has primarily focused on mitigating
catastrophic forgetting with fixed and limited storage allocation throughout an agent's …

On the opportunities of green computing: A survey

Y Zhou, X Lin, X Zhang, M Wang, G Jiang, H Lu… - arXiv preprint arXiv …, 2023 - arxiv.org
Artificial Intelligence (AI) has achieved significant advancements in technology and research
with the development over several decades, and is widely used in many areas including …

Lifelong robotic reinforcement learning by retaining experiences

A Xie, C Finn - Conference on Lifelong Learning Agents, 2022 - proceedings.mlr.press
Multi-task learning ideally allows embodied agents such as robots to acquire a diverse
repertoire of useful skills. However, many multi-task reinforcement learning efforts assume …

Knowledge restore and transfer for multi-label class-incremental learning

S Dong, H Luo, Y He, X Wei… - Proceedings of the …, 2023 - openaccess.thecvf.com
Current class-incremental learning research mainly focuses on single-label classification
tasks while multi-label class-incremental learning (MLCIL) with more practical application …