A comprehensive survey of continual learning: theory, method and application

L Wang, X Zhang, H Su, J Zhu - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …

Recent advances of continual learning in computer vision: An overview

H Qu, H Rahmani, L Xu, B Williams, J Liu - arXiv preprint arXiv …, 2021 - arxiv.org
In contrast to batch learning where all training data is available at once, continual learning
represents a family of methods that accumulate knowledge and learn continuously with data …

Incorporating neuro-inspired adaptability for continual learning in artificial intelligence

L Wang, X Zhang, Q Li, M Zhang, H Su, J Zhu… - Nature Machine …, 2023 - nature.com
Continual learning aims to empower artificial intelligence with strong adaptability to the real
world. For this purpose, a desirable solution should properly balance memory stability with …

Class-incremental continual learning into the extended der-verse

M Boschini, L Bonicelli, P Buzzega… - IEEE transactions on …, 2022 - ieeexplore.ieee.org
The staple of human intelligence is the capability of acquiring knowledge in a continuous
fashion. In stark contrast, Deep Networks forget catastrophically and, for this reason, the sub …

Gcr: Gradient coreset based replay buffer selection for continual learning

R Tiwari, K Killamsetty, R Iyer… - Proceedings of the …, 2022 - openaccess.thecvf.com
Continual learning (CL) aims to develop techniques by which a single model adapts to an
increasing number of tasks encountered sequentially, thereby potentially leveraging …

Preservation of the global knowledge by not-true distillation in federated learning

G Lee, M Jeong, Y Shin, S Bae… - Advances in Neural …, 2022 - proceedings.neurips.cc
In federated learning, a strong global model is collaboratively learned by aggregating
clients' locally trained models. Although this precludes the need to access clients' data …

Ddgr: Continual learning with deep diffusion-based generative replay

R Gao, W Liu - International Conference on Machine …, 2023 - proceedings.mlr.press
Popular deep-learning models in the field of image classification suffer from catastrophic
forgetting—models will forget previously acquired skills when learning new ones …

Flattening sharpness for dynamic gradient projection memory benefits continual learning

D Deng, G Chen, J Hao, Q Wang… - Advances in Neural …, 2021 - proceedings.neurips.cc
The backpropagation networks are notably susceptible to catastrophic forgetting, where
networks tend to forget previously learned skills upon learning new ones. To address such …

Cross-domain ensemble distillation for domain generalization

K Lee, S Kim, S Kwak - European Conference on Computer Vision, 2022 - Springer
Abstract Domain generalization is the task of learning models that generalize to unseen
target domains. We propose a simple yet effective method for domain generalization, named …

Data augmented flatness-aware gradient projection for continual learning

E Yang, L Shen, Z Wang, S Liu… - Proceedings of the …, 2023 - openaccess.thecvf.com
The goal of continual learning (CL) is to continuously learn new tasks without forgetting
previously learned old tasks. To alleviate catastrophic forgetting, gradient projection based …