A comprehensive survey of continual learning: theory, method and application

L Wang, X Zhang, H Su, J Zhu - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …

Deep class-incremental learning: A survey

DW Zhou, QW Wang, ZH Qi, HJ Ye, DC Zhan… - arXiv preprint arXiv …, 2023 - arxiv.org
Deep models, eg, CNNs and Vision Transformers, have achieved impressive achievements
in many vision tasks in the closed world. However, novel classes emerge from time to time in …

A comprehensive survey of forgetting in deep learning beyond continual learning

Z Wang, E Yang, L Shen, H Huang - arXiv preprint arXiv:2307.09218, 2023 - arxiv.org
Forgetting refers to the loss or deterioration of previously acquired information or knowledge.
While the existing surveys on forgetting have primarily focused on continual learning …

Fetril: Feature translation for exemplar-free class-incremental learning

G Petit, A Popescu, H Schindler… - Proceedings of the …, 2023 - openaccess.thecvf.com
Exemplar-free class-incremental learning is very challenging due to the negative effect of
catastrophic forgetting. A balance between stability and plasticity of the incremental process …

Learning weather-general and weather-specific features for image restoration under multiple adverse weather conditions

Y Zhu, T Wang, X Fu, X Yang, X Guo… - Proceedings of the …, 2023 - openaccess.thecvf.com
Image restoration under multiple adverse weather conditions aims to remove weather-
related artifacts by using the single set of network parameters. In this paper, we find that …

Continual segment: Towards a single, unified and non-forgetting continual segmentation model of 143 whole-body organs in ct scans

Z Ji, D Guo, P Wang, K Yan, L Lu… - Proceedings of the …, 2023 - openaccess.thecvf.com
Deep learning empowers the mainstream medical image segmentation methods.
Nevertheless, current deep segmentation approaches are not capable of efficiently and …

Endpoints weight fusion for class incremental semantic segmentation

JW Xiao, CB Zhang, J Feng, X Liu… - Proceedings of the …, 2023 - openaccess.thecvf.com
Class incremental semantic segmentation (CISS) focuses on alleviating catastrophic
forgetting to improve discrimination. Previous work mainly exploit regularization (eg …

Fecam: Exploiting the heterogeneity of class distributions in exemplar-free continual learning

D Goswami, Y Liu, B Twardowski… - Advances in Neural …, 2024 - proceedings.neurips.cc
Exemplar-free class-incremental learning (CIL) poses several challenges since it prohibits
the rehearsal of data from previous tasks and thus suffers from catastrophic forgetting …

When prompt-based incremental learning does not meet strong pretraining

YM Tang, YX Peng, WS Zheng - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Incremental learning aims to overcome catastrophic forgetting when learning deep networks
from sequential tasks. With impressive learning efficiency and performance, prompt-based …

Tangent model composition for ensembling and continual fine-tuning

TY Liu, S Soatto - … of the IEEE/CVF International Conference …, 2023 - openaccess.thecvf.com
Abstract Tangent Model Composition (TMC) is a method to combine component models
independently fine-tuned around a pre-trained point. Component models are tangent …