A comprehensive survey of continual learning: theory, method and application

L Wang, X Zhang, H Su, J Zhu - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …

Hierarchical decomposition of prompt-based continual learning: Rethinking obscured sub-optimality

L Wang, J Xie, X Zhang, M Huang… - Advances in Neural …, 2024 - proceedings.neurips.cc
Prompt-based continual learning is an emerging direction in leveraging pre-trained
knowledge for downstream continual learning, and has almost reached the performance …

Ranpac: Random projections and pre-trained models for continual learning

MD McDonnell, D Gong, A Parvaneh… - Advances in …, 2024 - proceedings.neurips.cc
Continual learning (CL) aims to incrementally learn different tasks (such as classification) in
a non-stationary data stream without forgetting old ones. Most CL works focus on tackling …

Ctp: Towards vision-language continual pretraining via compatible momentum contrast and topology preservation

H Zhu, Y Wei, X Liang, C Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Vision-Language Pretraining (VLP) has shown impressive results on diverse
downstream tasks by offline training on large-scale datasets. Regarding the growing nature …

Rethinking the up-sampling operations in cnn-based generative network for generalizable deepfake detection

C Tan, Y Zhao, S Wei, G Gu, P Liu… - Proceedings of the …, 2024 - openaccess.thecvf.com
Recently the proliferation of highly realistic synthetic images facilitated through a variety of
GANs and Diffusions has significantly heightened the susceptibility to misuse. While the …

Coinseg: Contrast inter-and intra-class representations for incremental segmentation

Z Zhang, G Gao, J Jiao, CH Liu… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Class incremental semantic segmentation aims to strike a balance between the model's
stability and plasticity by maintaining old knowledge while adapting to new concepts …

Generative Multi-modal Models are Good Class Incremental Learners

X Cao, H Lu, L Huang, X Liu… - Proceedings of the …, 2024 - openaccess.thecvf.com
In class incremental learning (CIL) scenarios the phenomenon of catastrophic forgetting
caused by the classifier's bias towards the current task has long posed a significant …

Expandable subspace ensemble for pre-trained model-based class-incremental learning

DW Zhou, HL Sun, HJ Ye… - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Abstract Class-Incremental Learning (CIL) requires a learning system to continually learn
new classes without forgetting. Despite the strong performance of Pre-Trained Models …

Forgery-aware adaptive transformer for generalizable synthetic image detection

H Liu, Z Tan, C Tan, Y Wei, J Wang… - Proceedings of the …, 2024 - openaccess.thecvf.com
In this paper we study the problem of generalizable synthetic image detection aiming to
detect forgery images from diverse generative methods eg GANs and diffusion models …

Continual learning with pre-trained models: A survey

DW Zhou, HL Sun, J Ning, HJ Ye, DC Zhan - arXiv preprint arXiv …, 2024 - arxiv.org
Nowadays, real-world applications often face streaming data, which requires the learning
system to absorb new knowledge as data evolves. Continual Learning (CL) aims to achieve …