Replay in deep learning: Current approaches and missing biological elements

TL Hayes, GP Krishnan, M Bazhenov… - Neural …, 2021 - ieeexplore.ieee.org
Replay is the reactivation of one or more neural patterns that are similar to the activation
patterns experienced during past waking experiences. Replay was first observed in …

[HTML][HTML] A survey on few-shot class-incremental learning

S Tian, L Li, W Li, H Ran, X Ning, P Tiwari - Neural Networks, 2024 - Elsevier
Large deep learning models are impressive, but they struggle when real-time data is not
available. Few-shot class-incremental learning (FSCIL) poses a significant challenge for …

Three types of incremental learning

GM Van de Ven, T Tuytelaars, AS Tolias - Nature Machine Intelligence, 2022 - nature.com
Incrementally learning new information from a non-stationary stream of data, referred to as
'continual learning', is a key feature of natural intelligence, but a challenging problem for …

Class-incremental learning: survey and performance evaluation on image classification

M Masana, X Liu, B Twardowski… - … on Pattern Analysis …, 2022 - ieeexplore.ieee.org
For future learning systems, incremental learning is desirable because it allows for: efficient
resource usage by eliminating the need to retrain from scratch at the arrival of new data; …

Deep class-incremental learning: A survey

DW Zhou, QW Wang, ZH Qi, HJ Ye, DC Zhan… - arXiv preprint arXiv …, 2023 - arxiv.org
Deep models, eg, CNNs and Vision Transformers, have achieved impressive achievements
in many vision tasks in the closed world. However, novel classes emerge from time to time in …

Preventing zero-shot transfer degradation in continual learning of vision-language models

Z Zheng, M Ma, K Wang, Z Qin… - Proceedings of the …, 2023 - openaccess.thecvf.com
Continual learning (CL) can help pre-trained vision-language models efficiently adapt to
new or under-trained data distributions without re-training. Nevertheless, during the …

Ss-il: Separated softmax for incremental learning

H Ahn, J Kwak, S Lim, H Bang… - Proceedings of the …, 2021 - openaccess.thecvf.com
We consider class incremental learning (CIL) problem, in which a learning agent
continuously learns new classes from incrementally arriving training data batches and aims …

Fetril: Feature translation for exemplar-free class-incremental learning

G Petit, A Popescu, H Schindler… - Proceedings of the …, 2023 - openaccess.thecvf.com
Exemplar-free class-incremental learning is very challenging due to the negative effect of
catastrophic forgetting. A balance between stability and plasticity of the incremental process …

Continual learning of natural language processing tasks: A survey

Z Ke, B Liu - arXiv preprint arXiv:2211.12701, 2022 - arxiv.org
Continual learning (CL) is a learning paradigm that emulates the human capability of
learning and accumulating knowledge continually without forgetting the previously learned …

Continual object detection: a review of definitions, strategies, and challenges

AG Menezes, G de Moura, C Alves, AC de Carvalho - Neural networks, 2023 - Elsevier
Abstract The field of Continual Learning investigates the ability to learn consecutive tasks
without losing performance on those previously learned. The efforts of researchers have …