A comprehensive survey of forgetting in deep learning beyond continual learning

Z Wang, E Yang, L Shen… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Forgetting refers to the loss or deterioration of previously acquired knowledge. While
existing surveys on forgetting have primarily focused on continual learning, forgetting is a …

Dualprompt: Complementary prompting for rehearsal-free continual learning

Z Wang, Z Zhang, S Ebrahimi, R Sun, H Zhang… - … on Computer Vision, 2022 - Springer
Continual learning aims to enable a single model to learn a sequence of tasks without
catastrophic forgetting. Top-performing methods usually require a rehearsal buffer to store …

Always be dreaming: A new approach for data-free class-incremental learning

J Smith, YC Hsu, J Balloch, Y Shen… - Proceedings of the …, 2021 - openaccess.thecvf.com
Modern computer vision applications suffer from catastrophic forgetting when incrementally
learning new concepts over time. The most successful approaches to alleviate this forgetting …

The clear benchmark: Continual learning on real-world imagery

Z Lin, J Shi, D Pathak, D Ramanan - Thirty-fifth conference on …, 2021 - openreview.net
Continual learning (CL) is widely regarded as crucial challenge for lifelong AI. However,
existing CL benchmarks, eg Permuted-MNIST and Split-CIFAR, make use of artificial …

Transfer without forgetting

M Boschini, L Bonicelli, A Porrello, G Bellitto… - … on Computer Vision, 2022 - Springer
This work investigates the entanglement between Continual Learning (CL) and Transfer
Learning (TL). In particular, we shed light on the widespread application of network …

AIDE: An Automatic Data Engine for Object Detection in Autonomous Driving

M Liang, JC Su, S Schulter, S Garg… - Proceedings of the …, 2024 - openaccess.thecvf.com
Autonomous vehicle (AV) systems rely on robust perception models as a cornerstone of
safety assurance. However objects encountered on the road exhibit a long-tailed distribution …

A multi-head model for continual learning via out-of-distribution replay

G Kim, B Liu, Z Ke - Conference on Lifelong Learning …, 2022 - proceedings.mlr.press
This paper studies class incremental learning (CIL) of continual learning (CL). Many
approaches have been proposed to deal with catastrophic forgetting (CF) in CIL. Most …

Meta-learning with less forgetting on large-scale non-stationary task distributions

Z Wang, L Shen, L Fang, Q Suo, D Zhan… - … on Computer Vision, 2022 - Springer
The paradigm of machine intelligence moves from purely supervised learning to a more
practical scenario when many loosely related unlabeled data are available and labeled data …

A soft nearest-neighbor framework for continual semi-supervised learning

Z Kang, E Fini, M Nabi, E Ricci… - Proceedings of the …, 2023 - openaccess.thecvf.com
Despite significant advances, the performance of state-of-the-art continual learning
approaches hinges on the unrealistic scenario of fully labeled data. In this paper, we tackle …

Beyond supervised continual learning: a review

B Bagus, A Gepperth, T Lesort - arXiv preprint arXiv:2208.14307, 2022 - arxiv.org
Continual Learning (CL, sometimes also termed incremental learning) is a flavor of machine
learning where the usual assumption of stationary data distribution is relaxed or omitted …