Few-shot class-incremental learning: A survey

J Zhang, L Liu, O Silven, M Pietikäinen… - arXiv preprint arXiv …, 2023 - arxiv.org
Few-shot Class-Incremental Learning (FSCIL) presents a unique challenge in machine
learning, as it necessitates the continuous learning of new classes from sparse labeled …

DELTA: Decoupling Long-Tailed Online Continual Learning

S Raghavan, J He, F Zhu - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
A significant challenge in achieving ubiquitous Artificial Intelligence is the limited ability of
models to rapidly learn new information in real-world scenarios where data follows long …

Recent Advances of Foundation Language Models-based Continual Learning: A Survey

Y Yang, J Zhou, X Ding, T Huai, S Liu, Q Chen… - arXiv preprint arXiv …, 2024 - arxiv.org
Recently, foundation language models (LMs) have marked significant achievements in the
domains of natural language processing (NLP) and computer vision (CV). Unlike traditional …

Read Between the Layers: Leveraging Intra-Layer Representations for Rehearsal-Free Continual Learning with Pre-Trained Models

K Ahrens, HH Lehmann, JH Lee, S Wermter - arXiv preprint arXiv …, 2023 - arxiv.org
We address the Continual Learning (CL) problem, where a model has to learn a sequence
of tasks from non-stationary distributions while preserving prior knowledge as it encounters …

Online Continual Learning via Logit Adjusted Softmax

Z Huang, T Li, C Yuan, Y Wu, X Huang - arXiv preprint arXiv:2311.06460, 2023 - arxiv.org
Online continual learning is a challenging problem where models must learn from a non-
stationary data stream while avoiding catastrophic forgetting. Inter-class imbalance during …

Relational Experience Replay: Continual Learning by Adaptively Tuning Task-wise Relationship

Q Wang, R Wang, Y Li, D Wei, H Wang… - IEEE Transactions …, 2024 - ieeexplore.ieee.org
Continual learning is a promising machine learning paradigm to learn new tasks while
retaining previously learned knowledge over streaming training data. Till now, rehearsal …

Mitigating Catastrophic Forgetting in Online Continual Learning by Modeling Previous Task Interrelations via Pareto Optimization

Y Wu, H Wang, P Zhao, Y Zheng, Y Wei… - Forty-first International … - openreview.net
Catastrophic forgetting remains a core challenge in continual learning (CL), where the
models struggle to retain previous knowledge when learning new tasks. While existing …

Learning Representations for Continual Learning Based on Information Bottleneck and Metric Loss

R Li - 2023 China Automation Congress (CAC), 2023 - ieeexplore.ieee.org
Continual learning, also known as lifelong learning, addresses the fundamental challenge of
enabling machine learning models to learn from a continuous stream of data and adapt their …

Enhanced Gradient Aligned Continual Learning via Pareto Optimization

Y Wu, H Wang, LK Huang, Y Zheng, P Zhao, Y Wei - openreview.net
Catastrophic forgetting remains a core challenge in continual learning (CL), whereby the
models struggle to retain previous knowledge when learning new tasks. While existing …