A comprehensive survey of continual learning: theory, method and application

L Wang, X Zhang, H Su, J Zhu - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …

Continual learning of natural language processing tasks: A survey

Z Ke, B Liu - arXiv preprint arXiv:2211.12701, 2022 - arxiv.org
Continual learning (CL) is a learning paradigm that emulates the human capability of
learning and accumulating knowledge continually without forgetting the previously learned …

Recent advances of foundation language models-based continual learning: A survey

Y Yang, J Zhou, X Ding, T Huai, S Liu, Q Chen… - ACM Computing …, 2024 - dl.acm.org
Recently, foundation language models (LMs) have marked significant achievements in the
domains of natural language processing (NLP) and computer vision (CV). Unlike traditional …

Class-incremental learning based on label generation

Y Shao, Y Guo, D Zhao, B Liu - arXiv preprint arXiv:2306.12619, 2023 - arxiv.org
Despite the great success of pre-trained language models, it is still a challenge to use these
models for continual learning, especially for the class-incremental learning (CIL) setting due …

Low-shot learning and class imbalance: a survey

P Billion Polak, JD Prusa, TM Khoshgoftaar - Journal of Big Data, 2024 - Springer
The tasks of few-shot, one-shot, and zero-shot learning—or collectively “low-shot
learning”(LSL)—at first glance are quite similar to the long-standing task of class imbalanced …

Class incremental learning via likelihood ratio based task prediction

H Lin, Y Shao, W Qian, N Pan, Y Guo, B Liu - arXiv preprint arXiv …, 2023 - arxiv.org
Class incremental learning (CIL) is a challenging setting of continual learning, which learns
a series of tasks sequentially. Each task consists of a set of unique classes. The key feature …

Boosting Large Language Models with Continual Learning for Aspect-based Sentiment Analysis

X Ding, J Zhou, L Dou, Q Chen, Y Wu, C Chen… - arXiv preprint arXiv …, 2024 - arxiv.org
Aspect-based sentiment analysis (ABSA) is an important subtask of sentiment analysis,
which aims to extract the aspects and predict their sentiments. Most existing studies focus on …

Never-Ending Embodied Robot Learning

W Liang, G Sun, Q He, Y Ren, J Dong… - arXiv preprint arXiv …, 2024 - arxiv.org
Relying on large language models (LLMs), embodied robots could perform complex
multimodal robot manipulation tasks from visual observations with powerful generalization …

Towards Lifelong Learning of Large Language Models: A Survey

J Zheng, S Qiu, C Shi, Q Ma - arXiv preprint arXiv:2406.06391, 2024 - arxiv.org
As the applications of large language models (LLMs) expand across diverse fields, the
ability of these models to adapt to ongoing changes in data, tasks, and user preferences …

CSSL-MHTR: Continual Self-Supervised Learning for Scalable Multi-script Handwritten Text Recognition

M Dhiaf, MA Souibgui, K Wang, Y Liu… - arXiv preprint arXiv …, 2023 - arxiv.org
Self-supervised learning has recently emerged as a strong alternative in document analysis.
These approaches are now capable of learning high-quality image representations and …