Continual learning of large language models: A comprehensive survey

H Shi, Z Xu, H Wang, W Qin, W Wang, Y Wang… - arXiv preprint arXiv …, 2024 - arxiv.org
The recent success of large language models (LLMs) trained on static, pre-collected,
general datasets has sparked numerous research directions and applications. One such …

Trends and challenges of real-time learning in large language models: A critical review

M Jovanovic, P Voss - arXiv preprint arXiv:2404.18311, 2024 - arxiv.org
Real-time learning concerns the ability of learning systems to acquire knowledge over time,
enabling their adaptation and generalization to novel tasks. It is a critical ability for …

CLoG: Benchmarking Continual Learning of Image Generation Models

H Zhang, J Zhou, H Lin, H Ye, J Zhu, Z Wang… - arXiv preprint arXiv …, 2024 - arxiv.org
Continual Learning (CL) poses a significant challenge in Artificial Intelligence, aiming to
mirror the human ability to incrementally acquire knowledge and skills. While extensive …

Recent Advances of Foundation Language Models-based Continual Learning: A Survey

Y Yang, J Zhou, X Ding, T Huai, S Liu, Q Chen… - arXiv preprint arXiv …, 2024 - arxiv.org
Recently, foundation language models (LMs) have marked significant achievements in the
domains of natural language processing (NLP) and computer vision (CV). Unlike traditional …

[PDF][PDF] Towards Incremental Learning in Large Language Models: A Critical Review

M Jovanović - 2024 - researchgate.net
Incremental learning is the ability of systems to acquire knowledge over time, enabling their
adaptation and generalization to novel tasks. It is a critical ability for intelligent, real-world …