A comprehensive survey of continual learning: theory, method and application

L Wang, X Zhang, H Su, J Zhu - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …

Deep class-incremental learning: A survey

DW Zhou, QW Wang, ZH Qi, HJ Ye, DC Zhan… - arXiv preprint arXiv …, 2023 - arxiv.org
Deep models, eg, CNNs and Vision Transformers, have achieved impressive achievements
in many vision tasks in the closed world. However, novel classes emerge from time to time in …

Class-incremental learning: A survey

DW Zhou, QW Wang, ZH Qi, HJ Ye… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Deep models, eg, CNNs and Vision Transformers, have achieved impressive achievements
in many vision tasks in the closed world. However, novel classes emerge from time to time in …

Modular deep learning

J Pfeiffer, S Ruder, I Vulić, EM Ponti - arXiv preprint arXiv:2302.11529, 2023 - arxiv.org
Transfer learning has recently become the dominant paradigm of machine learning. Pre-
trained models fine-tuned for downstream tasks achieve better performance with fewer …

Machine learning for service migration: a survey

N Toumi, M Bagaa, A Ksentini - IEEE Communications Surveys …, 2023 - ieeexplore.ieee.org
Future communication networks are envisioned to satisfy increasingly granular and dynamic
requirements to accommodate the application and user demands. Indeed, novel immersive …

A model or 603 exemplars: Towards memory-efficient class-incremental learning

DW Zhou, QW Wang, HJ Ye, DC Zhan - arXiv preprint arXiv:2205.13218, 2022 - arxiv.org
Real-world applications require the classification model to adapt to new classes without
forgetting old ones. Correspondingly, Class-Incremental Learning (CIL) aims to train a …

New insights on reducing abrupt representation change in online continual learning

L Caccia, R Aljundi, N Asadi, T Tuytelaars… - arXiv preprint arXiv …, 2021 - arxiv.org
In the online continual learning paradigm, agents must learn from a changing distribution
while respecting memory and compute constraints. Experience Replay (ER), where a small …

Learnability and algorithm for continual learning

G Kim, C Xiao, T Konishi, B Liu - … Conference on Machine …, 2023 - proceedings.mlr.press
This paper studies the challenging continual learning (CL) setting of Class Incremental
Learning (CIL). CIL learns a sequence of tasks consisting of disjoint sets of concepts or …

Combining parameter-efficient modules for task-level generalisation

EM Ponti, A Sordoni, Y Bengio… - Proceedings of the 17th …, 2023 - aclanthology.org
A modular design encourages neural models to disentangle and recombine different facets
of knowledge to generalise more systematically to new tasks. In this work, we assume that …

Dynamically expandable graph convolution for streaming recommendation

B He, X He, Y Zhang, R Tang, C Ma - … of the ACM Web Conference 2023, 2023 - dl.acm.org
Personalized recommender systems have been widely studied and deployed to reduce
information overload and satisfy users' diverse needs. However, conventional …