Adaptive deep models for incremental learning: Considering capacity scalability and sustainability

Y Yang, DW Zhou, DC Zhan, H Xiong… - Proceedings of the 25th …, 2019 - dl.acm.org
Recent years have witnessed growing interests in developing deep models for incremental
learning. However, existing approaches often utilize the fixed structure and online …

Class-incremental learning using diffusion model for distillation and replay

Q Jodelet, X Liu, YJ Phua… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
Class-incremental learning aims to learn new classes in an incremental fashion without
forgetting the previously learned ones. Several research works have shown how additional …

On the stability-plasticity dilemma of class-incremental learning

D Kim, B Han - Proceedings of the IEEE/CVF Conference …, 2023 - openaccess.thecvf.com
A primary goal of class-incremental learning is to strike a balance between stability and
plasticity, where models should be both stable enough to retain knowledge learned from …

No one left behind: Real-world federated class-incremental learning

J Dong, H Li, Y Cong, G Sun, Y Zhang… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Federated learning (FL) is a hot collaborative training framework via aggregating model
parameters of decentralized local clients. However, most FL methods unreasonably assume …

Towards better plasticity-stability trade-off in incremental learning: A simple linear connector

G Lin, H Chu, H Lai - … of the IEEE/CVF Conference on …, 2022 - openaccess.thecvf.com
Plasticity-stability dilemma is a main problem for incremental learning, where plasticity is
referring to the ability to learn new knowledge, and stability retains the knowledge of …

Podnet: Pooled outputs distillation for small-tasks incremental learning

A Douillard, M Cord, C Ollion, T Robert… - Computer vision–ECCV …, 2020 - Springer
Lifelong learning has attracted much attention, but existing works still struggle to fight
catastrophic forgetting and accumulate knowledge over long stretches of incremental …

Continuous transfer of neural network representational similarity for incremental learning

S Tian, W Li, X Ning, H Ran, H Qin, P Tiwari - Neurocomputing, 2023 - Elsevier
The incremental learning paradigm in machine learning has consistently been a focus of
academic research. It is similar to the way in which biological systems learn, and reduces …

Generative feature replay for class-incremental learning

X Liu, C Wu, M Menta, L Herranz… - Proceedings of the …, 2020 - openaccess.thecvf.com
Humans are capable of learning new tasks without forgetting previous ones, while neural
networks fail due to catastrophic forgetting between new and previously-learned tasks. We …

Fedet: a communication-efficient federated class-incremental learning framework based on enhanced transformer

C Liu, X Qu, J Wang, J Xiao - arXiv preprint arXiv:2306.15347, 2023 - arxiv.org
Federated Learning (FL) has been widely concerned for it enables decentralized learning
while ensuring data privacy. However, most existing methods unrealistically assume that the …

DeeSIL: Deep-Shallow Incremental Learning.

E Belouadah, A Popescu - Proceedings of the European …, 2018 - openaccess.thecvf.com
Incremental Learning (IL) is an interesting AI problem when the algorithm is assumed to
work on a budget. This is especially true when IL is modeled using a deep learning …