A comprehensive survey of continual learning: theory, method and application

L Wang, X Zhang, H Su, J Zhu - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …

Dataset distillation: A comprehensive review

R Yu, S Liu, X Wang - IEEE Transactions on Pattern Analysis …, 2023 - ieeexplore.ieee.org
Recent success of deep learning is largely attributed to the sheer amount of data used for
training deep neural networks. Despite the unprecedented success, the massive data …

Deep class-incremental learning: A survey

DW Zhou, QW Wang, ZH Qi, HJ Ye, DC Zhan… - arXiv preprint arXiv …, 2023 - arxiv.org
Deep models, eg, CNNs and Vision Transformers, have achieved impressive achievements
in many vision tasks in the closed world. However, novel classes emerge from time to time in …

Class-incremental learning by knowledge distillation with adaptive feature consolidation

M Kang, J Park, B Han - … of the IEEE/CVF conference on …, 2022 - openaccess.thecvf.com
We present a novel class incremental learning approach based on deep neural networks,
which continually learns new tasks with limited memory for storing examples in the previous …

Dataset distillation using neural feature regression

Y Zhou, E Nezhadarya, J Ba - Advances in Neural …, 2022 - proceedings.neurips.cc
Dataset distillation aims to learn a small synthetic dataset that preserves most of the
information from the original dataset. Dataset distillation can be formulated as a bi-level …

Federated class-incremental learning

J Dong, L Wang, Z Fang, G Sun, S Xu… - Proceedings of the …, 2022 - openaccess.thecvf.com
Federated learning (FL) has attracted growing attentions via data-private collaborative
training on decentralized clients. However, most existing methods unrealistically assume …

Few-shot incremental learning with continually evolved classifiers

C Zhang, N Song, G Lin, Y Zheng… - Proceedings of the …, 2021 - openaccess.thecvf.com
Few-shot class-incremental learning (FSCIL) aims to design machine learning algorithms
that can continually learn new concepts from a few data points, without forgetting knowledge …

Self-sustaining representation expansion for non-exemplar class-incremental learning

K Zhu, W Zhai, Y Cao, J Luo… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Non-exemplar class-incremental learning is to recognize both the old and new classes
when old class samples cannot be saved. It is a challenging task since representation …

Continual detection transformer for incremental object detection

Y Liu, B Schiele, A Vedaldi… - Proceedings of the …, 2023 - openaccess.thecvf.com
Incremental object detection (IOD) aims to train an object detector in phases, each with
annotations for new object categories. As other incremental settings, IOD is subject to …

Overcoming catastrophic forgetting in incremental few-shot learning by finding flat minima

G Shi, J Chen, W Zhang, LM Zhan… - Advances in neural …, 2021 - proceedings.neurips.cc
This paper considers incremental few-shot learning, which requires a model to continually
recognize new categories with only a few examples provided. Our study shows that existing …