A comprehensive survey of continual learning: theory, method and application

L Wang, X Zhang, H Su, J Zhu - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …

Continual object detection: a review of definitions, strategies, and challenges

AG Menezes, G de Moura, C Alves, AC de Carvalho - Neural networks, 2023 - Elsevier
Abstract The field of Continual Learning investigates the ability to learn consecutive tasks
without losing performance on those previously learned. The efforts of researchers have …

Co2l: Contrastive continual learning

H Cha, J Lee, J Shin - Proceedings of the IEEE/CVF …, 2021 - openaccess.thecvf.com
Recent breakthroughs in self-supervised learning show that such algorithms learn visual
representations that can be transferred better to unseen tasks than cross-entropy based …

Online prototype learning for online continual learning

Y Wei, J Ye, Z Huang, J Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Online continual learning (CL) studies the problem of learning continuously from a single-
pass data stream while adapting to new data and mitigating catastrophic forgetting …

On the importance and applicability of pre-training for federated learning

HY Chen, CH Tu, Z Li, HW Shen, WL Chao - arXiv preprint arXiv …, 2022 - arxiv.org
Pre-training is prevalent in nowadays deep learning to improve the learned model's
performance. However, in the literature on federated learning (FL), neural networks are …

Self-supervision can be a good few-shot learner

Y Lu, L Wen, J Liu, Y Liu, X Tian - European conference on computer …, 2022 - Springer
Existing few-shot learning (FSL) methods rely on training with a large labeled dataset, which
prevents them from leveraging abundant unlabeled data. From an information-theoretic …

Clad: A realistic continual learning benchmark for autonomous driving

E Verwimp, K Yang, S Parisot, L Hong, S McDonagh… - Neural Networks, 2023 - Elsevier
In this paper we describe the design and the ideas motivating a new Continual Learning
benchmark for Autonomous Driving (CLAD), that focuses on the problems of object …

Online continual learning for embedded devices

TL Hayes, C Kanan - arXiv preprint arXiv:2203.10681, 2022 - arxiv.org
Real-time on-device continual learning is needed for new applications such as home robots,
user personalization on smartphones, and augmented/virtual reality headsets. However, this …

Plasticity-optimized complementary networks for unsupervised continual learning

A Gomez-Villa, B Twardowski… - Proceedings of the …, 2024 - openaccess.thecvf.com
Continuous unsupervised representation learning (CURL) research has greatly benefited
from improvements in self-supervised learning (SSL) techniques. As a result, existing CURL …

A unified approach to domain incremental learning with memory: Theory and algorithm

H Shi, H Wang - Advances in Neural Information Processing …, 2024 - proceedings.neurips.cc
Abstract Domain incremental learning aims to adapt to a sequence of domains with access
to only a small subset of data (ie, memory) from previous domains. Various methods have …