Self-supervised training enhances online continual learning

J Gallardo, TL Hayes, C Kanan - arXiv preprint arXiv:2103.14010, 2021 - arxiv.org
In continual learning, a system must incrementally learn from a non-stationary data stream
without catastrophic forgetting. Recently, multiple methods have been devised for …

Online continual learning under extreme memory constraints

E Fini, S Lathuiliere, E Sangineto, M Nabi… - Computer Vision–ECCV …, 2020 - Springer
Continual Learning (CL) aims to develop agents emulating the human ability to sequentially
learn new tasks while being able to retain knowledge obtained from past experiences. In this …

Continual learning with lifelong vision transformer

Z Wang, L Liu, Y Duan, Y Kong… - Proceedings of the IEEE …, 2022 - openaccess.thecvf.com
Continual learning methods aim at training a neural network from sequential data with
streaming labels, relieving catastrophic forgetting. However, existing methods are based on …

A simple baseline that questions the use of pretrained-models in continual learning

P Janson, W Zhang, R Aljundi, M Elhoseiny - arXiv preprint arXiv …, 2022 - arxiv.org
With the success of pretraining techniques in representation learning, a number of continual
learning methods based on pretrained models have been proposed. Some of these …

Linear mode connectivity in multitask and continual learning

SI Mirzadeh, M Farajtabar, D Gorur, R Pascanu… - arXiv preprint arXiv …, 2020 - arxiv.org
Continual (sequential) training and multitask (simultaneous) training are often attempting to
solve the same overall objective: to find a solution that performs well on all considered tasks …

Introducing language guidance in prompt-based continual learning

MGZA Khan, MF Naeem, L Van Gool… - Proceedings of the …, 2023 - openaccess.thecvf.com
Continual Learning aims to learn a single model on a sequence of tasks without having
access to data from previous tasks. The biggest challenge in the domain still remains …

Probing representation forgetting in supervised and unsupervised continual learning

MR Davari, N Asadi, S Mudur… - Proceedings of the …, 2022 - openaccess.thecvf.com
Continual Learning (CL) research typically focuses on tackling the phenomenon of
catastrophic forgetting in neural networks. Catastrophic forgetting is associated with an …

Online continual learning in image classification: An empirical survey

Z Mai, R Li, J Jeong, D Quispe, H Kim, S Sanner - Neurocomputing, 2022 - Elsevier
Online continual learning for image classification studies the problem of learning to classify
images from an online stream of data and tasks, where tasks may include new classes …

Ranpac: Random projections and pre-trained models for continual learning

MD McDonnell, D Gong, A Parvaneh… - Advances in …, 2024 - proceedings.neurips.cc
Continual learning (CL) aims to incrementally learn different tasks (such as classification) in
a non-stationary data stream without forgetting old ones. Most CL works focus on tackling …

Continual learning: Applications and the road forward

E Verwimp, S Ben-David, M Bethge, A Cossu… - arXiv preprint arXiv …, 2023 - arxiv.org
Continual learning is a sub-field of machine learning, which aims to allow machine learning
models to continuously learn on new data, by accumulating knowledge without forgetting …