Online continual learning through mutual information maximization

Y Guo, B Liu, D Zhao - International conference on machine …, 2022 - proceedings.mlr.press
This paper proposed a new online continual learning approach called OCM based on
mutual information (MI) maximization. It achieves two objectives that are critical in dealing …

Adversarial continual learning for multi-domain hippocampal segmentation

M Memmel, C Gonzalez, A Mukhopadhyay - Domain Adaptation and …, 2021 - Springer
Deep learning for medical imaging suffers from temporal and privacy-related restrictions on
data availability. To still obtain viable models, continual learning aims to train in sequential …

Self-attention meta-learner for continual learning

G Sokar, DC Mocanu, M Pechenizkiy - arXiv preprint arXiv:2101.12136, 2021 - arxiv.org
Continual learning aims to provide intelligent agents capable of learning multiple tasks
sequentially with neural networks. One of its main challenging, catastrophic forgetting, is …

Avoiding forgetting and allowing forward transfer in continual learning via sparse networks

G Sokar, DC Mocanu, M Pechenizkiy - Joint European Conference on …, 2022 - Springer
Using task-specific components within a neural network in continual learning (CL) is a
compelling strategy to address the stability-plasticity dilemma in fixed-capacity models …

Unsupervised unlearning of concept drift with autoencoders

A Artelt, K Malialis, CG Panayiotou… - 2023 IEEE …, 2023 - ieeexplore.ieee.org
Concept drift refers to a change in the data distribution affecting the data stream of future
samples. Consequently, learning models operating on the data stream might become …

Progressive Learning With Recurrent Neural Network for Sequence Classification

RR Karn, J Knechtel… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Progressive learning is a deep learning framework in which tasks are learned sequentially,
with the capacity to leverage past knowledge from previously acquired tasks to aid in the …

Instance-level and class-level contrastive incremental learning for image classification

J Han, J Liu - 2022 International Joint Conference on Neural …, 2022 - ieeexplore.ieee.org
Recently, people pay more attention to catastrophic forgetting problem, that is, the ability of
the model to recognize old tasks decreases dramatically when new tasks are added …

Addressing the stability-plasticity dilemma via knowledge-aware continual learning

G Sokar, DC Mocanu, M Pechenizkiy - 2021 - openreview.net
Continual learning agents should incrementally learn a sequence of tasks while satisfying
two main desiderata: accumulating on previous knowledge without forgetting and …

[PDF][PDF] CNNs Sparsification and Expansion for Continual Learning.

B Tousside, J Frochte, T Meisen - ICAART (2), 2024 - scitepress.org
Learning multiple sequentially arriving tasks without forgetting previous knowledge, known
as Continual Learning (CL), remains a long-standing challenge for neural networks. Most …

[PDF][PDF] Continual Lifelong Learning for Intelligent Agents.

G Sokar - IJCAI, 2021 - ijcai.org
Deep neural networks have achieved outstanding performance in many machine learning
tasks. However, this remarkable success is achieved in closed and static environments …