A comprehensive survey of continual learning: theory, method and application

L Wang, X Zhang, H Su, J Zhu - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …

A comprehensive survey of forgetting in deep learning beyond continual learning

Z Wang, E Yang, L Shen, H Huang - arXiv preprint arXiv:2307.09218, 2023 - arxiv.org
Forgetting refers to the loss or deterioration of previously acquired information or knowledge.
While the existing surveys on forgetting have primarily focused on continual learning …

Self-Expansion of Pre-trained Models with Mixture of Adapters for Continual Learning

H Wang, H Lu, L Yao, D Gong - arXiv preprint arXiv:2403.18886, 2024 - arxiv.org
Continual learning aims to learn from a stream of continuously arriving data with minimum
forgetting of previously learned knowledge. While previous works have explored the …

Learning expressive priors for generalization and uncertainty estimation in neural networks

D Schnaus, J Lee, D Cremers… - … on Machine Learning, 2023 - proceedings.mlr.press
In this work, we propose a novel prior learning method for advancing generalization and
uncertainty estimation in deep neural networks. The key idea is to exploit scalable and …

Task agnostic continual learning with Pairwise layer architecture

S Keskinen - arXiv preprint arXiv:2405.13632, 2024 - arxiv.org
Most of the dominant approaches to continual learning are based on either memory replay,
parameter isolation, or regularization techniques that require task boundaries to calculate …

FETCH: A Memory-Efficient Replay Approach for Continual Learning in Image Classification

M Weißflog, P Protzel, P Neubert - International Conference on Intelligent …, 2023 - Springer
Class-incremental continual learning is an important area of research, as static deep
learning methods fail to adapt to changing tasks and data distributions. In previous works …

Mitigating Catastrophic Forgetting in Online Continual Learning by Modeling Previous Task Interrelations via Pareto Optimization

Y Wu, H Wang, P Zhao, Y Zheng, Y Wei… - Forty-first International … - openreview.net
Catastrophic forgetting remains a core challenge in continual learning (CL), where the
models struggle to retain previous knowledge when learning new tasks. While existing …

Stream: A Generalized Continual Learning Benchmark and Baseline

I Fostiropoulos, J Zhu, L Itti - openreview.net
In a typical Continual Learning (CL) setting, the goal is to learn a sequence of tasks that are
presented once while maintaining performance on all previously learned tasks. Current state …

Towards Robust and Generalizable Machine Learning for Real-World Healthcare Data with Heterogeneity

Z Huo - 2022 - search.proquest.com
The utility of machine learning for enhancing human well-being and health has risen to the
core discussion in both research and real-world application in today's technological front …