A comprehensive survey of continual learning: theory, method and application

L Wang, X Zhang, H Su, J Zhu - IEEE Transactions on Pattern …, 2024 - ieeexplore.ieee.org
To cope with real-world dynamics, an intelligent system needs to incrementally acquire,
update, accumulate, and exploit knowledge throughout its lifetime. This ability, known as …

Continual learning of natural language processing tasks: A survey

Z Ke, B Liu - arXiv preprint arXiv:2211.12701, 2022 - arxiv.org
Continual learning (CL) is a learning paradigm that emulates the human capability of
learning and accumulating knowledge continually without forgetting the previously learned …

Deep class-incremental learning: A survey

DW Zhou, QW Wang, ZH Qi, HJ Ye, DC Zhan… - arXiv preprint arXiv …, 2023 - arxiv.org
Deep models, eg, CNNs and Vision Transformers, have achieved impressive achievements
in many vision tasks in the closed world. However, novel classes emerge from time to time in …

Large language models and the reverse turing test

TJ Sejnowski - Neural computation, 2023 - direct.mit.edu
Large language models (LLMs) have been transformative. They are pretrained foundational
models that are self-supervised and can be adapted with fine-tuning to a wide range of …

Ddgr: Continual learning with deep diffusion-based generative replay

R Gao, W Liu - International Conference on Machine …, 2023 - proceedings.mlr.press
Popular deep-learning models in the field of image classification suffer from catastrophic
forgetting—models will forget previously acquired skills when learning new ones …

Continual object detection: a review of definitions, strategies, and challenges

AG Menezes, G de Moura, C Alves, AC de Carvalho - Neural networks, 2023 - Elsevier
Abstract The field of Continual Learning investigates the ability to learn consecutive tasks
without losing performance on those previously learned. The efforts of researchers have …

Online continual learning for embedded devices

TL Hayes, C Kanan - arXiv preprint arXiv:2203.10681, 2022 - arxiv.org
Real-time on-device continual learning is needed for new applications such as home robots,
user personalization on smartphones, and augmented/virtual reality headsets. However, this …

Design principles for lifelong learning AI accelerators

D Kudithipudi, A Daram, AM Zyarah, FT Zohora… - Nature …, 2023 - nature.com
Lifelong learning—an agent's ability to learn throughout its lifetime—is a hallmark of
biological learning systems and a central challenge for artificial intelligence (AI). The …

[HTML][HTML] Sleep-like unsupervised replay reduces catastrophic forgetting in artificial neural networks

T Tadros, GP Krishnan, R Ramyaa… - Nature …, 2022 - nature.com
Artificial neural networks are known to suffer from catastrophic forgetting: when learning
multiple tasks sequentially, they perform well on the most recent task at the expense of …

Self-supervised training enhances online continual learning

J Gallardo, TL Hayes, C Kanan - arXiv preprint arXiv:2103.14010, 2021 - arxiv.org
In continual learning, a system must incrementally learn from a non-stationary data stream
without catastrophic forgetting. Recently, multiple methods have been devised for …