A collective AI via lifelong learning and sharing at the edge

A Soltoggio, E Ben-Iwhiwhu, V Braverman… - Nature Machine …, 2024 - nature.com
One vision of a future artificial intelligence (AI) is where many separate units can learn
independently over a lifetime and share their knowledge with each other. The synergy …

Continual learning: Applications and the road forward

E Verwimp, S Ben-David, M Bethge, A Cossu… - arXiv preprint arXiv …, 2023 - arxiv.org
Continual learning is a sub-field of machine learning, which aims to allow machine learning
models to continuously learn on new data, by accumulating knowledge without forgetting …

Evolve: Enhancing unsupervised continual learning with multiple experts

X Yu, T Rosing, Y Guo - Proceedings of the IEEE/CVF winter …, 2024 - openaccess.thecvf.com
Recent years have seen significant progress in unsupervised continual learning methods.
Despite their success in controlled settings, their practicality in real-world contexts remains …

Learning Equi-angular Representations for Online Continual Learning

M Seo, H Koh, W Jeung, M Lee, S Kim… - Proceedings of the …, 2024 - openaccess.thecvf.com
Online continual learning suffers from an underfitted solution due to insufficient training for
prompt model updates (eg single-epoch training). To address the challenge we propose an …

Online distillation with continual learning for cyclic domain shifts

J Houyon, A Cioppa, Y Ghunaim… - Proceedings of the …, 2023 - openaccess.thecvf.com
In recent years, online distillation has emerged as a powerful technique for adapting real-
time deep neural networks on the fly using a slow, but accurate teacher model. However, a …

On the effectiveness of layernorm tuning for continual learning in vision transformers

T De Min, M Mancini, K Alahari… - 2023 IEEE/CVF …, 2023 - ieeexplore.ieee.org
State-of-the-art rehearsal-free continual learning methods exploit the peculiarities of Vision
Transformers to learn task-specific prompts, drastically reducing catastrophic forgetting …

Adaptive Memory Replay for Continual Learning

JS Smith, L Valkov, S Halbe, V Gutta… - Proceedings of the …, 2024 - openaccess.thecvf.com
Abstract Foundation Models (FMs) have become the hallmark of modern AI however these
models are trained on massive data leading to financially expensive training. Updating FMs …

Just Say the Name: Online Continual Learning with Category Names Only via Data Generation

M Seo, D Misra, S Cho, M Lee, J Choi - arXiv preprint arXiv:2403.10853, 2024 - arxiv.org
In real-world scenarios, extensive manual annotation for continual learning is impractical
due to prohibitive costs. Although prior arts, influenced by large-scale webly supervised …

Continual learning on a diet: Learning from sparsely labeled streams under constrained computation

W Zhang, Y Mohamed, B Ghanem, PHS Torr… - arXiv preprint arXiv …, 2024 - arxiv.org
We propose and study a realistic Continual Learning (CL) setting where learning algorithms
are granted a restricted computational budget per time step while training. We apply this …

Lifelong Continual Learning for Anomaly Detection: New Challenges, Perspectives, and Insights

K Faber, R Corizzo, B Sniezynski, N Japkowicz - IEEE Access, 2024 - ieeexplore.ieee.org
Anomaly detection is of paramount importance in many real-world domains characterized by
evolving behavior, such as monitoring cyber-physical systems, human conditions and …