Learning Equi-angular Representations for Online Continual Learning

M Seo, H Koh, W Jeung, M Lee, S Kim… - Proceedings of the …, 2024 - openaccess.thecvf.com
Online continual learning suffers from an underfitted solution due to insufficient training for
prompt model updates (eg single-epoch training). To address the challenge we propose an …

A Self-Commissioning Edge Computing Method for Data-Driven Anomaly Detection in Power Electronic Systems

PI Gómez, MEL Gajardo, N Mijatovic… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
Ensuring the reliability of power electronic converters is a matter of great importance, and
data-driven condition monitoring techniques are cementing themselves as an important tool …

Analyzing and Reducing Catastrophic Forgetting in Parameter Efficient Tuning

W Ren, X Li, L Wang, T Zhao, W Qin - arXiv preprint arXiv:2402.18865, 2024 - arxiv.org
Existing research has shown that large language models (LLMs) exhibit remarkable
performance in language understanding and generation. However, when LLMs are …

A streamlined Approach to Multimodal Few-Shot Class Incremental Learning for Fine-Grained Datasets

T Doan, S Behpour, X Li, W He, L Gou… - arXiv preprint arXiv …, 2024 - arxiv.org
Few-shot Class-Incremental Learning (FSCIL) poses the challenge of retaining prior
knowledge while learning from limited new data streams, all without overfitting. The rise of …

Theory on Mixture-of-Experts in Continual Learning

H Li, S Lin, L Duan, Y Liang, NB Shroff - arXiv preprint arXiv:2406.16437, 2024 - arxiv.org
Continual learning (CL) has garnered significant attention because of its ability to adapt to
new tasks that arrive over time. Catastrophic forgetting (of old tasks) has been identified as a …

Forward-Backward Knowledge Distillation for Continual Clustering

M Sadeghi, Z Wang, N Armanfard - arXiv preprint arXiv:2405.19234, 2024 - arxiv.org
Unsupervised Continual Learning (UCL) is a burgeoning field in machine learning, focusing
on enabling neural networks to sequentially learn tasks without explicit label information …

[PDF][PDF] Liquid Ensemble Selection for Continual Learning

C Blair, B Armstrong, K Larson - arXiv preprint arXiv:2405.07327, 2024 - assets.pubpub.org
Continual learning aims to enable machine learning models to acquire new knowledge from
a shifting data distribution without forgetting what has already been learned. Such shifting …

[PDF][PDF] Supplementary Materials for Learning Equi-angular Representations for Online Continual Learning

SCSCH Kim, J Choi - openaccess.thecvf.com
In online CL, new data continuously arrive in a stream rather than in a large chunk (eg, task
unit). Several previous works [2][5] train the model only after a large chunk of new data …