On efficient training of large-scale deep learning models: A literature review

L Shen, Y Sun, Z Yu, L Ding, X Tian, D Tao - arXiv preprint arXiv …, 2023 - arxiv.org
The field of deep learning has witnessed significant progress, particularly in computer vision
(CV), natural language processing (NLP), and speech. The use of large-scale models …

A comprehensive empirical evaluation on online continual learning

A Soutif-Cormerais, A Carta, A Cossu… - Proceedings of the …, 2023 - openaccess.thecvf.com
Online continual learning aims to get closer to a live learning experience by learning directly
on a stream of data with temporally shifting distribution and by storing a minimum amount of …

Calibration of Continual Learning Models

L Li, E Piccoli, A Cossu, D Bacciu… - Proceedings of the …, 2024 - openaccess.thecvf.com
Continual Learning (CL) focuses on maximizing the predictive performance of a model
across a non-stationary stream of data. Unfortunately CL models tend to forget previous …

Two-stage fine-grained image classification model based on multi-granularity feature fusion

Y Xu, S Wu, B Wang, M Yang, Z Wu, Y Yao, Z Wei - Pattern Recognition, 2024 - Elsevier
Fine-grained visual classification (FGVC) is a difficult task due to the challenges of
discriminative feature learning. Most existing methods directly use the final output of the …

A comprehensive empirical evaluation on online continual learning

A Carta, A Cossu, J Hurtado, H Hemati… - arXiv preprint arXiv …, 2023 - arxiv.org
Online continual learning aims to get closer to a live learning experience by learning directly
on a stream of data with temporally shifting distribution and by storing a minimum amount of …

[HTML][HTML] Drifting explanations in continual learning

A Cossu, F Spinnato, R Guidotti, D Bacciu - Neurocomputing, 2024 - Elsevier
Continual Learning (CL) trains models on streams of data, with the aim of learning new
information without forgetting previous knowledge. However, many of these models lack …

Continual Learning in the Presence of Repetition

H Hemati, L Pellegrini, X Duan, Z Zhao, F Xia… - arXiv preprint arXiv …, 2024 - arxiv.org
Continual learning (CL) provides a framework for training models in ever-evolving
environments. Although re-occurrence of previously seen objects or tasks is common in real …

An Ultra-Low Power Wearable BMI System with Continual Learning Capabilities

L Mei, TM Ingolfsson, C Cioflan… - … Circuits and Systems, 2024 - ieeexplore.ieee.org
Driven by the progress in efficient embedded processing, there is an accelerating trend
toward running machine learning models directly on wearable Brain-Machine Interfaces …

Layerwise Proximal Replay: A Proximal Point Method for Online Continual Learning

J Yoo, Y Liu, F Wood, G Pleiss - arXiv preprint arXiv:2402.09542, 2024 - arxiv.org
In online continual learning, a neural network incrementally learns from a non-iid data
stream. Nearly all online continual learning methods employ experience replay to …

Continual Learning by Three-Phase Consolidation

D Maltoni, L Pellegrini - arXiv preprint arXiv:2403.14679, 2024 - arxiv.org
TPC (Three-Phase Consolidation) is here introduced as a simple but effective approach to
continually learn new classes (and/or instances of known classes) while controlling …