On-Device Continual Learning With STT-Assisted-SOT MRAM Based In-Memory Computing

F Zhang, A Sridharan, W Hwang, F Xue… - … on Computer-Aided …, 2024 - ieeexplore.ieee.org
Due to the separate memory and computation units in traditional Von-Neumann architecture,
massive data transfer dominates the overall computing system's power and latency, known …

Xst: A crossbar column-wise sparse training for efficient continual learning

F Zhang, L Yang, J Meng, JS Seo… - … Design, Automation & …, 2022 - ieeexplore.ieee.org
Leveraging the ReRAM crossbar-based In-Memory-Computing (IMC) to accelerate single
task DNN inference has been widely studied. However, using the ReRAM crossbar for …

LifeLearner: Hardware-Aware Meta Continual Learning System for Embedded Computing Platforms

YD Kwon, J Chauhan, H Jia, SI Venieris… - Proceedings of the 21st …, 2023 - dl.acm.org
Continual Learning (CL) allows applications such as user personalization and household
robots to learn on the fly and adapt to context. This is an important feature when context …

AILC: Accelerate on-chip incremental learning with compute-in-memory technology

Y Luo, S Yu - IEEE Transactions on Computers, 2021 - ieeexplore.ieee.org
As AI applications become pervasive on edge device, incrementally learning new tasks is
demanded for deep neural network (DNN) models. In this article, we proposed AILC, a …

Mixed‐Precision Continual Learning Based on Computational Resistance Random Access Memory

Y Li, W Zhang, X Xu, Y He, D Dong… - Advanced Intelligent …, 2022 - Wiley Online Library
Artificial neural networks have acquired remarkable achievements in the field of artificial
intelligence. However, it suffers from catastrophic forgetting when dealing with continual …

Enabling On-device Continual Learning with Binary Neural Networks

L Vorabbi, D Maltoni, G Borghi, S Santi - arXiv preprint arXiv:2401.09916, 2024 - arxiv.org
On-device learning remains a formidable challenge, especially when dealing with resource-
constrained devices that have limited computational capabilities. This challenge is primarily …

Structured Sparse Back-propagation for Lightweight On-Device Continual Learning on Microcontroller Units

F Paissan, D Nadalini, M Rusci… - Proceedings of the …, 2024 - openaccess.thecvf.com
With many devices deployed at the extreme edge in dynamic environments the ability to
learn continually on the device is a fast-emerging trend for ultra-low-power Microcontrollers …

A tinyml platform for on-device continual learning with quantized latent replays

L Ravaglia, M Rusci, D Nadalini… - IEEE Journal on …, 2021 - ieeexplore.ieee.org
In the last few years, research and development on Deep Learning models & techniques for
ultra-low-power devices–in a word, TinyML–has mainly focused on a train-then-deploy …

REP: Resource-Efficient Prompting for On-device Continual Learning

S Jeon, X Ma, KI Kim, M Jeon - arXiv preprint arXiv:2406.04772, 2024 - arxiv.org
On-device continual learning (CL) requires the co-optimization of model accuracy and
resource efficiency to be practical. This is extremely challenging because it must preserve …

In-memory realization of in-situ few-shot continual learning with a dynamically evolving explicit memory

G Karunaratne, M Hersche… - … 2022-IEEE 48th …, 2022 - ieeexplore.ieee.org
Continually learning new classes from few training examples without forgetting previous old
classes demands a flexible architecture with an inevitably growing portion of storage, in …