[PDF][PDF] Does Alignment help continual learning?

A Daram, D Kudithipudi - Proceedings of Machine …, 2024 - raw.githubusercontent.com
Backpropagation relies on instantaneous weight transport and global updates, thus
questioning its neural plausibility. Continual learning mechanisms that are largely …

Biologically plausible learning on neuromorphic hardware architectures

C Wolters, B Taylor, E Hanson, X Yang… - 2023 IEEE 66th …, 2023 - ieeexplore.ieee.org
Movement of model parameters from memory to computing elements in deep learning (DL)
has led to a growing imbalance known as the memory wall. Neuromorphic computation-in …

Scaling Laws Beyond Backpropagation

MJ Filipovich, A Cappelli, D Hesslow… - arXiv preprint arXiv …, 2022 - arxiv.org
Alternatives to backpropagation have long been studied to better understand how biological
brains may learn. Recently, they have also garnered interest as a way to train neural …

Deep Learning without Weight Symmetry

L Ji-An, MK Benna - arXiv preprint arXiv:2405.20594, 2024 - arxiv.org
Backpropagation (BP), a foundational algorithm for training artificial neural networks,
predominates in contemporary deep learning. Although highly successful, it is often …

A Burst-Dependent Algorithm for Neuromorphic On-Chip Learning of Spiking Neural Networks

M Stuck, X Wang, R Naud - bioRxiv, 2024 - biorxiv.org
The field of neuromorphic engineering addresses the high energy demands of neural
networks through brain-inspired hardware for efficient neural network computing. For on …

Random feedback alignment algorithms to train neural networks: why do they align?

D Chu, F Bacho - Machine Learning: Science and Technology, 2024 - iopscience.iop.org
Feedback alignment algorithms are an alternative to backpropagation to train neural
networks, whereby some of the partial derivatives that are required to compute the gradient …

Using deep neural networks to understand the temporal structure of human memory

L Navez - 2023 - matheo.uliege.be
This thesis explores the temporal structure of human memory through the use of deep neural
networks. The research aims to extend the study conducted by Roseboom et al. in" Activity in …