Revisiting batch normalization for training low-latency deep spiking neural networks from scratch

Y Kim, P Panda - Frontiers in neuroscience, 2021 - frontiersin.org
Spiking Neural Networks (SNNs) have recently emerged as an alternative to deep learning
owing to sparse, asynchronous and binary event (or spike) driven processing, that can yield …

Rectified linear postsynaptic potential function for backpropagation in deep spiking neural networks

M Zhang, J Wang, J Wu, A Belatreche… - IEEE transactions on …, 2021 - ieeexplore.ieee.org
Spiking neural networks (SNNs) use spatiotemporal spike patterns to represent and transmit
information, which are not only biologically realistic but also suitable for ultralow-power …

Deep learning in spiking neural networks

A Tavanaei, M Ghodrati, SR Kheradpisheh… - Neural networks, 2019 - Elsevier
In recent years, deep learning has revolutionized the field of machine learning, for computer
vision in particular. In this approach, a deep (multilayer) artificial neural network (ANN) is …

Surrogate gradient learning in spiking neural networks: Bringing the power of gradient-based optimization to spiking neural networks

EO Neftci, H Mostafa, F Zenke - IEEE Signal Processing …, 2019 - ieeexplore.ieee.org
Spiking neural networks (SNNs) are nature's versatile solution to fault-tolerant, energy-
efficient signal processing. To translate these benefits into hardware, a growing number of …

Towards memory-and time-efficient backpropagation for training spiking neural networks

Q Meng, M Xiao, S Yan, Y Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Spiking Neural Networks (SNNs) are promising energy-efficient models for
neuromorphic computing. For training the non-differentiable SNN models, the …

Autosnn: Towards energy-efficient spiking neural networks

B Na, J Mok, S Park, D Lee, H Choe… - … on Machine Learning, 2022 - proceedings.mlr.press
Spiking neural networks (SNNs) that mimic information transmission in the brain can energy-
efficiently process spatio-temporal information through discrete and sparse spikes, thereby …

Adaptive smoothing gradient learning for spiking neural networks

Z Wang, R Jiang, S Lian, R Yan… - … on Machine Learning, 2023 - proceedings.mlr.press
Spiking neural networks (SNNs) with biologically inspired spatio-temporal dynamics
demonstrate superior energy efficiency on neuromorphic architectures. Error …

Training spiking neural networks with local tandem learning

Q Yang, J Wu, M Zhang, Y Chua… - Advances in Neural …, 2022 - proceedings.neurips.cc
Spiking neural networks (SNNs) are shown to be more biologically plausible and energy
efficient over their predecessors. However, there is a lack of an efficient and generalized …

SSTDP: Supervised spike timing dependent plasticity for efficient spiking neural network training

F Liu, W Zhao, Y Chen, Z Wang, T Yang… - Frontiers in …, 2021 - frontiersin.org
Spiking Neural Networks (SNNs) are a pathway that could potentially empower low-power
event-driven neuromorphic hardware due to their spatio-temporal information processing …

A tandem learning rule for effective training and rapid inference of deep spiking neural networks

J Wu, Y Chua, M Zhang, G Li, H Li… - IEEE Transactions on …, 2021 - ieeexplore.ieee.org
Spiking neural networks (SNNs) represent the most prominent biologically inspired
computing model for neuromorphic computing (NC) architectures. However, due to the …