Deep residual learning in spiking neural networks

W Fang, Z Yu, Y Chen, T Huang… - Advances in Neural …, 2021 - proceedings.neurips.cc
Abstract Deep Spiking Neural Networks (SNNs) present optimization difficulties for gradient-
based approaches due to discrete binary activation and complex spatial-temporal dynamics …

Differentiable spike: Rethinking gradient-descent for training spiking neural networks

Y Li, Y Guo, S Zhang, S Deng… - Advances in Neural …, 2021 - proceedings.neurips.cc
Abstract Spiking Neural Networks (SNNs) have emerged as a biology-inspired method
mimicking the spiking nature of brain neurons. This bio-mimicry derives SNNs' energy …

Spikingformer: Spike-driven residual learning for transformer-based spiking neural network

C Zhou, L Yu, Z Zhou, Z Ma, H Zhang, H Zhou… - arXiv preprint arXiv …, 2023 - arxiv.org
Spiking neural networks (SNNs) offer a promising energy-efficient alternative to artificial
neural networks, due to their event-driven spiking computation. However, state-of-the-art …

Inherent redundancy in spiking neural networks

M Yao, J Hu, G Zhao, Y Wang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract Spiking Neural Networks (SNNs) are well known as a promising energy-efficient
alternative to conventional artificial neural networks. Subject to the preconceived impression …

Spiking deep residual networks

Y Hu, H Tang, G Pan - IEEE Transactions on Neural Networks …, 2021 - ieeexplore.ieee.org
Spiking neural networks (SNNs) have received significant attention for their biological
plausibility. SNNs theoretically have at least the same computational power as traditional …

Multi-level firing with spiking ds-resnet: Enabling better and deeper directly-trained spiking neural networks

L Feng, Q Liu, H Tang, D Ma, G Pan - arXiv preprint arXiv:2210.06386, 2022 - arxiv.org
Spiking neural networks (SNNs) are bio-inspired neural networks with asynchronous
discrete and sparse characteristics, which have increasingly manifested their superiority in …

[HTML][HTML] SSTDP: Supervised spike timing dependent plasticity for efficient spiking neural network training

F Liu, W Zhao, Y Chen, Z Wang, T Yang… - Frontiers in …, 2021 - frontiersin.org
Spiking Neural Networks (SNNs) are a pathway that could potentially empower low-power
event-driven neuromorphic hardware due to their spatio-temporal information processing …

Going deeper with directly-trained larger spiking neural networks

H Zheng, Y Wu, L Deng, Y Hu, G Li - … of the AAAI conference on artificial …, 2021 - ojs.aaai.org
Spiking neural networks (SNNs) are promising in a bio-plausible coding for spatio-temporal
information and event-driven signal processing, which is very suited for energy-efficient …

Optimal ann-snn conversion for fast and accurate inference in deep spiking neural networks

J Ding, Z Yu, Y Tian, T Huang - arXiv preprint arXiv:2105.11654, 2021 - arxiv.org
Spiking Neural Networks (SNNs), as bio-inspired energy-efficient neural networks, have
attracted great attentions from researchers and industry. The most efficient way to train deep …

Glif: A unified gated leaky integrate-and-fire neuron for spiking neural networks

X Yao, F Li, Z Mo, J Cheng - Advances in Neural …, 2022 - proceedings.neurips.cc
Abstract Spiking Neural Networks (SNNs) have been studied over decades to incorporate
their biological plausibility and leverage their promising energy efficiency. Throughout …