Spike-driven transformer

M Yao, J Hu, Z Zhou, L Yuan, Y Tian… - Advances in neural …, 2024 - proceedings.neurips.cc
Abstract Spiking Neural Networks (SNNs) provide an energy-efficient deep learning option
due to their unique spike-based event-driven (ie, spike-driven) paradigm. In this paper, we …

Spikformer: When spiking neural network meets transformer

Z Zhou, Y Zhu, C He, Y Wang, S Yan, Y Tian… - arXiv preprint arXiv …, 2022 - arxiv.org
We consider two biologically plausible structures, the Spiking Neural Network (SNN) and the
self-attention mechanism. The former offers an energy-efficient and event-driven paradigm …

Attention spiking neural networks

M Yao, G Zhao, H Zhang, Y Hu, L Deng… - IEEE transactions on …, 2023 - ieeexplore.ieee.org
Brain-inspired spiking neural networks (SNNs) are becoming a promising energy-efficient
alternative to traditional artificial neural networks (ANNs). However, the performance gap …

Neural architecture search for spiking neural networks

Y Kim, Y Li, H Park, Y Venkatesha, P Panda - European conference on …, 2022 - Springer
Abstract Spiking Neural Networks (SNNs) have gained huge attention as a potential energy-
efficient alternative to conventional Artificial Neural Networks (ANNs) due to their inherent …

[HTML][HTML] Spike frequency adaptation: bridging neural models and neuromorphic applications

C Ganguly, SS Bezugam, E Abs, M Payvand… - Communications …, 2024 - nature.com
The human brain's unparalleled efficiency in executing complex cognitive tasks stems from
neurons communicating via short, intermittent bursts or spikes. This has inspired Spiking …

Exploring lottery ticket hypothesis in spiking neural networks

Y Kim, Y Li, H Park, Y Venkatesha, R Yin… - European Conference on …, 2022 - Springer
Abstract Spiking Neural Networks (SNNs) have recently emerged as a new generation of
low-power deep neural networks, which is suitable to be implemented on low-power …

Sparser spiking activity can be better: Feature refine-and-mask spiking neural network for event-based visual recognition

M Yao, H Zhang, G Zhao, X Zhang, D Wang, G Cao… - Neural Networks, 2023 - Elsevier
Event-based visual, a new visual paradigm with bio-inspired dynamic perception and μ s
level temporal resolution, has prominent advantages in many specific visual scenarios and …

Snn-rat: Robustness-enhanced spiking neural network through regularized adversarial training

J Ding, T Bu, Z Yu, T Huang… - Advances in Neural …, 2022 - proceedings.neurips.cc
Spiking neural networks (SNNs) are promising to be widely deployed in real-time and safety-
critical applications with the advance of neuromorphic computing. Recent work has …

Spikingformer: Spike-driven residual learning for transformer-based spiking neural network

C Zhou, L Yu, Z Zhou, Z Ma, H Zhang, H Zhou… - arXiv preprint arXiv …, 2023 - arxiv.org
Spiking neural networks (SNNs) offer a promising energy-efficient alternative to artificial
neural networks, due to their event-driven spiking computation. However, state-of-the-art …

Rate coding or direct coding: Which one is better for accurate, robust, and energy-efficient spiking neural networks?

Y Kim, H Park, A Moitra, A Bhattacharjee… - ICASSP 2022-2022 …, 2022 - ieeexplore.ieee.org
Recent Spiking Neural Networks (SNNs) works focus on an image classification task,
therefore various coding techniques have been proposed to convert an image into temporal …