Learning to be efficient: Algorithms for training low-latency, low-compute deep spiking neural networks

D Neil, M Pfeiffer, SC Liu - Proceedings of the 31st annual ACM …, 2016 - dl.acm.org
… the power and efficiency of spiking neural networks. These networks were able to achieve …
did so in far fewer operations and with a shorter latency. Due to the efficiency of a spike-based …

Training high-performance low-latency spiking neural networks by differentiation on spike representation

Q Meng, M Xiao, S Yan, Y Wang… - Proceedings of the …, 2022 - openaccess.thecvf.com
… To effectively train SNNs with low latency, we further study the representation error …
neural models to reduce the error. With these methods, we can train high-performance low-latency

Learn codes: Inventing low-latency codes via recurrent neural networks

Y Jiang, H Kim, H Asnani, S Kannan… - IEEE Journal on …, 2020 - ieeexplore.ieee.org
… We design LEARN code for low latency requirements with specific network designs. …
neural network architecture for LEARN (both encoder and decoder) that satisfies the low latency

Can deep neural networks be converted to ultra low-latency spiking neural networks?

G Datta, PA Beerel - 2022 Design, Automation & Test in …, 2022 - ieeexplore.ieee.org
neural network (DNN). In this paper, we determine that SOTA conversion strategies cannot
yield ultra low latency … The resulting SNNs have ultra low latency and high activation sparsity, …

Optimized potential initialization for low-latency spiking neural networks

T Bu, J Ding, Z Yu, T Huang - Proceedings of the AAAI conference on …, 2022 - ojs.aaai.org
… However, there is a trade-off between accuracy and latency. … a spiking neuron with the
activation value of an analog neuron, … converted SNNs with extremely low latency (fewer than 32 …

Automatic heterogeneous quantization of deep neural networks for low-latency inference on the edge for particle detectors

CN Coelho, A Kuusela, S Li, H Zhuang… - Nature Machine …, 2021 - nature.com
… reduction in model size, latency and energy consumption. … versions of deep neural network
models for minimum-energy… resources are strictly limited and a latency of\({\mathcal {O}}(1…

Optimal ANN-SNN conversion for high-accuracy and ultra-low-latency spiking neural networks

T Bu, W Fang, J Ding, PL Dai, Z Yu, T Huang - arXiv preprint arXiv …, 2023 - arxiv.org
… trade-off between low latency and high … -low latency (within 4 time-steps). Second, we
consider the best accuracy of SNN. It is obvious to find that the SNN accuracy at ultra-low latency

One timestep is all you need: Training spiking neural networks with ultra low latency

SS Chowdhury, N Rathi, K Roy - arXiv preprint arXiv:2110.05929, 2021 - arxiv.org
… An alternative route for efficient computation is using Spiking Neural Networks (SNNs) [9,
10]… networks. In this paper, standard networks are referred to as Analog Neural Networks (ANNs…

Mapping neural networks to FPGA-based IoT devices for ultra-low latency processing

M Wielgosz, M Karwatowski - Sensors, 2019 - mdpi.com
… To our best knowledge, the only high-level tool that can achieve comparable latency for
neural network inference in FPGA is hls4ml [10]. This tool was designed to work in particle …

Ps and qs: Quantization-aware pruning for efficient low latency neural network inference

B Hawks, J Duarte, NJ Fraser, A Pappalardo… - Frontiers in Artificial …, 2021 - frontiersin.org
… Section 2 describes the low latency benchmark task in this work related to jet classification
at the CERN Large Hadron Collider (LHC). Section 3 introduces our approach to QAP and the …