IMPULSE: A 65-nm digital compute-in-memory macro with fused weights and membrane potential for spike-based sequential learning tasks

A Agrawal, M Ali, M Koo, N Rathi… - IEEE Solid-State …, 2021 - ieeexplore.ieee.org
IEEE Solid-State Circuits Letters, 2021ieeexplore.ieee.org
The inherent dynamics of the neuron membrane potential in spiking neural networks (SNNs)
allows the processing of sequential learning tasks, avoiding the complexity of recurrent
neural networks. The highly sparse spike-based computations in such spatiotemporal data
can be leveraged for energy efficiency. However, the membrane potential incurs additional
memory access bottlenecks in current SNN hardware. To that effect, we propose a 10T-
SRAM compute-in-memory (CIM) macro, specifically designed for state-of-the-art SNN …
The inherent dynamics of the neuron membrane potential in spiking neural networks (SNNs) allows the processing of sequential learning tasks, avoiding the complexity of recurrent neural networks. The highly sparse spike-based computations in such spatiotemporal data can be leveraged for energy efficiency. However, the membrane potential incurs additional memory access bottlenecks in current SNN hardware. To that effect, we propose a 10T-SRAM compute-in-memory (CIM) macro, specifically designed for state-of-the-art SNN inference. It consists of a fused weight ( W MEM ) and membrane potential ( V MEM ) memory and inherently exploits sparsity in input spikes leading to ~97.4% reduction in energy-delay product (EDP) at 85% sparsity (typical of SNNs considered in this work) compared to the case of no sparsity. We propose staggered data mapping and reconfigurable peripherals for handling different bit precision requirements of W MEM and V MEM , while supporting multiple neuron functionalities. The proposed macro was fabricated in 65-nm CMOS technology, achieving energy efficiency of 0.99 TOPS/W at 0.85-V supply and 200-MHz frequency for signed 11-bit operations. We evaluate the SNN for sentiment classification from the IMDB dataset of movie reviews and achieve within ~1% accuracy difference and ~ 5× higher energy efficiency compared to a corresponding long short-term memory network.
ieeexplore.ieee.org
以上显示的是最相近的搜索结果。 查看全部搜索结果