Memristor-based binarized spiking neural networks: Challenges and applications

JK Eshraghian, X Wang, WD Lu - IEEE Nanotechnology …, 2022 - ieeexplore.ieee.org
Memristive arrays are a natural fit to implement spiking neural network (SNN) acceleration.
Representing information as digital spiking events can improve noise margins and tolerance …

Stochastic rounding: implementation, error analysis and applications

M Croci, M Fasi, NJ Higham… - Royal Society Open …, 2022 - royalsocietypublishing.org
Stochastic rounding (SR) randomly maps a real number x to one of the two nearest values in
a finite precision number system. The probability of choosing either of these two numbers is …

PLAM: A posit logarithm-approximate multiplier

R Murillo, AA Del Barrio, G Botella… - … on Emerging Topics …, 2021 - ieeexplore.ieee.org
The Posit™ Number System was introduced in 2017 as a replacement for floating-point
numbers. Since then, the community has explored its application in several areas, such as …

A block minifloat representation for training deep neural networks

S Fox, S Rasoulinezhad, J Faraone… - … Conference on Learning …, 2020 - openreview.net
Training Deep Neural Networks (DNN) with high efficiency can be difficult to achieve with
native floating-point representations and commercially available hardware. Specialized …

SALO: an efficient spatial accelerator enabling hybrid sparse attention mechanisms for long sequences

G Shen, J Zhao, Q Chen, J Leng, C Li… - Proceedings of the 59th …, 2022 - dl.acm.org
The attention mechanisms of transformers effectively extract pertinent information from the
input sequence. However, the quadratic complexity of self-attention wrt the sequence length …

Low-precision stochastic gradient Langevin dynamics

R Zhang, AG Wilson, C De Sa - International Conference on …, 2022 - proceedings.mlr.press
While low-precision optimization has been widely used to accelerate deep learning, low-
precision sampling remains largely unexplored. As a consequence, sampling is simply …

Accelerating Graph Neural Networks on Real Processing-In-Memory Systems

C Giannoula, P Yang, I Fernandez Vega… - arXiv e …, 2024 - ui.adsabs.harvard.edu
Abstract Graph Neural Networks (GNNs) are emerging ML models to analyze graph-
structure data. Graph Neural Network (GNN) execution involves both compute-intensive and …

Goldeneye: A platform for evaluating emerging numerical data formats in dnn accelerators

A Mahmoud, T Tambe, T Aloui… - 2022 52nd Annual …, 2022 - ieeexplore.ieee.org
This paper presents GoldenEye, a functional simulator with fault injection capabilities for
common and emerging numerical formats, implemented for the PyTorch deep learning …

HDReason: Algorithm-Hardware Codesign for Hyperdimensional Knowledge Graph Reasoning

H Chen, Y Ni, A Zakeri, Z Zou, S Yun, F Wen… - arXiv preprint arXiv …, 2024 - arxiv.org
In recent times, a plethora of hardware accelerators have been put forth for graph learning
applications such as vertex classification and graph classification. However, previous works …

Hardware-software co-design enabling static and dynamic sparse attention mechanisms

J Zhao, P Zeng, G Shen, Q Chen… - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
The attention mechanisms of transformers effectively extract pertinent information from the
input sequence. However, the quadratic complexity of self-attention incurs heavy …