A review of the optimal design of neural networks based on FPGA

C Wang, Z Luo - Applied Sciences, 2022 - mdpi.com
Deep learning based on neural networks has been widely used in image recognition,
speech recognition, natural language processing, automatic driving, and other fields and …

A survey on hardware accelerators and optimization techniques for RNNs

S Mittal, S Umesh - Journal of Systems Architecture, 2021 - Elsevier
Abstract “Recurrent neural networks”(RNNs) are powerful artificial intelligence models that
have shown remarkable effectiveness in several tasks such as music generation, speech …

Recurrent neural networks: An embedded computing perspective

NM Rezk, M Purnaprajna, T Nordström… - IEEE Access, 2020 - ieeexplore.ieee.org
Recurrent Neural Networks (RNNs) are a class of machine learning algorithms used for
applications with time-series and sequential data. Recently, there has been a strong interest …

Adaptable butterfly accelerator for attention-based NNs via hardware and algorithm co-design

H Fan, T Chau, SI Venieris, R Lee… - 2022 55th IEEE/ACM …, 2022 - ieeexplore.ieee.org
Attention-based neural networks have become pervasive in many AI tasks. Despite their
excellent algorithmic performance, the use of the attention mechanism and feedforward …

Spartus: A 9.4 TOp/s FPGA-based LSTM accelerator exploiting spatio-temporal sparsity

C Gao, T Delbruck, SC Liu - IEEE Transactions on Neural …, 2022 - ieeexplore.ieee.org
Long short-term memory (LSTM) recurrent networks are frequently used for tasks involving
time-sequential data, such as speech recognition. Unlike previous LSTM accelerators that …

Accpar: Tensor partitioning for heterogeneous deep learning accelerators

L Song, F Chen, Y Zhuo, X Qian, H Li… - 2020 IEEE International …, 2020 - ieeexplore.ieee.org
Deep neural network (DNN) accelerators as an example of domain-specific architecture
have demonstrated great success in DNN inference. However, the architecture acceleration …

Rtmobile: Beyond real-time mobile acceleration of rnns for speech recognition

P Dong, S Wang, W Niu, C Zhang, S Lin… - 2020 57th ACM/IEEE …, 2020 - ieeexplore.ieee.org
Recurrent neural networks (RNNs) based automatic speech recognition has nowadays
become promising and important on mobile devices such as smart phones. However …

Masr: A modular accelerator for sparse rnns

U Gupta, B Reagen, L Pentecost… - 2019 28th …, 2019 - ieeexplore.ieee.org
Recurrent neural networks (RNNs) are becoming the de-facto solution for speech
recognition. RNNs exploit long-term temporal relationships in data by applying repeated …

An experimental study of reduced-voltage operation in modern FPGAs for neural network acceleration

B Salami, EB Onural, IE Yuksel, F Koc… - 2020 50th Annual …, 2020 - ieeexplore.ieee.org
We empirically evaluate an undervolting technique, ie, underscaling the circuit supply
voltage below the nominal level, to improve the power-efficiency of Convolutional Neural …

Series arc fault diagnosis and line selection method based on recurrent neural network

W Li, Y Liu, Y Li, F Guo - IEEE Access, 2020 - ieeexplore.ieee.org
Series arc fault is a common phenomenon in the power system, it will directly affect the
working reliability, but there is no mature method to detect it due to its concealment and …