Integer-only Quantized Transformers for Embedded FPGA-based Time-series Forecasting in AIoT

T Ling, C Qian, G Schiele - 2024 IEEE Annual Congress on …, 2024 - ieeexplore.ieee.org
This paper presents the design of a hardware accelerator for Transformers, optimized for on-
device time-series forecasting in AIoT systems. It integrates integer-only quantization and …

HG-PIPE: Vision Transformer Acceleration with Hybrid-Grained Pipeline

Q Guo, J Wan, S Xu, M Li, Y Wang - arXiv preprint arXiv:2407.17879, 2024 - arxiv.org
Vision Transformer (ViT) acceleration with field programmable gate array (FPGA) is
promising but challenging. Existing FPGA-based ViT accelerators mainly rely on temporal …