A survey of the recent architectures of deep convolutional neural networks

A Khan, A Sohail, U Zahoora, AS Qureshi - Artificial intelligence review, 2020 - Springer
Abstract Deep Convolutional Neural Network (CNN) is a special type of Neural Networks,
which has shown exemplary performance on several competitions related to Computer …

Squeezeformer: An efficient transformer for automatic speech recognition

S Kim, A Gholami, A Shaw, N Lee… - Advances in …, 2022 - proceedings.neurips.cc
The recently proposed Conformer model has become the de facto backbone model for
various downstream speech tasks based on its hybrid attention-convolution architecture that …

ECG arrhythmia classification by using a recurrence plot and convolutional neural network

BM Mathunjwa, YT Lin, CH Lin, MF Abbod… - … Signal Processing and …, 2021 - Elsevier
Cardiovascular diseases affect approximately 50 million people worldwide; thus, heart
disease prevention is one of the most important tasks of any health care system. Despite the …

Speed is all you need: On-device acceleration of large diffusion models via gpu-aware optimizations

YH Chen, R Sarokin, J Lee, J Tang… - Proceedings of the …, 2023 - openaccess.thecvf.com
The rapid development and application of foundation models have revolutionized the field of
artificial intelligence. Large diffusion models have gained significant attention for their ability …

[HTML][HTML] A pseudo-softmax function for hardware-based high speed image classification

GC Cardarilli, L Di Nunzio, R Fazzolari, D Giardino… - Scientific reports, 2021 - nature.com
In this work a novel architecture, named pseudo-softmax, to compute an approximated form
of the softmax function is presented. This architecture can be fruitfully used in the last layer of …

Design and implementation of an approximate softmax layer for deep neural networks

Y Gao, W Liu, F Lombardi - 2020 IEEE international symposium …, 2020 - ieeexplore.ieee.org
Deep neural networks (DNNs) have been widely used in classification due to their high
accuracy. The softmax function is one of the important non-linear functions in DNNs …

[HTML][HTML] Hardware implementation of a softmax-like function for deep learning

I Kouretas, V Paliouras - Technologies, 2020 - mdpi.com
In this paper a simplified hardware implementation of a CNN softmax-like layer is proposed.
Initially the softmax activation function is analyzed in terms of required numerical accuracy …

Approximate softmax functions for energy-efficient deep neural networks

K Chen, Y Gao, H Waris, W Liu… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Approximate computing has emerged as a new paradigm that provides power-efficient and
high-performance arithmetic designs by relaxing the stringent requirement of accuracy …

Attention-based neural networks for chroma intra prediction in video coding

MG Blanch, S Blasi, AF Smeaton… - IEEE Journal of …, 2020 - ieeexplore.ieee.org
Neural networks can be successfully used to improve several modules of advanced video
coding schemes. In particular, compression of colour components was shown to greatly …

Efficient softmax approximation for deep neural networks with attention mechanism

I Vasyltsov, W Chang - arXiv preprint arXiv:2111.10770, 2021 - arxiv.org
There has been a rapid advance of custom hardware (HW) for accelerating the inference
speed of deep neural networks (DNNs). Previously, the softmax layer was not a main …