ASU-CNN: An Efficient Deep Architecture for Image Classification and Feature Visualizations

JU Rahman, F Makhdoom, D Lu - arXiv preprint arXiv:2305.19146, 2023 - arxiv.org
Activation functions play a decisive role in determining the capacity of Deep Neural
Networks as they enable neural networks to capture inherent nonlinearities present in data …

Enhancing Deep Learning Models for Image Classification using Hybrid Activation Functions

Z Zhang, X Li, Y Yang, Z Shi - 2023 - researchsquare.com
In the era of big data, efficient data processing has become a crucial issue for scientific
development. Image classification, as one of the core tasks in the field of computer vision …

Evaluating CNN with Oscillatory Activation Function

J Sharma - arXiv preprint arXiv:2211.06878, 2022 - arxiv.org
The reason behind CNNs capability to learn high-dimensional complex features from the
images is the non-linearity introduced by the activation function. Several advanced …

Performance analysis of nonlinear activation function in convolution neural network for image classification

EC Too, L Yujian, PK Gadosey… - International Journal …, 2020 - inderscienceonline.com
Deep learning architectures which are exceptionally deep have exhibited to be incredibly
powerful models for image processing. As the architectures become deep, it introduces …

Co-evolution of novel tree-like ANNs and activation functions: An observational study

D O'Neill, B Xue, M Zhang - AI 2018: Advances in Artificial Intelligence …, 2018 - Springer
Deep convolutional neural networks (CNNs) represent the state-of-the-art model structure in
image classification problems. However, deep CNNs suffer from issues of interpretability …

ResNet-18 comparative analysis of various activation functions for image classification

GK Pandey, S Srivastava - 2023 International Conference on …, 2023 - ieeexplore.ieee.org
Deep neural network and Machine learning are a latest emerging concept in the field of data
science. Due to multi-layer hierarchical feature extraction in conjunction with control …

[PDF][PDF] Rethinking the Role of Activation Functions in Deep Convolutional Neural Networks for Image Classification.

Q Zheng, M Yang, X Tian, X Wang… - engineering …, 2020 - engineeringletters.com
Deep convolutional neural network used for image classification is an important part of deep
learning and has great significance in the field of computer vision. Moreover, it helps …

Discovering parametric activation functions

G Bingham, R Miikkulainen - Neural Networks, 2022 - Elsevier
Recent studies have shown that the choice of activation function can significantly affect the
performance of deep learning networks. However, the benefits of novel activation functions …

[PDF][PDF] Learnable Extended Activation Function for Deep Neural Networks

Y Bodyanskiy, S Kostiuk - International Journal of Computing (Oct …, 2023 - researchgate.net
ABSTRACT This paper introduces Learnable Extended Activation Function (LEAF)-an
adaptive activation function that combines the properties of squashing functions and rectifier …

A Comparative Analysis of Activation Function, Evaluating their Accuracy and Efficiency when Applied to Miscellaneous Datasets

AS Tomar, A Sharma, A Shrivastava… - … on Applied Artificial …, 2023 - ieeexplore.ieee.org
Numerous deep learning architectures have been developed as a result of activation
functions (AFs), which are crucial for allowing deep neural networks to deal with intricate …