Three Decades of Activations: A Comprehensive Survey of 400 Activation Functions for Neural Networks

V Kunc, J Kléma - arXiv preprint arXiv:2402.09092, 2024 - arxiv.org
Neural networks have proven to be a highly effective tool for solving complex problems in
many areas of life. Recently, their importance and practical usability have further been …

SMU: smooth activation function for deep networks using smoothing maximum technique

K Biswas, S Kumar, S Banerjee, AK Pandey - arXiv preprint arXiv …, 2021 - arxiv.org
Deep learning researchers have a keen interest in proposing two new novel activation
functions which can boost network performance. A good choice of activation function can …

Temporal convolution network based on attention mechanism for well production prediction

Y Zhen, J Fang, X Zhao, J Ge, Y Xiao - Journal of Petroleum Science and …, 2022 - Elsevier
Well production forecasting has a very important guiding significance for oilfield production
and management. The traditional BP neural network is difficult to deal with the data with time …

SAU: Smooth activation function using convolution with approximate identities

K Biswas, S Kumar, S Banerjee… - European Conference on …, 2022 - Springer
Well-known activation functions like ReLU or Leaky ReLU are non-differentiable at the
origin. Over the years, many smooth approximations of ReLU have been proposed using …

[PDF][PDF] Enhancing the accuracy of low-cost thermocouple devices through deep-wavelet neural network calibration.

J Julian, F Wahyuni, AB Dewantara… - … Journal of Electrical …, 2024 - researchgate.net
Data collection using thermocouple sensors in low-cost data acquisition is prone to noise
interference, which could reduce the data quality. Noise sources such as cold junction …

Inference genové exprese pomocí umělých neuronových sítí

V Kunc - 2024 - search.proquest.com
Merení genové exprese je nezbytné pro porozumení bunecným procesum a stavum v
rozlicných experimentálních podmínkách, což je potreba v ruzných oblastech …

Inference genové exprese pomocí umělých neuronových sítí

K Vladimír - 2024 - dspace.cvut.cz
Merení genové exprese je nezbytné pro porozumení bunecným procesum a stavum v
rozlicných experimentálních podmínkách, což je potreba v ruzných oblastech …

Image response regression via deep neural networks

D Zhang, L Li, C Sripada, J Kang - Journal of the Royal …, 2023 - academic.oup.com
Delineating associations between images and covariates is a central aim of imaging studies.
To tackle this problem, we propose a novel non-parametric approach in the framework of …

[PDF][PDF] ACTIVATION FUNCTIONS

K Biswas, S Kumar, S Banerjee… - arXiv preprint arXiv …, 2021 - researchgate.net
An activation function is a crucial component of a neural network that introduces non-
linearity in the network. The state-of-the-art performance of a neural network depends on the …