Three Decades of Activations: A Comprehensive Survey of 400 Activation Functions for Neural Networks

V Kunc, J Kléma - arXiv preprint arXiv:2402.09092, 2024 - arxiv.org
Neural networks have proven to be a highly effective tool for solving complex problems in
many areas of life. Recently, their importance and practical usability have further been …

[PDF][PDF] Transfer functions: hidden possibilities for better neural networks.

W Duch, N Jankowski - ESANN, 2001 - is.umk.pl
Sigmoidal or radial transfer functions do not guarantee the best generalization nor fast
learning of neural networks. Families of parameterized transfer functions provide flexible …

Modeling parkinsonian circuitry and the DBS electrode: I. Biophysical background and software

JE Arle, LZ Mei, JL Shils - Stereotactic and functional neurosurgery, 2007 - karger.com
Deep brain stimulation (DBS) of the subthalamic nucleus (STN) for Parkinson's disease (PD)
has become routine over the past decade, utilizing microelectrode recordings to ensure …

Towards comprehensive foundations of computational intelligence

W Duch - Challenges for Computational Intelligence, 2007 - Springer
Although computational intelligence (CI) covers a vast variety of different methods it still
lacks an integrative theory. Several proposals for CI foundations are discussed: computing …

A comparative investigation of non-linear activation functions in neural controllers for search-based game AI engineering

TG Tan, J Teo, P Anthony - Artificial Intelligence Review, 2014 - Springer
The creation of intelligent video game controllers has recently become one of the greatest
challenges in game artificial intelligence research, and it is arguably one of the fastest …

Improving the precision of fMRI BOLD signal deconvolution with implications for connectivity analysis

K Bush, J Cisler, J Bian, G Hazaroglu… - Magnetic resonance …, 2015 - Elsevier
An important, open problem in neuroimaging analyses is developing analytical methods that
ensure precise inferences about neural activity underlying fMRI BOLD signal despite the …

K-separability

W Duch - International Conference on Artificial Neural Networks, 2006 - Springer
Neural networks use their hidden layers to transform input data into linearly separable data
clusters, with a linear or a perceptron type output layer making the final projection on the line …

The influence of ARIMA-GARCH parameters in feed forward neural networks prediction

MA de Oliveira - Neural Computing and Applications, 2011 - Springer
The objective of this article is to find out the influence of the parameters of the ARIMA-
GARCH models in the prediction of artificial neural networks (ANN) of the feed forward type …

Learning highly non-separable boolean functions using constructive feedforward neural network

M Grochowski, W Duch - International Conference on Artificial Neural …, 2007 - Springer
Learning problems with inherent non-separable Boolean logic is still a challenge that has
not been addressed by neural or kernel classifiers. The k-separability concept introduced …

Heterogeneous adaptive systems

W Duch, K Grabczewski - … on Neural Networks. IJCNN'02 (Cat …, 2002 - ieeexplore.ieee.org
Most adaptive systems are homogenous, ie, they are built from processing elements of the
same type. MLP neural networks and decision trees use nodes that partition the input space …