Perceptron: Learning, generalization, model selection, fault tolerance, and role in the deep learning era

KL Du, CS Leung, WH Mow, MNS Swamy - Mathematics, 2022 - mdpi.com
The single-layer perceptron, introduced by Rosenblatt in 1958, is one of the earliest and
simplest neural network models. However, it is incapable of classifying linearly inseparable …

Neural networks applied in chemistry. I. Determination of the optimal topology of multilayer perceptron neural networks

S Curteanu, H Cartwright - Journal of Chemometrics, 2011 - Wiley Online Library
Artificial neural networks (ANNs) are comparatively straightforward to understand and use in
the analysis of scientific data. However, this relative transparency may encourage their use …

Hydrological modelling using artificial neural networks

CW Dawson, RL Wilby - Progress in physical Geography, 2001 - journals.sagepub.com
This review considers the application of artificial neural networks (ANNs) to rainfall-runoff
modelling and flood forecasting. This is an emerging field of research, characterized by a …

Three learning phases for radial-basis-function networks

F Schwenker, HA Kestler, G Palm - Neural networks, 2001 - Elsevier
In this paper, learning algorithms for radial basis function (RBF) networks are discussed.
Whereas multilayer perceptrons (MLP) are typically trained with backpropagation …

[图书][B] Neural networks in a softcomputing framework

KL Du, MNS Swamy - 2006 - Springer
Conventional model-based data processing methods are computationally expensive and
require experts' knowledge for the modelling of a system. Neural networks are a model-free …

River flow forecasting using recurrent neural networks

D Nagesh Kumar, K Srinivasa Raju… - Water resources …, 2004 - Springer
Forecasting a hydrologic time series has been one of the most complicated tasks owing to
the wide range of data, the uncertainties in the parameters influencing the time series and …

New globally convergent training scheme based on the resilient propagation algorithm

AD Anastasiadis, GD Magoulas, MN Vrahatis - Neurocomputing, 2005 - Elsevier
In this paper, a new globally convergent modification of the Resilient Propagation-Rprop
algorithm is presented. This new addition to the Rprop family of methods builds on a …

Improving the convergence of the backpropagation algorithm using learning rate adaptation methods

GD Magoulas, MN Vrahatis, GS Androulakis - Neural Computation, 1999 - direct.mit.edu
This article focuses on gradient-based backpropagation algorithms that use either a
common adaptive learning rate for all weights or an individual adaptive learning rate for …

Online learning control using adaptive critic designs with sparse kernel machines

X Xu, Z Hou, C Lian, H He - IEEE Transactions on Neural …, 2013 - ieeexplore.ieee.org
In the past decade, adaptive critic designs (ACDs), including heuristic dynamic programming
(HDP), dual heuristic programming (DHP), and their action-dependent ones, have been …

Spiking neural network training using evolutionary algorithms

NG Pavlidis, OK Tasoulis… - … Joint Conference on …, 2005 - ieeexplore.ieee.org
Networks of spiking neurons can perform complex non-linear computations in fast temporal
coding just as well as rate coded networks. These networks differ from previous models in …