Perceptron: Learning, generalization, model selection, fault tolerance, and role in the deep learning era

KL Du, CS Leung, WH Mow, MNS Swamy - Mathematics, 2022 - mdpi.com
The single-layer perceptron, introduced by Rosenblatt in 1958, is one of the earliest and
simplest neural network models. However, it is incapable of classifying linearly inseparable …

Convergence analysis of online gradient method for BP neural networks

W Wu, J Wang, M Cheng, Z Li - Neural Networks, 2011 - Elsevier
This paper considers a class of online gradient learning methods for backpropagation (BP)
neural networks with a single hidden layer. We assume that in each training cycle, each …

On adaptive learning rate that guarantees convergence in feedforward networks

L Behera, S Kumar, A Patnaik - IEEE transactions on neural …, 2006 - ieeexplore.ieee.org
This paper investigates new learning algorithms (LF I and LF II) based on Lyapunov function
for the training of feedforward neural networks. It is observed that such algorithms have …

Weak and strong convergence analysis of Elman neural networks via weight decay regularization

L Zhou, Q Fan, X Huang, Y Liu - Optimization, 2023 - Taylor & Francis
In this paper, we propose a novel variant of the algorithm to improve the generalization
performance for Elman neural networks (ENN). Here, the weight decay term, also called L 2 …

Latent semantic analysis for text categorization using neural network

B Yu, Z Xu, C Li - Knowledge-Based Systems, 2008 - Elsevier
New text categorization models using back-propagation neural network (BPNN) and
modified back-propagation neural network (MBPNN) are proposed. An efficient feature …

Fractional‐order deep backpropagation neural network

C Bao, Y Pu, Y Zhang - Computational intelligence and …, 2018 - Wiley Online Library
In recent years, the research of artificial neural networks based on fractional calculus has
attracted much attention. In this paper, we proposed a fractional‐order deep …

Quantile based probabilistic wind turbine power curve model

K Xu, J Yan, H Zhang, H Zhang, S Han, Y Liu - Applied Energy, 2021 - Elsevier
Wind turbine power curve is an indicator of wind turbine performance and important input of
wind farm design or power prediction, therefore can serve the system planning and …

Common nature of learning between back-propagation and hopfield-type neural networks for generalized matrix inversion with simplified models

Y Zhang, D Guo, Z Li - IEEE transactions on neural networks …, 2013 - ieeexplore.ieee.org
In this paper, two simple-structure neural networks based on the error back-propagation
(BP) algorithm (ie, BP-type neural networks, BPNNs) are proposed, developed, and …

Vehicle lateral stability control based on stability category recognition with improved brain emotional learning network

H Wang, J Zhou, C Hu, W Chen - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Appropriate vehicle lateral stability control is the key to ensure vehicle driving safety,
whereas accurate lateral stability recognition can help improve the performance of vehicle …

Global convergence of online BP training with dynamic learning rate

R Zhang, ZB Xu, GB Huang… - IEEE Transactions on …, 2012 - ieeexplore.ieee.org
The online backpropagation (BP) training procedure has been extensively explored in
scientific research and engineering applications. One of the main factors affecting the …