Training pi-sigma network by online gradient algorithm with penalty for small weight update

Y Xiong, W Wu, X Kang, C Zhang - Neural computation, 2007 - ieeexplore.ieee.org
A pi-sigma network is a class of feedforward neural networks with product units in the output
layer. An online gradient algorithm is the simplest and most often used training method for …

Convergence of online gradient algorithm with stochastic inputs for pi-sigma neural networks

X Kang, Y Xiong, C Zhang, W Wu - 2007 IEEE Symposium on …, 2007 - ieeexplore.ieee.org
An online gradient method is presented and discussed for Pi-Sigma neural networks with
stochastic inputs. The error function is proved to be monotone in the training process, and …