作者
Enrique Castillo, Bertha Guijarro-Berdinas, Oscar Fontenla-Romero, Amparo Alonso-Betanzos, Yoshua Bengio
发表日期
2006/7/1
期刊
Journal of Machine Learning Research
卷号
7
期号
7
简介
This paper introduces a learning method for two-layer feedforward neural networks based on sensitivity analysis, which uses a linear training algorithm for each of the two layers. First, random values are assigned to the outputs of the first layer; later, these initial values are updated based on sensitivity formulas, which use the weights in each of the layers; the process is repeated until convergence. Since these weights are learnt solving a linear system of equations, there is an important saving in computational time. The method also gives the local sensitivities of the least square errors with respect to input and output data, with no extra computational cost, because the necessary information becomes available without extra calculations. This method, called the Sensitivity-Based Linear Learning Method, can also be used to provide an initial set of weights, which significantly improves the behavior of other learning algorithms. The theoretical basis for the method is given and its performance is illustrated by its application to several examples in which it is compared with several learning algorithms and well known data sets. The results have shown a learning speed generally faster than other existing methods. In addition, it can be used as an initialization tool for other well known methods with significant improvements.
引用总数
2006200720082009201020112012201320142015201620172018201920202021202220232024346414169181518151381158662
学术搜索中的文章
E Castillo, B Guijarro-Berdinas, O Fontenla-Romero… - Journal of Machine Learning Research, 2006