A fractional gradient descent algorithm robust to the initial weights of multilayer perceptron

X Xie, YF Pu, J Wang - Neural Networks, 2023 - Elsevier
For multilayer perceptron (MLP), the initial weights will significantly influence its
performance. Based on the enhanced fractional derivative extend from convex optimization …

Fractional‐order deep backpropagation neural network

C Bao, Y Pu, Y Zhang - Computational intelligence and …, 2018 - Wiley Online Library
In recent years, the research of artificial neural networks based on fractional calculus has
attracted much attention. In this paper, we proposed a fractional‐order deep …

Fractional-order gradient descent learning of BP neural networks with Caputo derivative

J Wang, Y Wen, Y Gou, Z Ye, H Chen - Neural networks, 2017 - Elsevier
Fractional calculus has been found to be a promising area of research for information
processing and modeling of some physical systems. In this paper, we propose a fractional …

Generalization of the gradient method with fractional order gradient direction

Y Wei, Y Kang, W Yin, Y Wang - Journal of the Franklin Institute, 2020 - Elsevier
Fractional calculus is an efficient tool, which has the potential to improve the performance of
gradient methods. However, when the first order gradient direction is generalized by …

Fractional extreme value adaptive training method: fractional steepest descent approach

YF Pu, JL Zhou, Y Zhang, N Zhang… - IEEE transactions on …, 2013 - ieeexplore.ieee.org
The application of fractional calculus to signal processing and adaptive learning is an
emerging area of research. A novel fractional adaptive learning approach that utilizes …

Study on fractional order gradient methods

Y Chen, Q Gao, Y Wei, Y Wang - Applied Mathematics and Computation, 2017 - Elsevier
In this paper, convergence capability of the conventional fractional order gradient methods
(FOGMs) is analyzed and a new FOGM with guaranteed and faster convergence ability is …

A global neural network learning machine: Coupled integer and fractional calculus operator with an adaptive learning scheme

H Zhang, YF Pu, X Xie, B Zhang, J Wang, T Huang - Neural Networks, 2021 - Elsevier
Find the global optimal solution of the model is one promising research topic in
computational intelligent community. Dependent on analogies to natural processes, the …

An innovative fractional order LMS based on variable initial value and gradient order

S Cheng, Y Wei, Y Chen, Y Li, Y Wang - Signal Processing, 2017 - Elsevier
This article presents a novel fractional order LMS (FOLMS) algorithm, which involves a
variable gradient order scheme. The fractional order gradient descent method is revisited …

Fractional approximation of broad learning system

S Wu, J Wang, H Sun, K Zhang… - IEEE Transactions on …, 2022 - ieeexplore.ieee.org
Approximation ability is of much importance for neural networks. The broad learning system
(BLS)(Chen and Liu, 2018), widely used in the industry with good performance, has been …

A fractional gradient descent-based rbf neural network

S Khan, I Naseem, MA Malik, R Togneri… - Circuits, Systems, and …, 2018 - Springer
In this research, we propose a novel fractional gradient descent-based learning algorithm
(FGD) for the radial basis function neural networks (RBF-NN). The proposed FGD is the …