Randomness in neural networks: an overview

S Scardapane, D Wang - Wiley Interdisciplinary Reviews: Data …, 2017 - Wiley Online Library
Neural networks, as powerful tools for data mining and knowledge engineering, can learn
from data to build feature‐based classifiers and nonlinear predictive models. Training neural …

The challenges of modern computing and new opportunities for optics

C Li, X Zhang, J Li, T Fang, X Dong - PhotoniX, 2021 - Springer
In recent years, the explosive development of artificial intelligence implementing by artificial
neural networks (ANNs) creates inconceivable demands for computing hardware. However …

Design of deep echo state networks

C Gallicchio, A Micheli, L Pedrelli - Neural Networks, 2018 - Elsevier
In this paper, we provide a novel approach to the architectural design of deep Recurrent
Neural Networks using signal frequency analysis. In particular, focusing on the Reservoir …

Reservoir computing approaches to recurrent neural network training

M Lukoševičius, H Jaeger - Computer science review, 2009 - Elsevier
Echo State Networks and Liquid State Machines introduced a new paradigm in artificial
recurrent neural network (RNN) training, where an RNN (the reservoir) is generated …

An overview and comparative analysis of recurrent neural networks for short term load forecasting

FM Bianchi, E Maiorino, MC Kampffmeyer… - arXiv preprint arXiv …, 2017 - arxiv.org
The key component in forecasting demand and consumption of resources in a supply
network is an accurate prediction of real-valued time series. Indeed, both service …

Minimum complexity echo state network

A Rodan, P Tino - IEEE transactions on neural networks, 2010 - ieeexplore.ieee.org
Reservoir computing (RC) refers to a new class of state-space models with a fixed state
transition structure (the reservoir) and an adaptable readout form the state space. The …

[PDF][PDF] An overview of reservoir computing: theory, applications and implementations

B Schrauwen, D Verstraeten… - Proceedings of the 15th …, 2007 - biblio.ugent.be
Training recurrent neural networks is hard. Recently it has however been discovered that it
is possible to just construct a random recurrent topology, and only train a single linear …

Fully analogue photonic reservoir computer

F Duport, A Smerieri, A Akrout, M Haelterman… - Scientific reports, 2016 - nature.com
Introduced a decade ago, reservoir computing is an efficient approach for signal processing.
State of the art capabilities have already been demonstrated with both computer simulations …

Nonlinear spiking neural systems with autapses for predicting chaotic time series

Q Liu, H Peng, L Long, J Wang, Q Yang… - IEEE Transactions …, 2023 - ieeexplore.ieee.org
Spiking neural P (SNP) systems are a class of distributed and parallel neural-like computing
models that are inspired by the mechanism of spiking neurons and are 3rd-generation …

Growing echo-state network with multiple subreservoirs

J Qiao, F Li, H Han, W Li - IEEE transactions on neural …, 2016 - ieeexplore.ieee.org
An echo-state network (ESN) is an effective alternative to gradient methods for training
recurrent neural network. However, it is difficult to determine the structure (mainly the …