Learning from the past: reservoir computing using delayed variables

U Parlitz - Frontiers in Applied Mathematics and Statistics, 2024 - frontiersin.org
Reservoir computing is a machine learning method that is closely linked to dynamical
systems theory. This connection is highlighted in a brief introduction to the general concept …

Embedding and approximation theorems for echo state networks

A Hart, J Hook, J Dawes - Neural Networks, 2020 - Elsevier
Abstract Echo State Networks (ESNs) are a class of single-layer recurrent neural networks
that have enjoyed recent attention. In this paper we prove that a suitable ESN, trained on a …

A brief survey on the approximation theory for sequence modelling

H Jiang, Q Li, Z Li, S Wang - arXiv preprint arXiv:2302.13752, 2023 - arxiv.org
We survey current developments in the approximation theory of sequence modelling in
machine learning. Particular emphasis is placed on classifying existing results for various …

Approximation bounds for random neural networks and reservoir systems

L Gonon, L Grigoryeva, JP Ortega - The Annals of Applied …, 2023 - projecteuclid.org
This work studies approximation based on single-hidden-layer feedforward and recurrent
neural networks with randomly generated internal weights. These methods, in which only …

Fading memory echo state networks are universal

L Gonon, JP Ortega - Neural Networks, 2021 - Elsevier
Echo state networks (ESNs) have been recently proved to be universal approximants for
input/output systems with respect to various L p-type criteria. When 1≤ p<∞, only p …

The universal approximation property: characterization, construction, representation, and existence

A Kratsios - Annals of Mathematics and Artificial Intelligence, 2021 - Springer
The universal approximation property of various machine learning models is currently only
understood on a case-by-case basis, limiting the rapid development of new theoretically …

Designing universal causal deep learning models: The geometric (hyper) transformer

B Acciaio, A Kratsios, G Pammer - Mathematical Finance, 2024 - Wiley Online Library
Several problems in stochastic analysis are defined through their geometry, and preserving
that geometric structure is essential to generating meaningful predictions. Nevertheless, how …

Discrete-time signatures and randomness in reservoir computing

C Cuchiero, L Gonon, L Grigoryeva… - … on Neural Networks …, 2021 - ieeexplore.ieee.org
A new explanation of the geometric nature of the reservoir computing (RC) phenomenon is
presented. RC is understood in the literature as the possibility of approximating input–output …

Infinite-dimensional reservoir computing

L Gonon, L Grigoryeva, JP Ortega - Neural Networks, 2024 - Elsevier
Reservoir computing approximation and generalization bounds are proved for a new
concept class of input/output systems that extends the so-called generalized Barron …

Quantum reservoir computing in finite dimensions

R Martínez-Peña, JP Ortega - Physical Review E, 2023 - APS
Most existing results in the analysis of quantum reservoir computing (QRC) systems with
classical inputs have been obtained using the density matrix formalism. This paper shows …