We consider the general class of time-homogeneous stochastic dynamical systems, both discrete and continuous, and study the problem of learning a representation of the state that …
Extended Dynamic Mode Decomposition (EDMD) is a popular data-driven method to approximate the Koopman operator for deterministic and stochastic (control) systems. This …
I Ishikawa, Y Hashimoto, M Ikeda… - arXiv preprint arXiv …, 2024 - arxiv.org
This paper presents a novel approach for estimating the Koopman operator defined on a reproducing kernel Hilbert space (RKHS) and its spectra. We propose an estimation method …
Linearity of Koopman operators and simplicity of their estimators coupled with model- reduction capabilities has lead to their great popularity in applications for learning dynamical …
We rigorously derive novel and sharp finite-data error bounds for highly sample-efficient Extended Dynamic Mode Decomposition (EDMD) for both iid and ergodic sampling. In …
We study the problem of forecasting the evolution of a function of the state (observable) of a discrete ergodic dynamical system over multiple time steps. The elegant theory of Koopman …
This paper proposes a fully data-driven approach for optimal control of nonlinear control- affine systems represented by a stochastic diffusion. The focus is on the scenario where both …
We study the evolution of distributions under the action of an ergodic dynamical system, which may be stochastic in nature. By employing tools from Koopman and transfer operator …
Policy Mirror Descent (PMD) is a powerful and theoretically sound methodology for sequential decision-making. However, it is not directly applicable to Reinforcement Learning …