Statistical learning theory for control: A finite-sample perspective

A Tsiamis, I Ziemann, N Matni… - IEEE Control Systems …, 2023 - ieeexplore.ieee.org
Learning algorithms have become an integral component to modern engineering solutions.
Examples range from self-driving cars and recommender systems to finance and even …

Logarithmic regret bound in partially observable linear dynamical systems

S Lale, K Azizzadenesheli, B Hassibi… - Advances in Neural …, 2020 - proceedings.neurips.cc
We study the problem of system identification and adaptive control in partially observable
linear dynamical systems. Adaptive and closed-loop system identification is a challenging …

Streaming linear system identification with reverse experience replay

S Kowshik, D Nagaraj, P Jain… - Advances in Neural …, 2021 - proceedings.neurips.cc
We consider the problem of estimating a linear time-invariant (LTI) dynamical system from a
single trajectory via streaming algorithms, which is encountered in several applications …

Online learning of the kalman filter with logarithmic regret

A Tsiamis, GJ Pappas - IEEE Transactions on Automatic …, 2022 - ieeexplore.ieee.org
In this article, we consider the problem of predicting observations generated online by an
unknown, partially observable linear system, which is driven by Gaussian noise. In the linear …

A new approach to learning linear dynamical systems

A Bakshi, A Liu, A Moitra, M Yau - Proceedings of the 55th Annual ACM …, 2023 - dl.acm.org
Linear dynamical systems are the foundational statistical model upon which control theory is
built. Both the celebrated Kalman filter and the linear quadratic regulator require knowledge …

Online linear regression in dynamic environments via discounting

A Jacobsen, A Cutkosky - arXiv preprint arXiv:2405.19175, 2024 - arxiv.org
We develop algorithms for online linear regression which achieve optimal static and
dynamic regret guarantees\emph {even in the complete absence of prior knowledge}. We …

Improved rates for prediction and identification of partially observed linear dynamical systems

H Lee - International Conference on Algorithmic Learning …, 2022 - proceedings.mlr.press
Identification of a linear time-invariant dynamical system from partial observations is a
fundamental problem in control theory. Particularly challenging are systems exhibiting long …

Slip: Learning to predict in unknown dynamical systems with long-term memory

P Rashidinejad, J Jiao… - Advances in Neural …, 2020 - proceedings.neurips.cc
We present an efficient and practical (polynomial time) algorithm for online prediction in
unknown and partially observed linear dynamical systems (LDS) under stochastic noise …

Butterfly effects of sgd noise: Error amplification in behavior cloning and autoregression

A Block, DJ Foster, A Krishnamurthy… - arXiv preprint arXiv …, 2023 - arxiv.org
This work studies training instabilities of behavior cloning with deep neural networks. We
observe that minibatch SGD updates to the policy network during training result in sharp …

Learning from censored and dependent data: The case of linear dynamics

O Plevrakis - Conference on Learning Theory, 2021 - proceedings.mlr.press
Observations from dynamical systems often exhibit irregularities, such as censoring, where
values are recorded only if they fall within a certain range. Censoring is ubiquitous in …