Simplified state space layers for sequence modeling

JTH Smith, A Warrington, SW Linderman - arXiv preprint arXiv:2208.04933, 2022 - arxiv.org
Models using structured state space sequence (S4) layers have achieved state-of-the-art
performance on long-range sequence modeling tasks. An S4 layer combines linear state …

KalmanNet: Neural network aided Kalman filtering for partially known dynamics

G Revach, N Shlezinger, X Ni… - IEEE Transactions …, 2022 - ieeexplore.ieee.org
State estimation of dynamical systems in real-time is a fundamental task in signal
processing. For systems that are well-represented by a fully known linear Gaussian state …

Disentangling physical dynamics from unknown factors for unsupervised video prediction

VL Guen, N Thome - … of the IEEE/CVF conference on …, 2020 - openaccess.thecvf.com
Leveraging physical knowledge described by partial differential equations (PDEs) is an
appealing way to improve unsupervised video forecasting models. Since physics is too …

Disentangling voice and content with self-supervision for speaker recognition

T Liu, KA Lee, Q Wang, H Li - Advances in Neural …, 2023 - proceedings.neurips.cc
For speaker recognition, it is difficult to extract an accurate speaker representation from
speech because of its mixture of speaker traits and content. This paper proposes a …

Augmenting physical models with deep networks for complex dynamics forecasting

Y Yin, V Le Guen, J Dona, E de Bézenac… - Journal of Statistical …, 2021 - iopscience.iop.org
Forecasting complex dynamical phenomena in settings where only partial knowledge of
their dynamics is available is a prevalent problem across various scientific fields. While …

Data-driven surrogate model with latent data assimilation: Application to wildfire forecasting

S Cheng, IC Prentice, Y Huang, Y Jin, YK Guo… - Journal of …, 2022 - Elsevier
The large and catastrophic wildfires have been increasing across the globe in the recent
decade, highlighting the importance of simulating and forecasting fire dynamics in near real …

Modeling irregular time series with continuous recurrent units

M Schirmer, M Eltayeb, S Lessmann… - … on machine learning, 2022 - proceedings.mlr.press
Recurrent neural networks (RNNs) are a popular choice for modeling sequential data.
Modern RNN architectures assume constant time-intervals between observations. However …

Generalised latent assimilation in heterogeneous reduced spaces with machine learning surrogate models

S Cheng, J Chen, C Anastasiou, P Angeli… - Journal of Scientific …, 2023 - Springer
Reduced-order modelling and low-dimensional surrogate models generated using machine
learning algorithms have been widely applied in high-dimensional dynamical systems to …

Latent sdes on homogeneous spaces

S Zeng, F Graf, R Kwitt - Advances in Neural Information …, 2024 - proceedings.neurips.cc
We consider the problem of variational Bayesian inference in a latent variable model where
a (possibly complex) observed stochastic process is governed by the unobserved solution of …

SSDNet: State space decomposition neural network for time series forecasting

Y Lin, I Koprinska, M Rana - 2021 IEEE International …, 2021 - ieeexplore.ieee.org
In this paper, we present SSDNet, a novel deep learning approach for time series
forecasting. SSDNet combines the Transformer architecture with state space models to …