Predrnn: Recurrent neural networks for predictive learning using spatiotemporal lstms

Y Wang, M Long, J Wang, Z Gao… - Advances in neural …, 2017 - proceedings.neurips.cc
The predictive learning of spatiotemporal sequences aims to generate future images by
learning from the historical frames, where spatial appearances and temporal variations are …

Predrnn: A recurrent neural network for spatiotemporal predictive learning

Y Wang, H Wu, J Zhang, Z Gao, J Wang… - … on Pattern Analysis …, 2022 - ieeexplore.ieee.org
The predictive learning of spatiotemporal sequences aims to generate future images by
learning from the historical context, where the visual dynamics are believed to have modular …

Eidetic 3D LSTM: A model for video prediction and beyond

Y Wang, L Jiang, MH Yang, LJ Li, M Long… - International …, 2018 - openreview.net
Spatiotemporal predictive learning, though long considered to be a promising self-
supervised feature learning method, seldom shows its effectiveness beyond future video …

Predrnn++: Towards a resolution of the deep-in-time dilemma in spatiotemporal predictive learning

Y Wang, Z Gao, M Long, J Wang… - … on machine learning, 2018 - proceedings.mlr.press
We present PredRNN++, a recurrent network for spatiotemporal predictive learning. In
pursuit of a great modeling capability for short-term video dynamics, we make our network …

Folded recurrent neural networks for future video prediction

M Oliu, J Selva, S Escalera - Proceedings of the European …, 2018 - openaccess.thecvf.com
This work introduces double-mapping Gated Recurrent Units (dGRU), an extension of
standard GRUs where the input is considered as a recurrent state. An extra set of logic gates …

Convolutional tensor-train LSTM for spatio-temporal learning

J Su, W Byeon, J Kossaifi, F Huang… - Advances in …, 2020 - proceedings.neurips.cc
Learning from spatio-temporal data has numerous applications such as human-behavior
analysis, object tracking, video compression, and physics simulation. However, existing …

Cubic LSTMs for video prediction

H Fan, L Zhu, Y Yang - Proceedings of the AAAI conference on artificial …, 2019 - ojs.aaai.org
Predicting future frames in videos has become a promising direction of research for both
computer vision and robot learning communities. The core of this problem involves moving …

Video prediction by efficient transformers

X Ye, GA Bilodeau - Image and Vision Computing, 2023 - Elsevier
Video prediction is a challenging computer vision task that has a wide range of applications.
In this work, we present a new family of Transformer-based models for video prediction …

Simvp: Towards simple yet powerful spatiotemporal predictive learning

C Tan, Z Gao, S Li, SZ Li - arXiv preprint arXiv:2211.12509, 2022 - arxiv.org
Recent years have witnessed remarkable advances in spatiotemporal predictive learning,
incorporating auxiliary inputs, elaborate neural architectures, and sophisticated training …

Pastnet: Introducing physical inductive biases for spatio-temporal video prediction

H Wu, W Xiong, F Xu, X Luo, C Chen, XS Hua… - arXiv preprint arXiv …, 2023 - arxiv.org
In this paper, we investigate the challenge of spatio-temporal video prediction, which
involves generating future videos based on historical data streams. Existing approaches …