Future video synthesis with object motion prediction

Y Wu, R Gao, J Park, Q Chen - Proceedings of the IEEE …, 2020 - openaccess.thecvf.com
… For better future prediction, we decompose moving objects and static scenes from the input
image. After extracting moving objects, the area where moving objects were placed remains …

Text-driven video prediction

X Song, J Chen, B Zhu, YG Jiang - ACM Transactions on Multimedia …, 2022 - dl.acm.org
… generation) lack constraints on both appearance and motion components to predicted
Mocogan: Decomposing motion and content for video generation. In Proceedings of the IEEE …

Dmvc: Decomposed motion modeling for learned video compression

K Lin, C Jia, X Zhang, S Wang, S Ma… - … and Systems for Video …, 2022 - ieeexplore.ieee.org
… In this paper, we innovatively model the motion representation and … neural video coding
method with decomposed motion (DMVC). More specifically, the motion can be decomposed

Video prediction recalling long-term motion context via memory alignment learning

S Lee, HG Kim, DH Choi, HI Kim… - Proceedings of the …, 2021 - openaccess.thecvf.com
… can be recalled from the limited input sequence. In addition, to resolve the bottleneck (ii),
we propose memory query decomposition to store local motion context (ie, low-dimensional …

MotionRNN: A flexible model for video prediction with spacetime-varying motions

H Wu, Z Yao, J Wang, M Long - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
… itself, making them difficult to adapt to ever-changing motions. We observe that physical
world motions can be decomposed into transient variation and motion trend, while the latter can …

Inmodegan: Interpretable motion decomposition generative adversarial network for video generation

Y Wang, F Bremond, A Dantcheva - arXiv preprint arXiv:2101.03049, 2021 - arxiv.org
… to interpret and modify the motion space. To do so, we decompose motion into semantic
sub-… Crucially, we have shown the ability of InMoDeGAN to decompose motion in semantic sub-…

Video prediction via example guidance

J Xu, H Xu, B Ni, X Yang… - … Conference on Machine …, 2020 - proceedings.mlr.press
… the ground truth motion, our model is able to predict the future motion in a more efficient way.
Meanwhile, we present more visualization results to show that predicted sequences are not …

Mau: A motion-aware unit for video prediction and beyond

Z Chang, X Zhang, S Wang, S Ma… - Advances in …, 2021 - proceedings.neurips.cc
… and decoders to help preserve the visual details of the predictions. We evaluate the MAU
on both video prediction and early action recognition tasks. Experimental results show that the …

Twostreamvan: Improving motion modeling in video generation

X Sun, H Xu, K Saenko - Proceedings of the IEEE/CVF …, 2020 - openaccess.thecvf.com
… modeling in video generation. To generate motion efficiently, we decompose content and
motion in the generation phase and fuse them via a novel multi-scale mechanism. Combined …

G3AN: Disentangling appearance and motion for video generation

Y Wang, P Bilinski, F Bremond… - Proceedings of the …, 2020 - openaccess.thecvf.com
… real videos from all datasets with the generated video sequences from our method. The
human raters ranked 25.71% of videos from our G3AN as more realistic than real videos, which …