Videocomposer: Compositional video synthesis with motion controllability

X Wang, H Yuan, S Zhang, D Chen… - Advances in …, 2024 - proceedings.neurips.cc
… The pursuit of controllability as a higher standard of visual content creation has yielded …
in customizable image synthesis. However, achieving controllable video synthesis remains …

Ccvs: Context-aware controllable video synthesis

G Le Moing, J Ponce, C Schmid - Advances in Neural …, 2021 - proceedings.neurips.cc
Video synthesis has numerous … motion) to human-robot interaction (eg, motion prediction).
Despite the photo-realistic results of modern image synthesis models [38], video synthesis is …

Boximator: Generating rich and controllable motions for video synthesis

J Wang, Y Zhang, J Zou, Y Zeng, G Wei… - arXiv preprint arXiv …, 2024 - arxiv.org
controllable motion is a pivotal challenge in video synthesis. We propose Boximator, a new
approach for fine-grained motion … the object’s position, shape, or motion path in future frames. …

Motion-conditioned diffusion model for controllable video synthesis

TS Chen, CH Lin, HY Tseng, TY Lin… - arXiv preprint arXiv …, 2023 - arxiv.org
motion controllability of MCDiff against II2V [7] and iPOKE [6], the state-of-the-art stroke-guided
controllable video synthesis … to generate video sequences with the motions more faithfully …

Animate anyone: Consistent and controllable image-to-video synthesis for character animation

L Hu - Proceedings of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
… Pose Guider, encoding motion control signals for achieving controllable character movements; …
the continuity of character motion. ReferenceNet. In text-to-video tasks, textual prompts ar…

Moglow: Probabilistic and controllable motion synthesis using normalising flows

GE Henter, S Alexanderson, J Beskow - ACM Transactions on Graphics …, 2020 - dl.acm.org
motions even if the input signal is the same. Data-driven modelling and synthesis of motion
… This paper introduces a new class of probabilistic, generative, and controllable motion-data …

GAC-GAN: A general method for appearance-controllable human video motion transfer

D Wei, X Xu, H Shen, K Huang - IEEE Transactions on …, 2020 - ieeexplore.ieee.org
… are conditioned on the previous frames, future video motions are unconditionally generated,
which is inappropriate for the motion controllable video synthesis that HVMT concerns. …

Layered controllable video generation

J Huang, Y Jin, KM Yi, L Sigal - European Conference on Computer Vision, 2022 - Springer
… have led to impressive results in image and video synthesis. Typical forms of such models, …
in-plane motion of the object, resizing it would lead to the depth away/towards motion, and …

Controllable video generation with sparse trajectories

Z Hao, X Huang, S Belongie - Proceedings of the IEEE …, 2018 - openaccess.thecvf.com
… Given the first frame and sparse motion trajectories specified by users, our model can
synthesize a video with corresponding appearance and motion. We propose to combine the …

Controllable One-Shot Face Video Synthesis With Semantic Aware Prior

K Liu, YC Su, R Cang, X Jia - arXiv preprint arXiv:2304.14471, 2023 - arxiv.org
… is, we transfer the motion difference between neighboring frames instead of the absolution
motion. … Therefore, it is important to capture fine-grained details in face video synthesis, which …