Videocomposer: Compositional video synthesis with motion controllability

X Wang, H Yuan, S Zhang, D Chen… - Advances in …, 2024 - proceedings.neurips.cc
The pursuit of controllability as a higher standard of visual content creation has yielded
remarkable progress in customizable image synthesis. However, achieving controllable …

Ccvs: Context-aware controllable video synthesis

G Le Moing, J Ponce, C Schmid - Advances in Neural …, 2021 - proceedings.neurips.cc
This presentation introduces a self-supervised learning approach to the synthesis of new
videos clips from old ones, with several new key elements for improved spatial resolution …

Show me what and tell me how: Video synthesis via multimodal conditioning

L Han, J Ren, HY Lee, F Barbieri… - Proceedings of the …, 2022 - openaccess.thecvf.com
Most methods for conditional video synthesis use a single modality as the condition. This
comes with major limitations. For example, it is problematic for a model conditioned on an …

Mostgan-v: Video generation with temporal motion styles

X Shen, X Li, M Elhoseiny - … of the IEEE/CVF Conference on …, 2023 - openaccess.thecvf.com
Video generation remains a challenging task due to spatiotemporal complexity and the
requirement of synthesizing diverse motions with temporal consistency. Previous works …

Make pixels dance: High-dynamic video generation

Y Zeng, G Wei, J Zheng, J Zou, Y Wei… - Proceedings of the …, 2024 - openaccess.thecvf.com
Creating high-dynamic videos such as motion-rich actions and sophisticated visual effects
poses a significant challenge in the field of artificial intelligence. Unfortunately current state …

Moonshot: Towards controllable video generation and editing with multimodal conditions

DJ Zhang, D Li, H Le, MZ Shou, C Xiong… - arXiv preprint arXiv …, 2024 - arxiv.org
Most existing video diffusion models (VDMs) are limited to mere text conditions. Thereby,
they are usually lacking in control over visual appearance and geometry structure of the …

Self-supervised dance video synthesis conditioned on music

X Ren, H Li, Z Huang, Q Chen - Proceedings of the 28th ACM …, 2020 - dl.acm.org
We present a self-supervised approach with pose perceptual loss for automatic dance video
generation. Our method can produce a realistic dance video that conforms to the beats and …

Video-to-video synthesis

TC Wang, MY Liu, JY Zhu, G Liu, A Tao, J Kautz… - arXiv preprint arXiv …, 2018 - arxiv.org
We study the problem of video-to-video synthesis, whose goal is to learn a mapping function
from an input source video (eg, a sequence of semantic segmentation masks) to an output …

Direct-a-video: Customized video generation with user-directed camera movement and object motion

S Yang, L Hou, H Huang, C Ma, P Wan… - arXiv preprint arXiv …, 2024 - arxiv.org
Recent text-to-video diffusion models have achieved impressive progress. In practice, users
often desire the ability to control object motion and camera movement independently for …

Make it move: controllable image-to-video generation with text descriptions

Y Hu, C Luo, Z Chen - … of the IEEE/CVF Conference on …, 2022 - openaccess.thecvf.com
Generating controllable videos conforming to user intentions is an appealing yet challenging
topic in computer vision. To enable maneuverable control in line with user intentions, a …