Freeinit: Bridging initialization gap in video diffusion models
Though diffusion-based video generation has witnessed rapid progress, the inference
results of existing models still exhibit unsatisfactory temporal consistency and unnatural …
results of existing models still exhibit unsatisfactory temporal consistency and unnatural …
Vlogger: Make your dream a vlog
In this work we present Vlogger a generic AI system for generating a minute-level video blog
(ie vlog) of user descriptions. Different from short videos with a few seconds vlog often …
(ie vlog) of user descriptions. Different from short videos with a few seconds vlog often …
Loong: Generating minute-level long videos with autoregressive language models
It is desirable but challenging to generate content-rich long videos in the scale of minutes.
Autoregressive large language models (LLMs) have achieved great success in generating …
Autoregressive large language models (LLMs) have achieved great success in generating …
Consisti2v: Enhancing visual consistency for image-to-video generation
Image-to-video (I2V) generation aims to use the initial frame (alongside a text prompt) to
create a video sequence. A grand challenge in I2V generation is to maintain visual …
create a video sequence. A grand challenge in I2V generation is to maintain visual …
ART-V: Auto-Regressive Text-to-Video Generation with Diffusion Models
We present ART-V an efficient framework for auto-regressive video generation with diffusion
models. Unlike existing methods that generate entire videos in one-shot ART-V generates a …
models. Unlike existing methods that generate entire videos in one-shot ART-V generates a …
Moviedreamer: Hierarchical generation for coherent long visual sequence
Recent advancements in video generation have primarily leveraged diffusion models for
short-duration content. However, these approaches often fall short in modeling complex …
short-duration content. However, these approaches often fall short in modeling complex …
Freelong: Training-free long video generation with spectralblend temporal attention
Video diffusion models have made substantial progress in various video generation
applications. However, training models for long video generation tasks require significant …
applications. However, training models for long video generation tasks require significant …
Streamingt2v: Consistent, dynamic, and extendable long video generation from text
R Henschel, L Khachatryan, D Hayrapetyan… - arXiv preprint arXiv …, 2024 - arxiv.org
Text-to-video diffusion models enable the generation of high-quality videos that follow text
instructions, making it easy to create diverse and individual content. However, existing …
instructions, making it easy to create diverse and individual content. However, existing …
Evaluation of text-to-video generation models: A dynamics perspective
Comprehensive and constructive evaluation protocols play an important role in the
development of sophisticated text-to-video (T2V) generation models. Existing evaluation …
development of sophisticated text-to-video (T2V) generation models. Existing evaluation …
Freetraj: Tuning-free trajectory control in video diffusion models
Diffusion model has demonstrated remarkable capability in video generation, which further
sparks interest in introducing trajectory control into the generation process. While existing …
sparks interest in introducing trajectory control into the generation process. While existing …