Pixart-\sigma: Weak-to-strong training of diffusion transformer for 4k text-to-image generation
In this paper, we introduce PixArt-\Sigma, a Diffusion Transformer model~(DiT) capable of
directly generating images at 4K resolution. PixArt-\Sigma represents a significant …
directly generating images at 4K resolution. PixArt-\Sigma represents a significant …
Generative flows on discrete state-spaces: Enabling multimodal flows with applications to protein co-design
Combining discrete and continuous data is an important capability for generative models.
We present Discrete Flow Models (DFMs), a new flow-based model of discrete data that …
We present Discrete Flow Models (DFMs), a new flow-based model of discrete data that …
Diffusion models meet remote sensing: Principles, methods, and perspectives
As a newly emerging advance in deep generative models, diffusion models have achieved
state-of-the-art results in many fields, including computer vision, natural language …
state-of-the-art results in many fields, including computer vision, natural language …
A survey on diffusion models for time series and spatio-temporal data
The study of time series data is crucial for understanding trends and anomalies over time,
enabling predictive insights across various sectors. Spatio-temporal data, on the other hand …
enabling predictive insights across various sectors. Spatio-temporal data, on the other hand …
Diffusion-rwkv: Scaling rwkv-like architectures for diffusion models
Transformers have catalyzed advancements in computer vision and natural language
processing (NLP) fields. However, substantial computational complexity poses limitations for …
processing (NLP) fields. However, substantial computational complexity poses limitations for …
VisionLLaMA: A Unified LLaMA Interface for Vision Tasks
Large language models are built on top of a transformer-based architecture to process
textual inputs. For example, the LLaMA stands out among many open-source …
textual inputs. For example, the LLaMA stands out among many open-source …
Mora: Enabling generalist video generation via a multi-agent framework
Sora is the first large-scale generalist video generation model that garnered significant
attention across society. Since its launch by OpenAI in February 2024, no other video …
attention across society. Since its launch by OpenAI in February 2024, no other video …
On statistical rates and provably efficient criteria of latent diffusion transformers (dits)
We investigate the statistical and computational limits of latent\textbf {Di} ffusion\textbf {T}
ransformers (\textbf {DiT} s) under the low-dimensional linear latent space assumption …
ransformers (\textbf {DiT} s) under the low-dimensional linear latent space assumption …
Puppet-Master: Scaling Interactive Video Generation as a Motion Prior for Part-Level Dynamics
We present Puppet-Master, an interactive video generative model that can serve as a motion
prior for part-level dynamics. At test time, given a single image and a sparse set of motion …
prior for part-level dynamics. At test time, given a single image and a sparse set of motion …
SimpleSpeech 2: Towards Simple and Efficient Text-to-Speech with Flow-based Scalar Latent Transformer Diffusion Models
Scaling Text-to-speech (TTS) to large-scale datasets has been demonstrated as an effective
method for improving the diversity and naturalness of synthesized speech. At the high level …
method for improving the diversity and naturalness of synthesized speech. At the high level …