Dreamreward: Text-to-3d generation with human preference
Abstract 3D content creation from text prompts has shown remarkable success recently.
However, current text-to-3D methods often generate 3D results that do not align well with …
However, current text-to-3D methods often generate 3D results that do not align well with …
Efficient diffusion models: A comprehensive survey from principles to practices
Z Ma, Y Zhang, G Jia, L Zhao, Y Ma, M Ma… - arXiv preprint arXiv …, 2024 - arxiv.org
As one of the most popular and sought-after generative models in the recent years, diffusion
models have sparked the interests of many researchers and steadily shown excellent …
models have sparked the interests of many researchers and steadily shown excellent …
Direct unlearning optimization for robust and safe text-to-image models
Recent advancements in text-to-image (T2I) models have greatly benefited from large-scale
datasets, but they also pose significant risks due to the potential generation of unsafe …
datasets, but they also pose significant risks due to the potential generation of unsafe …
Alignment of diffusion models: Fundamentals, challenges, and future
Diffusion models have emerged as the leading paradigm in generative modeling, excelling
in various applications. Despite their success, these models often misalign with human …
in various applications. Despite their success, these models often misalign with human …
Lodge: A coarse to fine diffusion network for long dance generation guided by the characteristic dance primitives
We propose Lodge a network capable of generating extremely long dance sequences
conditioned on given music. We design Lodge as a two-stage coarse to fine diffusion …
conditioned on given music. We design Lodge as a two-stage coarse to fine diffusion …
Feedback efficient online fine-tuning of diffusion models
Diffusion models excel at modeling complex data distributions, including those of images,
proteins, and small molecules. However, in many cases, our goal is to model parts of the …
proteins, and small molecules. However, in many cases, our goal is to model parts of the …
Itercomp: Iterative composition-aware feedback learning from model gallery for text-to-image generation
Advanced diffusion models like RPG, Stable Diffusion 3 and FLUX have made notable
strides in compositional text-to-image generation. However, these methods typically exhibit …
strides in compositional text-to-image generation. However, these methods typically exhibit …
Aligning diffusion models by optimizing human utility
We present Diffusion-KTO, a novel approach for aligning text-to-image diffusion models by
formulating the alignment objective as the maximization of expected human utility. Since this …
formulating the alignment objective as the maximization of expected human utility. Since this …
Next Token Prediction Towards Multimodal Intelligence: A Comprehensive Survey
Building on the foundations of language modeling in natural language processing, Next
Token Prediction (NTP) has evolved into a versatile training objective for machine learning …
Token Prediction (NTP) has evolved into a versatile training objective for machine learning …
Improving Dynamic Object Interactions in Text-to-Video Generation with AI Feedback
Large text-to-video models hold immense potential for a wide range of downstream
applications. However, these models struggle to accurately depict dynamic object …
applications. However, these models struggle to accurately depict dynamic object …