The Crystal Ball Hypothesis in diffusion models: Anticipating object positions from initial noise

Y Ban, R Wang, T Zhou, B Gong, CJ Hsieh… - arXiv preprint arXiv …, 2024 - arxiv.org
Diffusion models have achieved remarkable success in text-to-image generation tasks;
however, the role of initial noise has been rarely explored. In this study, we identify specific …