Score jacobian chaining: Lifting pretrained 2d diffusion models for 3d generation

H Wang, X Du, J Li, RA Yeh… - Proceedings of the …, 2023 - openaccess.thecvf.com
A diffusion model learns to predict a vector field of gradients. We propose to apply chain rule
on the learned gradients, and back-propagate the score of a diffusion model through the …

Holodiffusion: Training a 3d diffusion model using 2d images

A Karnewar, A Vedaldi, D Novotny… - Proceedings of the …, 2023 - openaccess.thecvf.com
Diffusion models have emerged as the best approach for generative modeling of 2D images.
Part of their success is due to the possibility of training them on millions if not billions of …

Control3diff: Learning controllable 3d diffusion models from single-view images

J Gu, Q Gao, S Zhai, B Chen, L Liu… - … Conference on 3D …, 2024 - ieeexplore.ieee.org
Diffusion models have recently become the de-facto approach for generative modeling in
the 2D domain. However, extending diffusion models to 3D is challenging, due to the …

Holofusion: Towards photo-realistic 3d generative modeling

A Karnewar, NJ Mitra, A Vedaldi… - Proceedings of the …, 2023 - openaccess.thecvf.com
Diffusion-based image generators can now produce high-quality and diverse samples, but
their success has yet to fully translate to 3D generation: existing diffusion methods can either …

Stag4d: Spatial-temporal anchored generative 4d gaussians

Y Zeng, Y Jiang, S Zhu, Y Lu, Y Lin, H Zhu… - arXiv preprint arXiv …, 2024 - arxiv.org
Recent progress in pre-trained diffusion models and 3D generation have spurred interest in
4D content creation. However, achieving high-fidelity 4D generation with spatial-temporal …

Viewset diffusion:(0-) image-conditioned 3d generative models from 2d data

S Szymanowicz, C Rupprecht… - Proceedings of the …, 2023 - openaccess.thecvf.com
Abstract We present Viewset Diffusion, a diffusion-based generator that outputs 3D objects
while only using multi-view 2D data for supervision. We note that there exists a one-to-one …

Renderdiffusion: Image diffusion for 3d reconstruction, inpainting and generation

T Anciukevičius, Z Xu, M Fisher… - Proceedings of the …, 2023 - openaccess.thecvf.com
Diffusion models currently achieve state-of-the-art performance for both conditional and
unconditional image generation. However, so far, image diffusion models do not support …

Cad: Photorealistic 3d generation via adversarial distillation

Z Wan, D Paschalidou, I Huang, H Liu… - Proceedings of the …, 2024 - openaccess.thecvf.com
The increased demand for 3D data in AR/VR robotics and gaming applications gave rise to
powerful generative pipelines capable of synthesizing high-quality 3D objects. Most of these …

Let us build bridges: Understanding and extending diffusion generative models

X Liu, L Wu, M Ye, Q Liu - arXiv preprint arXiv:2208.14699, 2022 - arxiv.org
Diffusion-based generative models have achieved promising results recently, but raise an
array of open questions in terms of conceptual understanding, theoretical analysis, algorithm …

Make-it-3d: High-fidelity 3d creation from a single image with diffusion prior

J Tang, T Wang, B Zhang, T Zhang… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this work, we investigate the problem of creating high-fidelity 3D content from only a single
image. This is inherently challenging: it essentially involves estimating the underlying 3D …