State of the art on diffusion models for visual computing

R Po, W Yifan, V Golyanik, K Aberman… - Computer Graphics …, 2024 - Wiley Online Library
The field of visual computing is rapidly advancing due to the emergence of generative
artificial intelligence (AI), which unlocks unprecedented capabilities for the generation …

Single image 3D object reconstruction based on deep learning: A review

K Fu, J Peng, Q He, H Zhang - Multimedia Tools and Applications, 2021 - Springer
The reconstruction of 3D object from a single image is an important task in the field of
computer vision. In recent years, 3D reconstruction of single image using deep learning …

Objaverse: A universe of annotated 3d objects

M Deitke, D Schwenk, J Salvador… - Proceedings of the …, 2023 - openaccess.thecvf.com
Massive data corpora like WebText, Wikipedia, Conceptual Captions, WebImageText, and
LAION have propelled recent dramatic progress in AI. Large neural models trained on such …

Score jacobian chaining: Lifting pretrained 2d diffusion models for 3d generation

H Wang, X Du, J Li, RA Yeh… - Proceedings of the …, 2023 - openaccess.thecvf.com
A diffusion model learns to predict a vector field of gradients. We propose to apply chain rule
on the learned gradients, and back-propagate the score of a diffusion model through the …

Lion: Latent point diffusion models for 3d shape generation

A Vahdat, F Williams, Z Gojcic… - Advances in …, 2022 - proceedings.neurips.cc
Denoising diffusion models (DDMs) have shown promising results in 3D point cloud
synthesis. To advance 3D DDMs and make them useful for digital artists, we require (i) high …

Sdfusion: Multimodal 3d shape completion, reconstruction, and generation

YC Cheng, HY Lee, S Tulyakov… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this work, we present a novel framework built to simplify 3D asset generation for amateur
users. To enable interactive generation, our method supports a variety of input modalities …

Diffrf: Rendering-guided 3d radiance field diffusion

N Müller, Y Siddiqui, L Porzi, SR Bulo… - Proceedings of the …, 2023 - openaccess.thecvf.com
We introduce DiffRF, a novel approach for 3D radiance field synthesis based on denoising
diffusion probabilistic models. While existing diffusion-based methods operate on images …

Scalable 3d captioning with pretrained models

T Luo, C Rockwell, H Lee… - Advances in Neural …, 2024 - proceedings.neurips.cc
We introduce Cap3D, an automatic approach for generating descriptive text for 3D objects.
This approach utilizes pretrained models from image captioning, image-text alignment, and …

Google scanned objects: A high-quality dataset of 3d scanned household items

L Downs, A Francis, N Koenig, B Kinman… - … on Robotics and …, 2022 - ieeexplore.ieee.org
Interactive 3D simulations have enabled break-throughs in robotics and computer vision, but
simulating the broad diversity of environments needed for deep learning requires large …

Autosdf: Shape priors for 3d completion, reconstruction and generation

P Mittal, YC Cheng, M Singh… - Proceedings of the …, 2022 - openaccess.thecvf.com
Powerful priors allow us to perform inference with insufficient information. In this paper, we
propose an autoregressive prior for 3D shapes to solve multimodal 3D tasks such as shape …