Differentiable rendering: A survey

H Kato, D Beker, M Morariu, T Ando… - arXiv preprint arXiv …, 2020 - arxiv.org
Deep neural networks (DNNs) have shown remarkable performance improvements on
vision-related tasks such as object detection or image segmentation. Despite their success …

Score jacobian chaining: Lifting pretrained 2d diffusion models for 3d generation

H Wang, X Du, J Li, RA Yeh… - Proceedings of the …, 2023 - openaccess.thecvf.com
A diffusion model learns to predict a vector field of gradients. We propose to apply chain rule
on the learned gradients, and back-propagate the score of a diffusion model through the …

Lion: Latent point diffusion models for 3d shape generation

A Vahdat, F Williams, Z Gojcic… - Advances in …, 2022 - proceedings.neurips.cc
Denoising diffusion models (DDMs) have shown promising results in 3D point cloud
synthesis. To advance 3D DDMs and make them useful for digital artists, we require (i) high …

Extracting triangular 3d models, materials, and lighting from images

J Munkberg, J Hasselgren, T Shen… - Proceedings of the …, 2022 - openaccess.thecvf.com
We present an efficient method for joint optimization of topology, materials and lighting from
multi-view image observations. Unlike recent multi-view reconstruction approaches, which …

Advances in neural rendering

A Tewari, J Thies, B Mildenhall… - Computer Graphics …, 2022 - Wiley Online Library
Synthesizing photo‐realistic images and videos is at the heart of computer graphics and has
been the focus of decades of research. Traditionally, synthetic images of a scene are …

Neural geometric level of detail: Real-time rendering with implicit 3d shapes

T Takikawa, J Litalien, K Yin, K Kreis… - Proceedings of the …, 2021 - openaccess.thecvf.com
Neural signed distance functions (SDFs) are emerging as an effective representation for 3D
shapes. State-of-the-art methods typically encode the SDF with a large, fixed-size neural …

Accelerating 3d deep learning with pytorch3d

N Ravi, J Reizenstein, D Novotny, T Gordon… - arXiv preprint arXiv …, 2020 - arxiv.org
Deep learning has significantly improved 2D image recognition. Extending into 3D may
advance many new applications including autonomous vehicles, virtual and augmented …

Neural fields meet explicit geometric representations for inverse rendering of urban scenes

Z Wang, T Shen, J Gao, S Huang… - Proceedings of the …, 2023 - openaccess.thecvf.com
Reconstruction and intrinsic decomposition of scenes from captured imagery would enable
many applications such as relighting and virtual object insertion. Recent NeRF based …

Nerf: Representing scenes as neural radiance fields for view synthesis

B Mildenhall, PP Srinivasan, M Tancik… - Communications of the …, 2021 - dl.acm.org
We present a method that achieves state-of-the-art results for synthesizing novel views of
complex scenes by optimizing an underlying continuous volumetric scene function using a …

Shape, light, and material decomposition from images using monte carlo rendering and denoising

J Hasselgren, N Hofmann… - Advances in Neural …, 2022 - proceedings.neurips.cc
Recent advances in differentiable rendering have enabled high-quality reconstruction of 3D
scenes from multi-view images. Most methods rely on simple rendering algorithms: pre …