Neural lighting simulation for urban scenes

A Pun, G Sun, J Wang, Y Chen… - Advances in …, 2024 - proceedings.neurips.cc
Different outdoor illumination conditions drastically alter the appearance of urban scenes,
and they can harm the performance of image-based robot perception systems if not seen …

Physically-based editing of indoor scene lighting from a single image

Z Li, J Shi, S Bi, R Zhu, K Sunkavalli, M Hašan… - … on Computer Vision, 2022 - Springer
We present a method to edit complex indoor lighting from a single image with its predicted
depth and light source segmentation masks. This is an extremely challenging problem that …

Deferred neural lighting: free-viewpoint relighting from unstructured photographs

D Gao, G Chen, Y Dong, P Peers, K Xu… - ACM Transactions on …, 2020 - dl.acm.org
We present deferred neural lighting, a novel method for free-viewpoint relighting from
unstructured photographs of a scene captured with handheld devices. Our method …

Neural light field estimation for street scenes with differentiable virtual object insertion

Z Wang, W Chen, D Acuna, J Kautz, S Fidler - European Conference on …, 2022 - Springer
We consider the challenging problem of outdoor lighting estimation for the goal of
photorealistic virtual object insertion into photographs. Existing works on outdoor lighting …

DarkGS: Learning Neural Illumination and 3D Gaussians Relighting for Robotic Exploration in the Dark

T Zhang, K Huang, W Zhi… - arXiv preprint arXiv …, 2024 - arxiv.org
Humans have the remarkable ability to construct consistent mental models of an
environment, even under limited or varying levels of illumination. We wish to endow robots …

Neural illumination: Lighting prediction for indoor environments

S Song, T Funkhouser - … of the IEEE/CVF Conference on …, 2019 - openaccess.thecvf.com
This paper addresses the task of estimating the light arriving from all directions to a 3D point
observed at a selected pixel in an RGB image. This task is challenging because it requires …

Free-viewpoint indoor neural relighting from multi-view stereo

J Philip, S Morgenthaler, M Gharbi… - ACM Transactions on …, 2021 - dl.acm.org
We introduce a neural relighting algorithm for captured indoors scenes, that allows
interactive free-viewpoint navigation. Our method allows illumination to be changed …

Nerfactor: Neural factorization of shape and reflectance under an unknown illumination

X Zhang, PP Srinivasan, B Deng, P Debevec… - ACM Transactions on …, 2021 - dl.acm.org
We address the problem of recovering the shape and spatially-varying reflectance of an
object from multi-view images (and their camera poses) of an object illuminated by one …

[PDF][PDF] Multi-view relighting using a geometry-aware network.

J Philip, M Gharbi, T Zhou, AA Efros… - ACM Trans. Graph., 2019 - repo-sam.inria.fr
Changing the illumination of an outdoor image is a notoriously difficult problem that requires
the lighting to be modified consistently across the image, and shadows to be removed and …

Nerv: Neural reflectance and visibility fields for relighting and view synthesis

PP Srinivasan, B Deng, X Zhang… - Proceedings of the …, 2021 - openaccess.thecvf.com
We present a method that takes as input a set of images of a scene illuminated by
unconstrained known lighting, and produces as output a 3D representation that can be …