Incorporating physics into data-driven computer vision

A Kadambi, C de Melo, CJ Hsieh… - Nature Machine …, 2023 - nature.com
Many computer vision techniques infer properties of our physical world from images.
Although images are formed through the physics of light and mechanics, computer vision …

Glass segmentation using intensity and spectral polarization cues

H Mei, B Dong, W Dong, J Yang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Transparent and semi-transparent materials pose significant challenges for existing scene
understanding and segmentation algorithms due to their lack of RGB texture which impedes …

Deep polarization imaging for 3d shape and svbrdf acquisition

V Deschaintre, Y Lin, A Ghosh - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
We present a novel method for efficient acquisition of shape and spatially varying
reflectance of 3D objects using polarization cues. Unlike previous works that have exploited …

Event-based shape from polarization

M Muglikar, L Bauersfeld, DP Moeys… - Proceedings of the …, 2023 - openaccess.thecvf.com
State-of-the-art solutions for Shape-from-Polarization (SfP) suffer from a speed-resolution
tradeoff: they either sacrifice the number of polarization angles measured or necessitate …

Sparse ellipsometry: portable acquisition of polarimetric SVBRDF and shape with unstructured flash photography

I Hwang, DS Jeon, A Munoz, D Gutierrez… - ACM Transactions on …, 2022 - dl.acm.org
Ellipsometry techniques allow to measure polarization information of materials, requiring
precise rotations of optical components with different configurations of lights and sensors …

Multi-view Spectral Polarization Propagation for Video Glass Segmentation

Y Qiao, B Dong, A Jin, Y Fu, SH Baek… - Proceedings of the …, 2023 - openaccess.thecvf.com
In this paper, we present the first polarization-guided video glass segmentation propagation
solution (PGVS-Net) that can robustly and coherently propagate glass segmentation in RGB …

Polarimetric itof: Measuring high-fidelity depth through scattering media

DS Jeon, A Meuleman, SH Baek… - Proceedings of the …, 2023 - openaccess.thecvf.com
Indirect time-of-flight (iToF) imaging allows us to capture dense depth information at a low
cost. However, iToF imaging often suffers from multipath interference (MPI) artifacts in the …

Pisr: Polarimetric neural implicit surface reconstruction for textureless and specular objects

G Chen, Y He, L He, H Zhang - European Conference on Computer Vision, 2024 - Springer
Neural implicit surface reconstruction has achieved remarkable progress recently. Despite
resorting to complex radiance modeling, state-of-the-art methods still struggle with …

End-to-end neural network for pBRDF estimation of object to reconstruct polarimetric reflectance

J Duan, Y Hao, J Liu, C Cheng, Q Fu, H Jiang - Optics Express, 2023 - opg.optica.org
Estimating the polarization properties of objects from polarization images is still an important
but extremely undefined problem. Currently, there are two types of methods to probe the …

Polarimetric helmholtz stereopsis

Y Ding, Y Ji, M Zhou, SB Kang… - Proceedings of the IEEE …, 2021 - openaccess.thecvf.com
Helmholtz stereopsis (HS) exploits the reciprocity principle of light propagation (ie, the
Helmholtz reciprocity) for 3D reconstruction of surfaces with arbitrary reflectance. In this …