Exploiting Diffusion Prior for Generalizable Dense Prediction

HY Lee, HY Tseng, MH Yang - Proceedings of the IEEE …, 2024 - openaccess.thecvf.com
Contents generated by recent advanced Text-to-Image (T2I) diffusion models are sometimes
too imaginative for existing off-the-shelf dense predictors to estimate due to the immitigable …

Estimating reflectance layer from a single image: Integrating reflectance guidance and shadow/specular aware learning

Y Jin, R Li, W Yang, RT Tan - Proceedings of the AAAI Conference on …, 2023 - ojs.aaai.org
Estimating the reflectance layer from a single image is a challenging task. It becomes more
challenging when the input image contains shadows or specular highlights, which often …

Intrinsic image decomposition via ordinal shading

C Careaga, Y Aksoy - ACM Transactions on Graphics, 2023 - dl.acm.org
Intrinsic decomposition is a fundamental mid-level vision problem that plays a crucial role in
various inverse rendering and computational photography pipelines. Generating highly …

A decoupled multi-task network for shadow removal

J Liu, Q Wang, H Fan, W Li, L Qu… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Shadow removal, which aims to restore the illumination in shadow regions, is challenging
due to the diversity of shadows in terms of location, intensity, shape, and size. Different from …

Intrinsicdiffusion: Joint intrinsic layers from latent diffusion models

J Luo, D Ceylan, JS Yoon, N Zhao, J Philip… - ACM SIGGRAPH 2024 …, 2024 - dl.acm.org
Reasoning about the intrinsic properties of an image, such as albedo, illumination, and
surface geometry, is a long-standing problem with many applications in image editing and …

Exploiting Diffusion Prior for Generalizable Dense Prediction

HY Lee, HY Tseng, MH Yang - arXiv preprint arXiv:2311.18832, 2023 - arxiv.org
Contents generated by recent advanced Text-to-Image (T2I) diffusion models are sometimes
too imaginative for existing off-the-shelf dense predictors to estimate due to the immitigable …

IDTransformer: Transformer for Intrinsic Image Decomposition

P Das, M Gevers, S Karaoglu… - Proceedings of the …, 2023 - openaccess.thecvf.com
The aim of intrinsic image decomposition (IID) is to recover reflectance and the shading from
a given image. As different combinations are possible, IID is an under constrained problem …

Retinex-diffusion: On controlling illumination conditions in diffusion models via retinex theory

X Xing, VT Hu, JH Metzen, K Groh, S Karaoglu… - arXiv preprint arXiv …, 2024 - arxiv.org
This paper introduces a novel approach to illumination manipulation in diffusion models,
addressing the gap in conditional image generation with a focus on lighting conditions. We …

A general albedo recovery approach for aerial photogrammetric images through inverse rendering

S Song, R Qin - ISPRS Journal of Photogrammetry and Remote …, 2024 - Elsevier
Modeling outdoor scenes for the synthetic 3D environment requires the recovery of
reflectance/albedo information from raw images, which is an ill-posed problem due to the …

Intrinsic Appearance Decomposition Using Point Cloud Representation

X Xing, K Groh, S Karaoglu… - Proceedings of the IEEE …, 2023 - openaccess.thecvf.com
The aim of intrinsic decomposition is to deduce the albedo and shading components,
typically from 2D images. However, this task is ill-posed, necessitating previous methods to …