Spectral imaging with deep learning

L Huang, R Luo, X Liu, X Hao - Light: Science & Applications, 2022 - nature.com
The goal of spectral imaging is to capture the spectral signature of a target. Traditional
scanning method for spectral imaging suffers from large system volume and low image …

At the intersection of optics and deep learning: statistical inference, computing, and inverse design

D Mengu, MS Sakib Rahman, Y Luo, J Li… - Advances in Optics …, 2022 - opg.optica.org
Deep learning has been revolutionizing information processing in many fields of science
and engineering owing to the massively growing amounts of data and the advances in deep …

Image sensing with multilayer nonlinear optical neural networks

T Wang, MM Sohoni, LG Wright, MM Stein, SY Ma… - Nature …, 2023 - nature.com
Optical imaging is commonly used for both scientific and technological applications across
industry and academia. In image sensing, a measurement, such as of an object's position or …

[PDF][PDF] End-to-end complex lens design with differentiable ray tracing

Q Sun, C Wang, F Qiang, D Xiong, H Wolfgang - ACM Trans. Graph, 2021 - vccimaging.org
Cameras are designed with a complicated tradeoff between image quality (eg sharpness,
contrast, color fidelity), and practical considerations such as cost, form factor, and weight …

Universal linear intensity transformations using spatially incoherent diffractive processors

MSS Rahman, X Yang, J Li, B Bai… - Light: Science & …, 2023 - nature.com
Under spatially coherent light, a diffractive optical network composed of structured surfaces
can be designed to perform any arbitrary complex-valued linear transformation between its …

Miniature color camera via flat hybrid meta-optics

S Pinilla, JE Fröch, SR Miri Rostami, V Katkovnik… - Science …, 2023 - science.org
The race for miniature color cameras using flat meta-optics has rapidly developed the end-to-
end design framework using neural networks. Although a large body of work has shown the …

Depth from defocus with learned optics for imaging and occlusion-aware depth estimation

H Ikoma, CM Nguyen, CA Metzler… - 2021 IEEE …, 2021 - ieeexplore.ieee.org
Monocular depth estimation remains a challenging problem, despite significant advances in
neural network architectures that leverage pictorial depth cues alone. Inspired by depth from …

Curriculum learning for ab initio deep learned refractive optics

X Yang, Q Fu, W Heidrich - Nature communications, 2024 - nature.com
Deep optical optimization has recently emerged as a new paradigm for designing
computational imaging systems using only the output image as the objective. However, it …

Split-aperture 2-in-1 computational cameras

Z Shi, I Chugunov, M Bijelic, G Côté, J Yeom… - ACM Transactions on …, 2024 - dl.acm.org
While conventional cameras offer versatility for applications ranging from amateur
photography to autonomous driving, computational cameras allow for domain-specific …

Quantization-aware deep optics for diffractive snapshot hyperspectral imaging

L Li, L Wang, W Song, L Zhang… - Proceedings of the …, 2022 - openaccess.thecvf.com
Diffractive snapshot hyperspectral imaging based on the deep optics framework has been
striving to capture the spectral images of dynamic scenes. However, existing deep optics …