References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Spatially-Varying Outdoor Lighting Estimation from Intrinsics
(Submitted on 9 Apr 2021 (v1), last revised 28 Apr 2021 (this version, v2))
Abstract: We present SOLID-Net, a neural network for spatially-varying outdoor lighting estimation from a single outdoor image for any 2D pixel location. Previous work has used a unified sky environment map to represent outdoor lighting. Instead, we generate spatially-varying local lighting environment maps by combining global sky environment map with warped image information according to geometric information estimated from intrinsics. As no outdoor dataset with image and local lighting ground truth is readily available, we introduce the SOLID-Img dataset with physically-based rendered images and their corresponding intrinsic and lighting information. We train a deep neural network to regress intrinsic cues with physically-based constraints and use them to conduct global and local lightings estimation. Experiments on both synthetic and real datasets show that SOLID-Net significantly outperforms previous methods.
Submission history
From: Yongjie Zhu [view email][v1] Fri, 9 Apr 2021 02:28:54 GMT (44750kb,D)
[v2] Wed, 28 Apr 2021 05:22:29 GMT (27910kb,D)
Link back to: arXiv, form interface, contact.