Current browse context:
eess.IV
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Image and Video Processing
Title: How to Train Neural Networks for Flare Removal
(Submitted on 25 Nov 2020 (v1), last revised 8 Oct 2021 (this version, v4))
Abstract: When a camera is pointed at a strong light source, the resulting photograph may contain lens flare artifacts. Flares appear in a wide variety of patterns (halos, streaks, color bleeding, haze, etc.) and this diversity in appearance makes flare removal challenging. Existing analytical solutions make strong assumptions about the artifact's geometry or brightness, and therefore only work well on a small subset of flares. Machine learning techniques have shown success in removing other types of artifacts, like reflections, but have not been widely applied to flare removal due to the lack of training data. To solve this problem, we explicitly model the optical causes of flare either empirically or using wave optics, and generate semi-synthetic pairs of flare-corrupted and clean images. This enables us to train neural networks to remove lens flare for the first time. Experiments show our data synthesis approach is critical for accurate flare removal, and that models trained with our technique generalize well to real lens flares across different scenes, lighting conditions, and cameras.
Submission history
From: Yicheng Wu [view email][v1] Wed, 25 Nov 2020 02:23:50 GMT (14346kb,D)
[v2] Thu, 26 Nov 2020 03:02:42 GMT (14346kb,D)
[v3] Tue, 30 Mar 2021 13:55:52 GMT (15955kb,D)
[v4] Fri, 8 Oct 2021 00:48:27 GMT (15959kb,D)
Link back to: arXiv, form interface, contact.