Current browse context:
eess.IV
Change to browse by:
References & Citations
Electrical Engineering and Systems Science > Image and Video Processing
Title: Spectrally Consistent UNet for High Fidelity Image Transformations
(Submitted on 22 Apr 2020 (v1), last revised 29 Sep 2020 (this version, v2))
Abstract: Convolutional Neural Networks (CNNs) are the current de-facto models used for many imaging tasks due to their high learning capacity as well as their architectural qualities. The ubiquitous UNet architecture provides an efficient and multi-scale solution that combines local and global information. Despite the success of UNet architectures, the use of upsampling layers can cause artefacts. In this work, a method for assessing the structural biases of UNets and the effects these have on the outputs is presented, characterising their impact in the Fourier domain. A new upsampling module is proposed, based on a novel use of the Guided Image Filter, that provides spectrally consistent outputs when used in a UNet architecture, forming the Guided UNet (GUNet). The GUNet architecture is applied and evaluated for example applications of inverse tone mapping/dynamic range expansion and colourisation from grey-scale images and is shown to provide higher fidelity outputs.
Submission history
From: Demetris Marnerides [view email][v1] Wed, 22 Apr 2020 17:04:02 GMT (8653kb,D)
[v2] Tue, 29 Sep 2020 09:32:09 GMT (19399kb,D)
Link back to: arXiv, form interface, contact.