We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

eess.IV

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Electrical Engineering and Systems Science > Image and Video Processing

Title: Spectrally Consistent UNet for High Fidelity Image Transformations

Abstract: Convolutional Neural Networks (CNNs) are the current de-facto models used for many imaging tasks due to their high learning capacity as well as their architectural qualities. The ubiquitous UNet architecture provides an efficient and multi-scale solution that combines local and global information. Despite the success of UNet architectures, the use of upsampling layers can cause artefacts. In this work, a method for assessing the structural biases of UNets and the effects these have on the outputs is presented, characterising their impact in the Fourier domain. A new upsampling module is proposed, based on a novel use of the Guided Image Filter, that provides spectrally consistent outputs when used in a UNet architecture, forming the Guided UNet (GUNet). The GUNet architecture is applied and evaluated for example applications of inverse tone mapping/dynamic range expansion and colourisation from grey-scale images and is shown to provide higher fidelity outputs.
Subjects: Image and Video Processing (eess.IV); Graphics (cs.GR); Machine Learning (cs.LG); Machine Learning (stat.ML)
Cite as: arXiv:2004.10696 [eess.IV]
  (or arXiv:2004.10696v2 [eess.IV] for this version)

Submission history

From: Demetris Marnerides [view email]
[v1] Wed, 22 Apr 2020 17:04:02 GMT (8653kb,D)
[v2] Tue, 29 Sep 2020 09:32:09 GMT (19399kb,D)

Link back to: arXiv, form interface, contact.