Current browse context:
cs.CV
Change to browse by:
References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: Texture Synthesis with Spatial Generative Adversarial Networks
(Submitted on 24 Nov 2016 (v1), last revised 8 Sep 2017 (this version, v4))
Abstract: Generative adversarial networks (GANs) are a recent approach to train generative models of data, which have been shown to work particularly well on image data. In the current paper we introduce a new model for texture synthesis based on GAN learning. By extending the input noise distribution space from a single vector to a whole spatial tensor, we create an architecture with properties well suited to the task of texture synthesis, which we call spatial GAN (SGAN). To our knowledge, this is the first successful completely data-driven texture synthesis method based on GANs.
Our method has the following features which make it a state of the art algorithm for texture synthesis: high image quality of the generated textures, very high scalability w.r.t. the output texture size, fast real-time forward generation, the ability to fuse multiple diverse source images in complex textures. To illustrate these capabilities we present multiple experiments with different classes of texture images and use cases. We also discuss some limitations of our method with respect to the types of texture images it can synthesize, and compare it to other neural techniques for texture generation.
Submission history
From: Nikolay Jetchev [view email][v1] Thu, 24 Nov 2016 15:01:42 GMT (5479kb,D)
[v2] Thu, 1 Dec 2016 11:32:11 GMT (5479kb,D)
[v3] Thu, 18 May 2017 13:42:04 GMT (5479kb,D)
[v4] Fri, 8 Sep 2017 15:09:52 GMT (5479kb,D)
Link back to: arXiv, form interface, contact.