References & Citations
Computer Science > Computer Vision and Pattern Recognition
Title: MPG: A Multi-ingredient Pizza Image Generator with Conditional StyleGANs
(Submitted on 4 Dec 2020 (v1), last revised 6 Oct 2021 (this version, v2))
Abstract: Multilabel conditional image generation is a challenging problem in computer vision. In this work we propose Multi-ingredient Pizza Generator (MPG), a conditional Generative Neural Network (GAN) framework for synthesizing multilabel images. We design MPG based on a state-of-the-art GAN structure called StyleGAN2, in which we develop a new conditioning technique by enforcing intermediate feature maps to learn scalewise label information. Because of the complex nature of the multilabel image generation problem, we also regularize synthetic image by predicting the corresponding ingredients as well as encourage the discriminator to distinguish between matched image and mismatched image. To verify the efficacy of MPG, we test it on Pizza10, which is a carefully annotated multi-ingredient pizza image dataset. MPG can successfully generate photo-realist pizza images with desired ingredients. The framework can be easily extend to other multilabel image generation scenarios.
Submission history
From: Fangda Han [view email][v1] Fri, 4 Dec 2020 19:51:31 GMT (24235kb,D)
[v2] Wed, 6 Oct 2021 00:48:37 GMT (34493kb,D)
Link back to: arXiv, form interface, contact.