We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.CV

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Computer Vision and Pattern Recognition

Title: In-Domain GAN Inversion for Real Image Editing

Abstract: Recent work has shown that a variety of semantics emerge in the latent space of Generative Adversarial Networks (GANs) when being trained to synthesize images. However, it is difficult to use these learned semantics for real image editing. A common practice of feeding a real image to a trained GAN generator is to invert it back to a latent code. However, existing inversion methods typically focus on reconstructing the target image by pixel values yet fail to land the inverted code in the semantic domain of the original latent space. As a result, the reconstructed image cannot well support semantic editing through varying the inverted code. To solve this problem, we propose an in-domain GAN inversion approach, which not only faithfully reconstructs the input image but also ensures the inverted code to be semantically meaningful for editing. We first learn a novel domain-guided encoder to project a given image to the native latent space of GANs. We then propose domain-regularized optimization by involving the encoder as a regularizer to fine-tune the code produced by the encoder and better recover the target image. Extensive experiments suggest that our inversion method achieves satisfying real image reconstruction and more importantly facilitates various image editing tasks, significantly outperforming start-of-the-arts.
Comments: ECCV 2020 camera-ready
Subjects: Computer Vision and Pattern Recognition (cs.CV)
Cite as: arXiv:2004.00049 [cs.CV]
  (or arXiv:2004.00049v3 [cs.CV] for this version)

Submission history

From: Yujun Shen [view email]
[v1] Tue, 31 Mar 2020 18:20:18 GMT (6532kb,D)
[v2] Mon, 11 May 2020 20:16:32 GMT (7767kb,D)
[v3] Thu, 16 Jul 2020 09:47:36 GMT (7342kb,D)

Link back to: arXiv, form interface, contact.