Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: RG-Flow: A hierarchical and explainable flow model based on renormalization group and sparse prior
(Submitted on 30 Sep 2020 (v1), revised 2 Oct 2020 (this version, v2), latest version 15 Aug 2022 (v5))
Abstract: Flow-based generative models have become an important class of unsupervised learning approaches. In this work, we incorporate the key idea of renormalization group (RG) and sparse prior distribution to design a hierarchical flow-based generative model, called RG-Flow, which can separate different scale information of images with disentangle representations at each scale. We demonstrate our method mainly on the CelebA dataset and show that the disentangled representation at different scales enables semantic manipulation and style mixing of the images. To visualize the latent representation, we introduce the receptive fields for flow-based models and find receptive fields learned by RG-Flow are similar to convolutional neural networks. In addition, we replace the widely adopted Gaussian prior distribution by sparse prior distributions to further enhance the disentanglement of representations. From a theoretical perspective, the proposed method has $O(\log L)$ complexity for image inpainting compared to previous flow-based models with $O(L^2)$ complexity.
Submission history
From: Dian Wu [view email][v1] Wed, 30 Sep 2020 18:04:04 GMT (18742kb,D)
[v2] Fri, 2 Oct 2020 18:27:26 GMT (18898kb,D)
[v3] Wed, 7 Oct 2020 00:59:10 GMT (18905kb,D)
[v4] Fri, 18 Dec 2020 20:27:11 GMT (11165kb,D)
[v5] Mon, 15 Aug 2022 09:50:27 GMT (6792kb,D)
Link back to: arXiv, form interface, contact.