Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: VFlow: More Expressive Generative Flows with Variational Data Augmentation
(Submitted on 22 Feb 2020 (v1), last revised 22 Jul 2020 (this version, v2))
Abstract: Generative flows are promising tractable models for density modeling that define probabilistic distributions with invertible transformations. However, tractability imposes architectural constraints on generative flows, making them less expressive than other types of generative models. In this work, we study a previously overlooked constraint that all the intermediate representations must have the same dimensionality with the original data due to invertibility, limiting the width of the network. We tackle this constraint by augmenting the data with some extra dimensions and jointly learning a generative flow for augmented data as well as the distribution of augmented dimensions under a variational inference framework. Our approach, VFlow, is a generalization of generative flows and therefore always performs better. Combining with existing generative flows, VFlow achieves a new state-of-the-art 2.98 bits per dimension on the CIFAR-10 dataset and is more compact than previous models to reach similar modeling quality.
Submission history
From: Cheng Lu [view email][v1] Sat, 22 Feb 2020 18:03:44 GMT (2413kb,D)
[v2] Wed, 22 Jul 2020 15:27:12 GMT (3681kb,D)
Link back to: arXiv, form interface, contact.