Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Asymmetric Variational Autoencoders
(Submitted on 20 Nov 2017 (v1), last revised 9 Jul 2018 (this version, v2))
Abstract: Variational inference for latent variable models is prevalent in various machine learning problems, typically solved by maximizing the Evidence Lower Bound (ELBO) of the true data likelihood with respect to a variational distribution. However, freely enriching the family of variational distribution is challenging since the ELBO requires variational likelihood evaluations of the latent variables. In this paper, we propose a novel framework to enrich the variational family by incorporating auxiliary variables to the variational family. The resulting inference network doesn't require density evaluations for the auxiliary variables and thus complex implicit densities over the auxiliary variables can be constructed by neural networks. It can be shown that the actual variational posterior of the proposed approach is essentially modeling a rich probabilistic mixture of simple variational posterior indexed by auxiliary variables, thus a flexible inference model can be built. Empirical evaluations on several density estimation tasks demonstrates the effectiveness of the proposed method.
Submission history
From: Guoqing Zheng [view email][v1] Mon, 20 Nov 2017 21:27:32 GMT (227kb,D)
[v2] Mon, 9 Jul 2018 18:44:43 GMT (772kb,D)
Link back to: arXiv, form interface, contact.