We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Batch norm with entropic regularization turns deterministic autoencoders into generative models

Abstract: The variational autoencoder is a well defined deep generative model that utilizes an encoder-decoder framework where an encoding neural network outputs a non-deterministic code for reconstructing an input. The encoder achieves this by sampling from a distribution for every input, instead of outputting a deterministic code per input. The great advantage of this process is that it allows the use of the network as a generative model for sampling from the data distribution beyond provided samples for training. We show in this work that utilizing batch normalization as a source for non-determinism suffices to turn deterministic autoencoders into generative models on par with variational ones, so long as we add a suitable entropic regularization to the training objective.
Subjects: Machine Learning (cs.LG); Computer Vision and Pattern Recognition (cs.CV); Machine Learning (stat.ML)
Journal reference: Published in the Proceedings of the International Conference on Uncertainty in Artificial Intelligence (UAI), 2020
Cite as: arXiv:2002.10631 [cs.LG]
  (or arXiv:2002.10631v2 [cs.LG] for this version)

Submission history

From: Pascal Poupart [view email]
[v1] Tue, 25 Feb 2020 02:42:18 GMT (6104kb,D)
[v2] Wed, 22 Sep 2021 00:51:29 GMT (6628kb,D)

Link back to: arXiv, form interface, contact.