We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Neural Autoregressive Distribution Estimation

Abstract: We present Neural Autoregressive Distribution Estimation (NADE) models, which are neural network architectures applied to the problem of unsupervised distribution and density estimation. They leverage the probability product rule and a weight sharing scheme inspired from restricted Boltzmann machines, to yield an estimator that is both tractable and has good generalization performance. We discuss how they achieve competitive performance in modeling both binary and real-valued observations. We also present how deep NADE models can be trained to be agnostic to the ordering of input dimensions used by the autoregressive product rule decomposition. Finally, we also show how to exploit the topological structure of pixels in images using a deep convolutional architecture for NADE.
Subjects: Machine Learning (cs.LG)
Cite as: arXiv:1605.02226 [cs.LG]
  (or arXiv:1605.02226v3 [cs.LG] for this version)

Submission history

From: Marc-Alexandre Côté [view email]
[v1] Sat, 7 May 2016 18:13:25 GMT (3523kb,D)
[v2] Wed, 11 May 2016 12:00:17 GMT (3523kb,D)
[v3] Fri, 27 May 2016 14:25:41 GMT (3518kb,D)

Link back to: arXiv, form interface, contact.