We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.PR

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Probability

Title: Pattern reconstruction with restricted Boltzmann machines

Abstract: We show that the ability of a restricted Boltzmann machine to reconstruct a random pattern depends on the tail of the hidden prior distribution: hidden priors with strictly sub-Gaussian tails give only a logarithmic loss in pattern retrieval, while an efficient retrieval is much harder with hidden units with strictly super-Gaussian tails; reconstruction with sub-Gaussian hidden prior is regulated by the number of hidden units (as in the Hopfield model). This is proved by localisation estimates for the local minima of the energy function.
Subjects: Probability (math.PR); Disordered Systems and Neural Networks (cond-mat.dis-nn); Information Retrieval (cs.IR); Machine Learning (stat.ML)
Cite as: arXiv:2205.07087 [math.PR]
  (or arXiv:2205.07087v1 [math.PR] for this version)

Submission history

From: Giuseppe Genovese [view email]
[v1] Sat, 14 May 2022 16:00:21 GMT (21kb)
[v2] Wed, 5 Oct 2022 19:07:50 GMT (28kb)
[v3] Fri, 27 Oct 2023 18:13:49 GMT (25kb)

Link back to: arXiv, form interface, contact.