Current browse context:
math.PR
Change to browse by:
References & Citations
Mathematics > Probability
Title: Pattern reconstruction with restricted Boltzmann machines
(Submitted on 14 May 2022 (this version), latest version 27 Oct 2023 (v3))
Abstract: We show that the ability of a restricted Boltzmann machine to reconstruct a random pattern depends on the tail of the hidden prior distribution: hidden priors with strictly sub-Gaussian tails give only a logarithmic loss in pattern retrieval, while an efficient retrieval is much harder with hidden units with strictly super-Gaussian tails; reconstruction with sub-Gaussian hidden prior is regulated by the number of hidden units (as in the Hopfield model). This is proved by localisation estimates for the local minima of the energy function.
Submission history
From: Giuseppe Genovese [view email][v1] Sat, 14 May 2022 16:00:21 GMT (21kb)
[v2] Wed, 5 Oct 2022 19:07:50 GMT (28kb)
[v3] Fri, 27 Oct 2023 18:13:49 GMT (25kb)
Link back to: arXiv, form interface, contact.