References & Citations
Quantum Physics
Title: Estimation of effective temperatures in quantum annealers for sampling applications: A case study with possible applications in deep learning
(Submitted on 26 Oct 2015 (v1), last revised 9 Aug 2016 (this version, v4))
Abstract: An increase in the efficiency of sampling from Boltzmann distributions would have a significant impact on deep learning and other machine-learning applications. Recently, quantum annealers have been proposed as a potential candidate to speed up this task, but several limitations still bar these state-of-the-art technologies from being used effectively. One of the main limitations is that, while the device may indeed sample from a Boltzmann-like distribution, quantum dynamical arguments suggest it will do so with an {\it instance-dependent} effective temperature, different from its physical temperature. Unless this unknown temperature can be unveiled, it might not be possible to effectively use a quantum annealer for Boltzmann sampling. In this work, we propose a strategy to overcome this challenge with a simple effective-temperature estimation algorithm. We provide a systematic study assessing the impact of the effective temperatures in the learning of a special class of a restricted Boltzmann machine embedded on quantum hardware, which can serve as a building block for deep-learning architectures. We also provide a comparison to $k$-step contrastive divergence (CD-$k$) with $k$ up to 100. Although assuming a suitable fixed effective temperature also allows us to outperform one step contrastive divergence (CD-1), only when using an instance-dependent effective temperature do we find a performance close to that of CD-100 for the case studied here.
Submission history
From: Alejandro Perdomo-Ortiz [view email][v1] Mon, 26 Oct 2015 19:46:34 GMT (944kb,D)
[v2] Tue, 27 Oct 2015 19:14:21 GMT (944kb,D)
[v3] Wed, 2 Mar 2016 08:54:39 GMT (716kb,D)
[v4] Tue, 9 Aug 2016 14:59:34 GMT (965kb,D)
Link back to: arXiv, form interface, contact.