References & Citations
Statistics > Computation
Title: Kinetic energy choice in Hamiltonian/hybrid Monte Carlo
(Submitted on 8 Jun 2017 (v1), last revised 16 Nov 2018 (this version, v3))
Abstract: We consider how different choices of kinetic energy in Hamiltonian Monte Carlo affect algorithm performance. To this end, we introduce two quantities which can be easily evaluated, the composite gradient and the implicit noise. Results are established on integrator stability and geometric convergence, and we show that choices of kinetic energy that result in heavy-tailed momentum distributions can exhibit an undesirable negligible moves property, which we define. A general efficiency-robustness trade off is outlined, and implementations which rely on approximate gradients are also discussed. Two numerical studies illustrate our theoretical findings, showing that the standard choice which results in a Gaussian momentum distribution is not always optimal in terms of either robustness or efficiency.
Submission history
From: Samuel Livingstone [view email][v1] Thu, 8 Jun 2017 15:44:01 GMT (124kb,D)
[v2] Mon, 25 Sep 2017 15:36:18 GMT (124kb,D)
[v3] Fri, 16 Nov 2018 12:32:08 GMT (150kb,D)
Link back to: arXiv, form interface, contact.