We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.CO

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Computation

Title: Kinetic energy choice in Hamiltonian/hybrid Monte Carlo

Abstract: We consider how different choices of kinetic energy in Hamiltonian Monte Carlo affect algorithm performance. To this end, we introduce two quantities which can be easily evaluated, the composite gradient and the implicit noise. Results are established on integrator stability and geometric convergence, and we show that choices of kinetic energy that result in heavy-tailed momentum distributions can exhibit an undesirable negligible moves property, which we define. A general efficiency-robustness trade off is outlined, and implementations which rely on approximate gradients are also discussed. Two numerical studies illustrate our theoretical findings, showing that the standard choice which results in a Gaussian momentum distribution is not always optimal in terms of either robustness or efficiency.
Comments: 15 pages (+7 page supplement, included here as an appendix), 2 figures (+1 in supplement)
Subjects: Computation (stat.CO)
Cite as: arXiv:1706.02649 [stat.CO]
  (or arXiv:1706.02649v3 [stat.CO] for this version)

Submission history

From: Samuel Livingstone [view email]
[v1] Thu, 8 Jun 2017 15:44:01 GMT (124kb,D)
[v2] Mon, 25 Sep 2017 15:36:18 GMT (124kb,D)
[v3] Fri, 16 Nov 2018 12:32:08 GMT (150kb,D)

Link back to: arXiv, form interface, contact.