We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.CO

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Computation

Title: Geometrically Tempered Hamiltonian Monte Carlo

Abstract: Hamiltonian Monte Carlo (HMC) has become routinely used for sampling from posterior distributions. Its extension Riemann manifold HMC (RMHMC) modifies the proposal kernel through distortion of local distances by a Riemannian metric. The performance depends critically on the choice of metric, with the Fisher information providing the standard choice. In this article, we propose a new class of metrics aimed at improving HMC's performance on multi-modal target distributions. We refer to the proposed approach as geometrically tempered HMC (GTHMC) due to its connection to other tempering methods. We establish a geometric theory behind RMHMC to motivate GTHMC and characterize its theoretical properties. Moreover, we develop a novel variable step size integrator for simulating Hamiltonian dynamics to improve on the usual St\"{o}rmer-Verlet integrator which suffers from numerical instability in GTHMC settings. We illustrate GTHMC through simulations, demonstrating generality and substantial gains over standard HMC implementations in terms of effective sample sizes.
Comments: 44 papges, 3 figures
Subjects: Computation (stat.CO)
Cite as: arXiv:1604.00872 [stat.CO]
  (or arXiv:1604.00872v2 [stat.CO] for this version)

Submission history

From: Akihiko Nishimura [view email]
[v1] Mon, 4 Apr 2016 14:24:38 GMT (239kb,D)
[v2] Sun, 19 Feb 2017 02:58:34 GMT (929kb,D)

Link back to: arXiv, form interface, contact.