References & Citations
Statistics > Computation
Title: Neural Network Gradient Hamiltonian Monte Carlo
(Submitted on 14 Nov 2017 (v1), last revised 26 Oct 2018 (this version, v2))
Abstract: Hamiltonian Monte Carlo is a widely used algorithm for sampling from posterior distributions of complex Bayesian models. It can efficiently explore high-dimensional parameter spaces guided by simulated Hamiltonian flows. However, the algorithm requires repeated gradient calculations, and these computations become increasingly burdensome as data sets scale. We present a method to substantially reduce the computation burden by using a neural network to approximate the gradient. First, we prove that the proposed method still maintains convergence to the true distribution though the approximated gradient no longer comes from a Hamiltonian system. Second, we conduct experiments on synthetic examples and real data sets to validate the proposed method.
Submission history
From: Lingge Li [view email][v1] Tue, 14 Nov 2017 20:23:50 GMT (88kb,D)
[v2] Fri, 26 Oct 2018 03:49:10 GMT (2026kb,D)
Link back to: arXiv, form interface, contact.