References & Citations
Statistics > Computation
Title: Mini-batch Tempered MCMC
(Submitted on 31 Jul 2017 (this version), latest version 21 May 2018 (v8))
Abstract: In this paper we propose a general framework of performing MCMC with only a mini-batch of data. We show by estimating the Metropolis-Hasting ratio with only a mini-batch of data, one is essentially sampling from the true posterior raised to a known temperature. We show by experiments that our method, Mini-batch Tempered MCMC (MINT-MCMC), can efficiently explore multiple modes of a posterior distribution. As an application, we demonstrate one application of MINT-MCMC as an inference tool for Bayesian neural networks. We also show an cyclic version of our algorithm can be applied to build an ensemble of neural networks with little additional training cost.
Submission history
From: Dangna Li [view email][v1] Mon, 31 Jul 2017 03:07:00 GMT (613kb,D)
[v2] Sun, 6 Aug 2017 16:11:05 GMT (613kb,D)
[v3] Sat, 7 Oct 2017 18:11:09 GMT (664kb,D)
[v4] Sun, 5 Nov 2017 21:24:30 GMT (562kb,D)
[v5] Thu, 8 Feb 2018 04:28:23 GMT (654kb,D)
[v6] Mon, 26 Feb 2018 23:29:04 GMT (699kb,D)
[v7] Wed, 25 Apr 2018 01:03:24 GMT (701kb,D)
[v8] Mon, 21 May 2018 18:09:49 GMT (701kb,D)
Link back to: arXiv, form interface, contact.