We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Machine Learning

Title: Measuring Sample Quality with Diffusions

Abstract: Stein's method for measuring convergence to a continuous target distribution relies on an operator characterizing the target and Stein factor bounds on the solutions of an associated differential equation. While such operators and bounds are readily available for a diversity of univariate targets, few multivariate targets have been analyzed. We introduce a new class of characterizing operators based on Ito diffusions and develop explicit multivariate Stein factor bounds for any target with a fast-coupling Ito diffusion. As example applications, we develop computable and convergence-determining diffusion Stein discrepancies for log-concave, heavy-tailed, and multimodal targets and use these quality measures to select the hyperparameters of biased Markov chain Monte Carlo (MCMC) samplers, compare random and deterministic quadrature rules, and quantify bias-variance tradeoffs in approximate MCMC. Our results establish a near-linear relationship between diffusion Stein discrepancies and Wasserstein distances, improving upon past work even for strongly log-concave targets. The exposed relationship between Stein factors and Markov process coupling may be of independent interest.
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Probability (math.PR)
MSC classes: 60J60, 62-04, 62E17, 60E15, 65C60 (Primary) 62-07, 65C05, 68T05 (Secondary)
Cite as: arXiv:1611.06972 [stat.ML]
  (or arXiv:1611.06972v6 [stat.ML] for this version)

Submission history

From: Jack Gorham [view email]
[v1] Mon, 21 Nov 2016 19:47:08 GMT (779kb,D)
[v2] Wed, 23 Nov 2016 19:46:21 GMT (779kb,D)
[v3] Mon, 19 Jun 2017 18:42:43 GMT (790kb,D)
[v4] Wed, 31 Jan 2018 22:47:59 GMT (308kb,D)
[v5] Wed, 21 Feb 2018 01:20:25 GMT (309kb,D)
[v6] Tue, 13 Nov 2018 01:25:12 GMT (308kb,D)

Link back to: arXiv, form interface, contact.