Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Kernelized Complete Conditional Stein Discrepancy
(Submitted on 9 Apr 2019 (v1), last revised 18 Jul 2020 (this version, v4))
Abstract: Much of machine learning relies on comparing distributions with discrepancy measures. Stein's method creates discrepancy measures between two distributions that require only the unnormalized density of one and samples from the other. Stein discrepancies can be combined with kernels to define kernelized Stein discrepancies (KSDs). While kernels make Stein discrepancies tractable, they pose several challenges in high dimensions. We introduce kernelized complete conditional Stein discrepancies (KCC-SDs). Complete conditionals turn a multivariate distribution into multiple univariate distributions. We show that KCC-SDs distinguish distributions. To show the efficacy of KCC-SDs in distinguishing distributions, we introduce a goodness-of-fit test using KCC-SDs. We empirically show that KCC-SDs have higher power over baselines and use KCC-SDs to assess sample quality in Markov chain Monte Carlo.
Submission history
From: Raghav Singhal [view email][v1] Tue, 9 Apr 2019 06:06:23 GMT (76kb,D)
[v2] Sat, 13 Apr 2019 07:09:09 GMT (76kb,D)
[v3] Tue, 21 Jan 2020 03:21:14 GMT (97kb,D)
[v4] Sat, 18 Jul 2020 03:06:14 GMT (86kb,D)
Link back to: arXiv, form interface, contact.