Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Unbiased estimators for the variance of MMD estimators
(Submitted on 5 Jun 2019 (v1), last revised 15 Nov 2022 (this version, v3))
Abstract: The maximum mean discrepancy (MMD) is a kernel-based distance between probability distributions useful in many applications (Gretton et al. 2012), bearing a simple estimator with pleasing computational and statistical properties. Being able to efficiently estimate the variance of this estimator is very helpful to various problems in two-sample testing. Towards this end, Bounliphone et al. (2016) used the theory of U-statistics to derive estimators for the variance of an MMD estimator, and differences between two such estimators. Their estimator, however, drops lower-order terms, and is unnecessarily biased. We show in this note - extending and correcting work of Sutherland et al. (2017) - that we can find a truly unbiased estimator for the actual variance of both the squared MMD estimator and the difference of two correlated squared MMD estimators, at essentially no additional computational cost.
Submission history
From: Danica J. Sutherland [view email][v1] Wed, 5 Jun 2019 16:26:46 GMT (100kb)
[v2] Thu, 14 Jan 2021 05:07:16 GMT (100kb)
[v3] Tue, 15 Nov 2022 06:18:46 GMT (142kb)
Link back to: arXiv, form interface, contact.