Current browse context:
stat
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Interpretable Distribution Features with Maximum Testing Power
(Submitted on 22 May 2016 (v1), last revised 28 Oct 2016 (this version, v2))
Abstract: Two semimetrics on probability distributions are proposed, given as the sum of differences of expectations of analytic functions evaluated at spatial or frequency locations (i.e, features). The features are chosen so as to maximize the distinguishability of the distributions, by optimizing a lower bound on test power for a statistical test using these features. The result is a parsimonious and interpretable indication of how and where two distributions differ locally. An empirical estimate of the test power criterion converges with increasing sample size, ensuring the quality of the returned features. In real-world benchmarks on high-dimensional text and image data, linear-time tests using the proposed semimetrics achieve comparable performance to the state-of-the-art quadratic-time maximum mean discrepancy test, while returning human-interpretable features that explain the test results.
Submission history
From: Wittawat Jitkrittum [view email][v1] Sun, 22 May 2016 14:10:13 GMT (579kb,D)
[v2] Fri, 28 Oct 2016 10:48:05 GMT (4359kb,D)
Link back to: arXiv, form interface, contact.