We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: The Chi-Square Test of Distance Correlation

Abstract: Distance correlation has gained much recent attention in the data science community: the sample statistic is straightforward to compute and asymptotically equals zero if and only if independence, making it an ideal choice to test any type of dependency structure given sufficient sample size. One major bottleneck is the testing process: because the null distribution of distance correlation depends on the underlying random variables and metric choice, it typically requires a permutation test to estimate the null and compute the p-value, which is very costly for large amount of data. To overcome the difficulty, we propose a centered chi-square distribution, demonstrate it well-approximates the null distribution of unbiased distance correlation, and prove upper tail dominance and distribution bound between them. The resulting distance correlation chi-square test is a nonparametric test for independence, is valid and universally consistent using any strong negative type metric or characteristic kernel, enjoys a similar finite-sample testing power as the standard permutation test, and is provably the most powerful test of distance correlation among all valid tests with known distribution.
Comments: 12 pages + 8 pages appendix, 3 figures
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Statistics Theory (math.ST); Methodology (stat.ME)
Cite as: arXiv:1912.12150 [stat.ML]
  (or arXiv:1912.12150v3 [stat.ML] for this version)

Submission history

From: Cencheng Shen [view email]
[v1] Fri, 27 Dec 2019 15:16:40 GMT (144kb,D)
[v2] Tue, 7 Jan 2020 15:08:41 GMT (142kb,D)
[v3] Wed, 22 Jan 2020 21:53:47 GMT (143kb,D)

Link back to: arXiv, form interface, contact.