We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: Optimal rates for independence testing via $U$-statistic permutation tests

Abstract: We study the problem of independence testing given independent and identically distributed pairs taking values in a $\sigma$-finite, separable measure space. Defining a natural measure of dependence $D(f)$ as the squared $L^2$-distance between a joint density $f$ and the product of its marginals, we first show that there is no valid test of independence that is uniformly consistent against alternatives of the form $\{f: D(f) \geq \rho^2 \}$. We therefore restrict attention to alternatives that impose additional Sobolev-type smoothness constraints, and define a permutation test based on a basis expansion and a $U$-statistic estimator of $D(f)$ that we prove is minimax optimal in terms of its separation rates in many instances. Finally, for the case of a Fourier basis on $[0,1]^2$, we provide an approximation to the power function that offers several additional insights. Our methodology is implemented in the R package USP.
Comments: 58 pages, 4 figures
Subjects: Statistics Theory (math.ST); Methodology (stat.ME); Machine Learning (stat.ML)
MSC classes: 62C20, 62G10, 62H20
Cite as: arXiv:2001.05513 [math.ST]
  (or arXiv:2001.05513v2 [math.ST] for this version)

Submission history

From: Thomas Berrett [view email]
[v1] Wed, 15 Jan 2020 19:04:23 GMT (59kb,D)
[v2] Fri, 6 Nov 2020 11:50:28 GMT (91kb,D)

Link back to: arXiv, form interface, contact.