We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Statistics Theory

Title: Higher Criticism to Compare Two Large Frequency Tables, with sensitivity to Possible Rare and Weak Differences

Abstract: We adapt Higher Criticism (HC) to the comparison of two frequency tables which may -- or may not -- exhibit moderate differences between the tables in some unknown, relatively small subset out of a large number of categories. Our analysis of the power of the proposed HC test quantifies the rarity and size of assumed differences and applies moderate deviations-analysis to determine the asymptotic powerfulness/powerlessness of our proposed HC procedure.
Our analysis considers the null hypothesis of no difference in underlying generative model against a rare/weak perturbation alternative, in which the frequencies of $N^{1-\beta}$ out of the $N$ categories are perturbed by $r(\log N)/2n$ in the Hellinger distance; here $n$ is the size of each sample. Our proposed Higher Criticism (HC) test for this setting uses P-values obtained from $N$ exact binomial tests. We characterize the asymptotic performance of the HC-based test in terms of the rarity parameter $\beta$ and the perturbation intensity parameter $r$. Specifically, we derive a region in the $(\beta,r)$-plane where the test asymptotically has maximal power, while having asymptotically no power outside this region. Our analysis distinguishes between cases in which the counts in both tables are low, versus cases in which counts are high, corresponding to the cases of sparse and dense frequency tables. The phase transition curve of HC in the high-counts regime matches formally the curve delivered by HC in a two-sample normal means model.
Subjects: Statistics Theory (math.ST); Computation (stat.CO)
MSC classes: 62H17, 62H15, 62G10
Journal reference: Annals of Statistics 2022, Vol. 50, No. 3, 1447-1472
DOI: 10.1214/21-AOS2158
Cite as: arXiv:2007.01958 [math.ST]
  (or arXiv:2007.01958v5 [math.ST] for this version)

Submission history

From: Alon Kipnis [view email]
[v1] Fri, 3 Jul 2020 22:38:28 GMT (902kb,D)
[v2] Mon, 13 Jul 2020 18:53:38 GMT (903kb,D)
[v3] Mon, 9 Nov 2020 22:52:08 GMT (1808kb,D)
[v4] Fri, 4 Jun 2021 07:41:46 GMT (1793kb,D)
[v5] Tue, 21 Jun 2022 07:01:22 GMT (872kb,D)

Link back to: arXiv, form interface, contact.