Current browse context:
stat.CO
Change to browse by:
References & Citations
Statistics > Computation
Title: Fast Approximation of Small p-values in Permutation Tests by Partitioning the Permutation Space
(Submitted on 12 May 2016 (this version), latest version 11 Mar 2017 (v2))
Abstract: Researchers in genetics and other life sciences commonly use permutation tests to evaluate differences between groups. Permutation tests have desirable properties, including exactness, and are applicable even when the distribution of the test statistic is analytically intractable. However, permutation tests can be computationally intensive. We propose both an asymptotic approximation and a resampling algorithm for quickly estimating small permutation p-values (e.g. $<10^{-6}$) for functions of the means in two-sample tests. Our methods are based on the distribution of test statistics within and across partitions of the permutation space, which we define. In this article, we present our methods and demonstrate their use through simulations and an application to cancer genomic data. Through simulations, we find that our resampling algorithm is more computationally efficient than another leading alternative, particulary for extremely small p-values (e.g. $<10^{-30}$). Through application to cancer genomic data, we find that our methods can successfully identify up- and down-regulated genes.
Submission history
From: Brian Segal [view email][v1] Thu, 12 May 2016 21:13:03 GMT (1185kb,D)
[v2] Sat, 11 Mar 2017 22:46:32 GMT (6589kb,D)
Link back to: arXiv, form interface, contact.