We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.ST

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Statistics Theory

Title: General Behaviour of P-Values Under the Null and Alternative

Abstract: Hypothesis testing results often rely on simple, yet important assumptions about the behaviour of the distribution of p-values under the null and the alternative. We examine tests for one dimensional parameters of interest that converge to a normal distribution, possibly in the presence of nuisance parameters, and characterize the distribution of the p-values using techniques from the higher order asymptotics literature. We show that commonly held beliefs regarding the distribution of p-values are misleading when the variance and location of the test statistic are not well-calibrated or when the higher order cumulants of the test statistic are not negligible. Corrected tests are proposed and are shown to perform better than their first order counterparts in certain settings.
Comments: 19 pages, 8 figures
Subjects: Statistics Theory (math.ST); Methodology (stat.ME)
Cite as: arXiv:2012.01697 [math.ST]
  (or arXiv:2012.01697v2 [math.ST] for this version)

Submission history

From: Yanbo Tang [view email]
[v1] Thu, 3 Dec 2020 04:36:39 GMT (354kb,D)
[v2] Wed, 4 Aug 2021 22:22:47 GMT (378kb,D)

Link back to: arXiv, form interface, contact.