References & Citations
Mathematics > Statistics Theory
Title: Estimating the proportion of false null hypotheses among a large number of independently tested hypotheses
(Submitted on 19 Jan 2005 (v1), last revised 18 May 2006 (this version, v2))
Abstract: We consider the problem of estimating the number of false null hypotheses among a very large number of independently tested hypotheses, focusing on the situation in which the proportion of false null hypotheses is very small. We propose a family of methods for establishing lower $100(1-\alpha)%$ confidence bounds for this proportion, based on the empirical distribution of the $p$-values of the tests. Methods in this family are then compared in terms of ability to consistently estimate the proportion by letting $\alpha \to 0$ as the number of hypothesis tests increases and the proportion decreases. This work is motivated by a signal detection problem that occurs in astronomy.
Submission history
From: Nicolai Meinshausen [view email][v1] Wed, 19 Jan 2005 12:02:48 GMT (46kb)
[v2] Thu, 18 May 2006 15:30:50 GMT (219kb,S)
Link back to: arXiv, form interface, contact.