Current browse context:
stat.ME
Change to browse by:
References & Citations
Statistics > Methodology
Title: The p-filter: multi-layer FDR control for grouped hypotheses
(Submitted on 10 Dec 2015 (this version), latest version 29 Oct 2016 (v3))
Abstract: False discovery rate (FDR) control has recently proved to be critical in scientific applications involving testing multiple hypotheses on the same dataset, and is intricately related to the recent public controversy regarding reproducibility of scientific results. In many practical applications of multiple hypothesis testing, the hypotheses can be naturally partitioned into groups, and one may not only want to control the number of falsely discoveries (wrongly rejected individual hypotheses), but also the number of falsely discovered groups of hypotheses (where a group is said to be falsely discovered if at least one hypothesis within that group is rejected, when in reality none of the hypotheses within that group should have been rejected). In this paper, we introduce the p-filter, a generalization of the standard FDR procedure by Benjamini and Hochberg [1], and prove that our proposed method can simultaneously control the overall FDR at the finest level (individual hypotheses treated separately) and the group FDR at coarser levels (when such groups are user-specified). We then generalize the p-filter procedure even further to handle multiple partitions of hypotheses, since that might be natural in many applications. For example, in neuroscience experiments, we may have a hypothesis for every (discretized) location in the brain, and at every (discretized) timepoint: does the stimulus correlate with activity in location x at time t after the stimulus was presented? In this setting, one might want to group hypotheses by location or by time (or both). Our procedure naturally generalizes to handle multiple possible partitions of the hypotheses; in the above example, this would amount to controlling overall FDR over all voxels and time points, and FDR at each individual voxel over all time points, and FDR over all voxels at a particular time point.
Submission history
From: Rina Foygel Barber [view email][v1] Thu, 10 Dec 2015 20:23:16 GMT (321kb,D)
[v2] Mon, 22 Feb 2016 14:57:01 GMT (354kb,D)
[v3] Sat, 29 Oct 2016 01:53:16 GMT (2272kb,D)
Link back to: arXiv, form interface, contact.