We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Online control of the false discovery rate in biomedical research

Abstract: Modern biomedical research frequently involves testing multiple related hypotheses, while maintaining control over a suitable error rate. In many applications the false discovery rate (FDR), which is the expected proportion of false positives among the rejected hypotheses, has become the standard error criterion. Procedures that control the FDR, such as the well-known Benjamini-Hochberg procedure, assume that all p-values are available to be tested at a single time point. However, this ignores the sequential nature of many biomedical experiments, where a sequence of hypotheses is tested without having access to future p-values or even the number of hypotheses. Recently, the first procedures that control the FDR in this online manner have been proposed by Javanmard and Montanari (Ann. Stat. 2018), and built upon by Ramdas et al. (NIPS 2017, ICML 2018). In this paper, we compare and contrast these proposed procedures, with a particular focus on the setting where the p-values are dependent. We also propose a simple modification of the procedures for when there is an upper bound on the number of hypotheses to be tested. Using comprehensive simulation scenarios and case studies, we provide recommendations for which procedures to use in practice for online FDR control.
Comments: 48 pages, 18 figures; Updated references
Subjects: Methodology (stat.ME); Applications (stat.AP)
MSC classes: 62-07
Cite as: arXiv:1809.07292 [stat.ME]
  (or arXiv:1809.07292v2 [stat.ME] for this version)

Submission history

From: David Robertson [view email]
[v1] Wed, 19 Sep 2018 16:37:46 GMT (555kb,D)
[v2] Wed, 26 Sep 2018 17:08:01 GMT (555kb,D)

Link back to: arXiv, form interface, contact.