We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Ancillary-file links:

Ancillary files (details):

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: Online Control of the False Discovery Rate under "Decision Deadlines"

Authors: Aaron Fisher
Abstract: Online testing procedures aim to control the extent of false discoveries over a sequence of hypothesis tests, allowing for the possibility that early-stage test results influence the choice of hypotheses to be tested in later stages. Typically, online methods assume that a permanent decision regarding the current test (reject or not reject) must be made before advancing to the next test. We instead assume that each hypothesis requires an immediate preliminary decision, but also allows us to update that decision until a preset deadline. Roughly speaking, this lets us apply a Benjamini-Hochberg-type procedure over a moving window of hypotheses, where the threshold parameters for upcoming tests can be determined based on preliminary results. Our method controls the false discovery rate (FDR) at every stage of testing, as well as at adaptively chosen stopping times. These results apply even under arbitrary p-value dependency structures.
Comments: Keywords: adaptive stopping time, batch testing, data decay, decaying memory, quality preserving database. Updates: Expanded simulations, other minor edits for submission
Subjects: Methodology (stat.ME); Machine Learning (stat.ML)
Cite as: arXiv:2110.01583 [stat.ME]
  (or arXiv:2110.01583v2 [stat.ME] for this version)

Submission history

From: Aaron Fisher [view email]
[v1] Mon, 4 Oct 2021 17:28:09 GMT (272kb,D)
[v2] Fri, 15 Oct 2021 15:51:31 GMT (1046kb,AD)

Link back to: arXiv, form interface, contact.