We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: Dynamic Algorithms for Online Multiple Testing

Abstract: We derive new algorithms for online multiple testing that provably control false discovery exceedance (FDX) while achieving orders of magnitude more power than previous methods. This statistical advance is enabled by the development of new algorithmic ideas: earlier algorithms are more "static" while our new ones allow for the dynamical adjustment of testing levels based on the amount of wealth the algorithm has accumulated. We demonstrate that our algorithms achieve higher power in a variety of synthetic experiments. We also prove that SupLORD can provide error control for both FDR and FDX, and controls FDR at stopping times. Stopping times are particularly important as they permit the experimenter to end the experiment arbitrarily early while maintaining desired control of the FDR. SupLORD is the first non-trivial algorithm, to our knowledge, that can control FDR at stopping times in the online setting.
Comments: 32 pages, 15 figures. Will be published in Mathematical and Scientific Machine Learning 2021 (PMLR)
Subjects: Methodology (stat.ME); Statistics Theory (math.ST); Machine Learning (stat.ML)
Cite as: arXiv:2010.13953 [stat.ME]
  (or arXiv:2010.13953v3 [stat.ME] for this version)

Submission history

From: Ziyu Xu [view email]
[v1] Mon, 26 Oct 2020 23:41:54 GMT (2344kb,D)
[v2] Sat, 2 Jan 2021 22:25:47 GMT (2102kb,D)
[v3] Wed, 2 Jun 2021 15:43:59 GMT (3848kb,D)

Link back to: arXiv, form interface, contact.