We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

physics

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Physics > Data Analysis, Statistics and Probability

Title: Nested sampling for frequentist computation: fast estimation of small $p$-values

Abstract: We propose a novel method for computing $p$-values based on nested sampling (NS) applied to the sampling space rather than the parameter space of the problem, in contrast to its usage in Bayesian computation. The computational cost of NS scales as $\log^2{1/p}$, which compares favorably to the $1/p$ scaling for Monte Carlo (MC) simulations. For significances greater than about $4\sigma$ in both a toy problem and a simplified resonance search, we show that NS requires orders of magnitude fewer simulations than ordinary MC estimates. This is particularly relevant for high-energy physics, which adopts a $5\sigma$ gold standard for discovery. We conclude with remarks on new connections between Bayesian and frequentist computation and possibilities for tuning NS implementations for still better performance in this setting.
Comments: 5 pages + refs, 3 figures. added refs + schematic of algorithm. closely matches published version
Subjects: Data Analysis, Statistics and Probability (physics.data-an); Instrumentation and Methods for Astrophysics (astro-ph.IM); High Energy Physics - Experiment (hep-ex); High Energy Physics - Phenomenology (hep-ph); Computation (stat.CO)
Journal reference: Phys.Rev.Lett. 128 (2022) 2, 021801
DOI: 10.1103/PhysRevLett.128.021801
Cite as: arXiv:2105.13923 [physics.data-an]
  (or arXiv:2105.13923v2 [physics.data-an] for this version)

Submission history

From: Andrew Fowlie Assoc. Prof. [view email]
[v1] Thu, 27 May 2021 15:06:03 GMT (1233kb,D)
[v2] Fri, 14 Jan 2022 02:30:30 GMT (403kb,D)

Link back to: arXiv, form interface, contact.