We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: Towards replicability with confidence intervals for the exceedance probability

Abstract: Several scientific fields including psychology are undergoing a replication crisis. There are many reasons for this problem, one of which is a misuse of p-values. There are several alternatives to p-values, and in this paper we describe a complement that is geared towards replication. In particular, we focus on confidence intervals for the probability that a parameter estimate will exceed a specified value in an exact replication study. These intervals convey uncertainty in a way that p-values and standard confidence intervals do not, and can help researchers to draw sounder scientific conclusions. After briefly reviewing background on p-values and a few alternatives, we describe our approach and provide examples with simulated and real data. For linear models, we also describe how confidence intervals for the exceedance probability are related to p-values and confidence intervals for parameters.
Comments: 36 pages, 7 figures
Subjects: Methodology (stat.ME)
DOI: 10.1080/00031305.2019.1678521
Cite as: arXiv:1803.03356 [stat.ME]
  (or arXiv:1803.03356v4 [stat.ME] for this version)

Submission history

From: Brian Segal [view email]
[v1] Fri, 9 Mar 2018 02:26:49 GMT (302kb,D)
[v2] Sun, 29 Jul 2018 22:51:47 GMT (302kb,D)
[v3] Mon, 8 Oct 2018 00:06:51 GMT (445kb,D)
[v4] Sun, 25 Aug 2019 13:32:43 GMT (262kb,D)

Link back to: arXiv, form interface, contact.