References & Citations
Statistics > Methodology
Title: Towards replicability with confidence intervals for the exceedance probability
(Submitted on 9 Mar 2018 (v1), last revised 25 Aug 2019 (this version, v4))
Abstract: Several scientific fields including psychology are undergoing a replication crisis. There are many reasons for this problem, one of which is a misuse of p-values. There are several alternatives to p-values, and in this paper we describe a complement that is geared towards replication. In particular, we focus on confidence intervals for the probability that a parameter estimate will exceed a specified value in an exact replication study. These intervals convey uncertainty in a way that p-values and standard confidence intervals do not, and can help researchers to draw sounder scientific conclusions. After briefly reviewing background on p-values and a few alternatives, we describe our approach and provide examples with simulated and real data. For linear models, we also describe how confidence intervals for the exceedance probability are related to p-values and confidence intervals for parameters.
Submission history
From: Brian Segal [view email][v1] Fri, 9 Mar 2018 02:26:49 GMT (302kb,D)
[v2] Sun, 29 Jul 2018 22:51:47 GMT (302kb,D)
[v3] Mon, 8 Oct 2018 00:06:51 GMT (445kb,D)
[v4] Sun, 25 Aug 2019 13:32:43 GMT (262kb,D)
Link back to: arXiv, form interface, contact.