We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: Simple Methods for Estimating Confidence Levels, or Tentative Probabilities, for Hypotheses Instead of P Values

Authors: Michael Wood
Abstract: In many fields of research null hypothesis significance tests and p values are the accepted way of assessing the degree of certainty with which research results can be extrapolated beyond the sample studied. However, there are very serious concerns about the suitability of p values for this purpose. An alternative approach is to cite confidence intervals for a statistic of interest, but this does not directly tell readers how certain a hypothesis is. Here, I suggest how the framework used for confidence intervals could easily be extended to derive confidence levels, or "tentative probabilities", for hypotheses. I also outline four quick methods for estimating these. This allows researchers to state their confidence in a hypothesis as a direct probability, instead of circuitously by p values referring to an unstated, hypothetical null hypothesis. The inevitable difficulties of statistical inference mean that these probabilities can only be tentative, but probabilities are the natural way to express uncertainties, so, arguably, researchers using statistical methods have an obligation to estimate how probable their hypotheses are by the best available method. Otherwise misinterpretations will fill the void. Key words: Confidence, Null hypothesis significance test, p value, Statistical inference
Comments: Published in Methodological Innovations, 2019, 1-9. 2 figures, 2 tables, 3 linked spreadsheets which are also at this https URL
Subjects: Methodology (stat.ME)
DOI: 10.1177/2059799119826518
Cite as: arXiv:1702.03129 [stat.ME]
  (or arXiv:1702.03129v3 [stat.ME] for this version)

Submission history

From: Michael Wood [view email]
[v1] Fri, 10 Feb 2017 11:08:57 GMT (1138kb)
[v2] Wed, 14 Mar 2018 14:16:36 GMT (1295kb)
[v3] Sun, 12 Jan 2020 19:27:09 GMT (324kb)

Link back to: arXiv, form interface, contact.