We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Methodology

Title: Empirical Bayes factors for common hypothesis tests

Abstract: Bayes factors for composite hypotheses have difficulty in encoding vague prior knowledge, as improper priors cannot be used and objective priors may be subjectively unreasonable. To address these issues we revisit the posterior Bayes factor, in which the posterior distribution from the data at hand is re-used in the Bayes factor for the same data. We argue that this is biased when calibrated against proper Bayes factors, but propose adjustments to allow interpretation on the same scale. In the important case of a regular normal model, the bias in log scale is half the number of parameters. The resulting empirical Bayes factor is closely related to the widely applicable information criterion. We develop test-based empirical Bayes factors for several standard tests and propose an extension to multiple testing closely related to the optimal discovery procedure. For non-parametric tests the empirical Bayes factor is approximately 10 times the P-value. We propose interpreting the strength of Bayes factors on a logarithmic scale with base 3.73, reflecting the sharpest distinction between weaker and stronger belief. This provides an objective framework for interpreting statistical evidence, realising a Bayesian/frequentist compromise.
Subjects: Methodology (stat.ME); Statistics Theory (math.ST)
Cite as: arXiv:2301.11057 [stat.ME]
  (or arXiv:2301.11057v3 [stat.ME] for this version)

Submission history

From: Frank Dudbridge [view email]
[v1] Thu, 26 Jan 2023 12:03:24 GMT (629kb)
[v2] Fri, 24 Feb 2023 08:07:38 GMT (641kb)
[v3] Tue, 14 Mar 2023 09:53:17 GMT (530kb)

Link back to: arXiv, form interface, contact.