We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: Objective Priors in the Empirical Bayes Framework

Abstract: When dealing with Bayesian inference the choice of the prior often remains a debatable question. Empirical Bayes methods offer a data-driven solution to this problem by estimating the prior itself from an ensemble of data. In the nonparametric case, the maximum likelihood estimate is known to overfit the data, an issue that is commonly tackled by regularization. However, the majority of regularizations are ad hoc choices which lack invariance under reparametrization of the model and result in inconsistent estimates for equivalent models. We introduce a non-parametric, transformation invariant estimator for the prior distribution. Being defined in terms of the missing information similar to the reference prior, it can be seen as an extension of the latter to the data-driven setting. This implies a natural interpretation as a trade-off between choosing the least informative prior and incorporating the information provided by the data, a symbiosis between the objective and empirical Bayes methodologies.
Subjects: Methodology (stat.ME)
MSC classes: 62C12, 62G08
Cite as: arXiv:1612.00064 [stat.ME]
  (or arXiv:1612.00064v5 [stat.ME] for this version)

Submission history

From: Ilja Klebanov [view email]
[v1] Wed, 30 Nov 2016 22:35:55 GMT (93kb,D)
[v2] Wed, 21 Jun 2017 14:03:16 GMT (7884kb,D)
[v3] Wed, 7 Feb 2018 13:36:57 GMT (7884kb,D)
[v4] Fri, 4 May 2018 10:34:03 GMT (1017kb,D)
[v5] Mon, 11 May 2020 23:34:50 GMT (1705kb,D)

Link back to: arXiv, form interface, contact.