We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ME

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Methodology

Title: A framework for probabilistic inferences from imperfect models

Abstract: The Bayesian paradigm provides a natural way to deal with uncertainty in model selection through assigning each model in a list of models under consideration a posterior probability. Unfortunately, this framework relies on the assumption that one of the models in the list is the true model. When this assumption is violated and all the models are imperfect, interpretation of posterior model probabilities is unclear. We propose a new concept of {\em absolute} model probabilities, which measure the quality of imperfect models. This concept leads to divergence-based estimates ({\em D-probabilities}) relying on evaluating parametric models relative to a nonparametric Bayesian reference using Kullback-Leibler divergence. While providing good-of-fit assessment, D-probabilities avoid some of the pitfalls of usual posterior model probabilities including large sensitivity to prior choice. In an application to linear model selection against a Gaussian process reference, we provide simple analytic forms for routine implementation and show that D-probabilities automatically penalize model complexity. Some asymptotic properties of this framework are described. Absolute model probabilities have several interesting probabilistic interpretations, and can potentially be applied in broad problems. The framework is illustrated through simulations and applications.
Subjects: Methodology (stat.ME)
Cite as: arXiv:1611.01241 [stat.ME]
  (or arXiv:1611.01241v2 [stat.ME] for this version)

Submission history

From: Meng Li [view email]
[v1] Fri, 4 Nov 2016 01:50:57 GMT (571kb,D)
[v2] Tue, 14 Mar 2017 18:32:35 GMT (389kb,D)
[v3] Fri, 1 Jun 2018 14:54:45 GMT (642kb,D)

Link back to: arXiv, form interface, contact.