References & Citations
Statistics > Methodology
Title: A framework for probabilistic inferences from imperfect models
(Submitted on 4 Nov 2016 (v1), revised 14 Mar 2017 (this version, v2), latest version 1 Jun 2018 (v3))
Abstract: The Bayesian paradigm provides a natural way to deal with uncertainty in model selection through assigning each model in a list of models under consideration a posterior probability. Unfortunately, this framework relies on the assumption that one of the models in the list is the true model. When this assumption is violated and all the models are imperfect, interpretation of posterior model probabilities is unclear. We propose a new concept of {\em absolute} model probabilities, which measure the quality of imperfect models. This concept leads to divergence-based estimates ({\em D-probabilities}) relying on evaluating parametric models relative to a nonparametric Bayesian reference using Kullback-Leibler divergence. While providing good-of-fit assessment, D-probabilities avoid some of the pitfalls of usual posterior model probabilities including large sensitivity to prior choice. In an application to linear model selection against a Gaussian process reference, we provide simple analytic forms for routine implementation and show that D-probabilities automatically penalize model complexity. Some asymptotic properties of this framework are described. Absolute model probabilities have several interesting probabilistic interpretations, and can potentially be applied in broad problems. The framework is illustrated through simulations and applications.
Submission history
From: Meng Li [view email][v1] Fri, 4 Nov 2016 01:50:57 GMT (571kb,D)
[v2] Tue, 14 Mar 2017 18:32:35 GMT (389kb,D)
[v3] Fri, 1 Jun 2018 14:54:45 GMT (642kb,D)
Link back to: arXiv, form interface, contact.