Current browse context:
math.ST
Change to browse by:
References & Citations
Mathematics > Statistics Theory
Title: Conjugate Projective Limits
(Submitted on 2 Dec 2010 (v1), last revised 7 Jan 2011 (this version, v2))
Abstract: We characterize conjugate nonparametric Bayesian models as projective limits of conjugate, finite-dimensional Bayesian models. In particular, we identify a large class of nonparametric models representable as infinite-dimensional analogues of exponential family distributions and their canonical conjugate priors. This class contains most models studied in the literature, including Dirichlet processes and Gaussian process regression models. To derive these results, we introduce a representation of infinite-dimensional Bayesian models by projective limits of regular conditional probabilities. We show under which conditions the nonparametric model itself, its sufficient statistics, and -- if they exist -- conjugate updates of the posterior are projective limits of their respective finite-dimensional counterparts. We illustrate our results both by application to existing nonparametric models and by construction of a model on infinite permutations.
Submission history
From: Peter Orbanz [view email][v1] Thu, 2 Dec 2010 01:57:46 GMT (73kb,D)
[v2] Fri, 7 Jan 2011 12:13:53 GMT (77kb,D)
Link back to: arXiv, form interface, contact.