We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Posterior Dispersion Indices

Abstract: Probabilistic modeling is cyclical: we specify a model, infer its posterior, and evaluate its performance. Evaluation drives the cycle, as we revise our model based on how it performs. This requires a metric. Traditionally, predictive accuracy prevails. Yet, predictive accuracy does not tell the whole story. We propose to evaluate a model through posterior dispersion. The idea is to analyze how each datapoint fares in relation to posterior uncertainty around the hidden structure. We propose a family of posterior dispersion indices (PDI) that capture this idea. A PDI identifies rich patterns of model mismatch in three real data examples: voting preferences, supermarket shopping, and population genetics.
Subjects: Machine Learning (stat.ML); Artificial Intelligence (cs.AI); Computation (stat.CO)
Cite as: arXiv:1605.07604 [stat.ML]
  (or arXiv:1605.07604v1 [stat.ML] for this version)

Submission history

From: Alp Kucukelbir [view email]
[v1] Tue, 24 May 2016 19:58:02 GMT (300kb,D)

Link back to: arXiv, form interface, contact.