We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.OT

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Statistics > Other Statistics

Title: Reduced Perplexity: A simplified perspective on assessing probabilistic forecasts

Abstract: A simple, intuitive approach to the assessment of probabilistic inferences is introduced. The Shannon information metrics are translated to the probability domain. The translation shows that the negative logarithmic score and the geometric mean are equivalent measures of the accuracy of a probabilistic inference. Thus there is both a quantitative reduction in perplexity, which is the inverse of the geometric mean of the probabilities, as good inference algorithms reduce the uncertainty and a qualitative reduction due to the increased clarity between the original set of probabilistic forecasts and their central tendency, the geometric mean. Further insight is provided by showing that the R\'enyi and Tsallis entropy functions translated to the probability domain are both the weighted generalized mean of the distribution. The generalized mean of probabilistic forecasts forms a spectrum of performance metrics referred to as a Risk Profile. The arithmetic mean is used to measure the decisiveness, while the -2/3 mean is used to measure the robustness.
Comments: 21 pages, 5 figures, conference paper presented at Recent Advances in Info-Metrics, Washington, DC, 2014. Accepted for a book chapter in "Recent innovations in info-metrics: a cross-disciplinary perspective on information and information processing" by Oxford University Press
Subjects: Other Statistics (stat.OT)
Cite as: arXiv:1603.08830 [stat.OT]
  (or arXiv:1603.08830v5 [stat.OT] for this version)

Submission history

From: Kenric Nelson Ph.D. [view email]
[v1] Tue, 15 Mar 2016 14:40:55 GMT (1666kb)
[v2] Sun, 8 Oct 2017 14:39:59 GMT (2075kb)
[v3] Mon, 13 Aug 2018 13:10:17 GMT (2042kb)
[v4] Mon, 22 Oct 2018 20:22:25 GMT (2155kb)
[v5] Sun, 23 Dec 2018 02:21:39 GMT (2112kb)

Link back to: arXiv, form interface, contact.