We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.PR

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Probability

Title: Universal Coding and Prediction on Ergodic Martin-Löf Random Points

Abstract: Suppose that we have a method which estimates the conditional probabilities of some unknown stochastic source and we use it to guess which of the outcomes will happen. We want to make a correct guess as often as it is possible. What estimators are good for this? In this work, we consider estimators given by a familiar notion of universal coding for stationary ergodic measures, while working in the framework of algorithmic randomness, i.e, we are particularly interested in prediction of Martin-L\"of random points. We outline the general theory and exhibit some counterexamples. Completing a result of Ryabko from 2009 we also show that universal probability measure in the sense of universal coding induces a universal predictor in the prequential sense. Surprisingly, this implication holds true provided the universal measure does not ascribe too low conditional probabilities to individual symbols. As an example, we show that the Prediction by Partial Matching (PPM) measure satisfies this requirement with a large reserve.
Comments: 24 pages. The manuscript significantly improved and extended with respect to the previous version
Subjects: Probability (math.PR); Information Theory (cs.IT)
MSC classes: 94A29, 62M20, 03D32
Cite as: arXiv:2005.03627 [math.PR]
  (or arXiv:2005.03627v2 [math.PR] for this version)

Submission history

From: Łukasz Dębowski [view email]
[v1] Thu, 7 May 2020 17:24:53 GMT (16kb)
[v2] Fri, 5 Feb 2021 11:06:38 GMT (22kb)

Link back to: arXiv, form interface, contact.