We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.CO

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Combinatorics

Title: Optimal bounds for bit-sizes of stationary distributions in finite Markov chains

Abstract: An irreducible stochastic matrix with rational entries has a stationary distribution given by a vector of rational numbers. We give an upper bound on the lowest common denominator of the entries of this vector. Bounds of this kind are used to study the complexity of algorithms for solving stochastic mean payoff games. They are usually derived using the Hadamard inequality, but this leads to suboptimal results. We replace the Hadamard inequality with the Markov chain tree formula in order to obtain optimal bounds. We also adapt our approach to obtain bounds on the absorption probabilities of finite Markov chains and on the gains and bias vectors of Markov chains with rewards.
Comments: 15 pages, 3 figures
Subjects: Combinatorics (math.CO); Computer Science and Game Theory (cs.GT); Probability (math.PR)
Cite as: arXiv:2109.04976 [math.CO]
  (or arXiv:2109.04976v1 [math.CO] for this version)

Submission history

From: Mateusz Skomra [view email]
[v1] Fri, 10 Sep 2021 16:20:56 GMT (18kb)

Link back to: arXiv, form interface, contact.