We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: Strategy Complexity of Threshold Payoff with Applications to Optimal Expected Payoff

Abstract: We study countably infinite Markov decision processes (MDPs) with transition rewards. The $\limsup$ (resp. $\liminf$) threshold objective is to maximize the probability that the $\limsup$ (resp. $\liminf$) of the infinite sequence of transition rewards is non-negative. We establish the complete picture of the strategy complexity of these objectives, i.e., the upper and lower bounds on the memory required by $\varepsilon$-optimal (resp. optimal) strategies. We then apply these results to solve two open problems from [Sudderth, Decisions in Economics and Finance, 2020] about the strategy complexity of optimal strategies for the expected $\limsup$ (resp. $\liminf$) payoff.
Comments: 53 pages
Subjects: Optimization and Control (math.OC); Probability (math.PR)
MSC classes: 90C40, 91A60
Cite as: arXiv:2211.13259 [math.OC]
  (or arXiv:2211.13259v1 [math.OC] for this version)

Submission history

From: Richard Mayr [view email]
[v1] Wed, 23 Nov 2022 19:12:24 GMT (53kb,D)

Link back to: arXiv, form interface, contact.