### Current browse context:

math.OC

### Change to browse by:

### References & Citations

# Mathematics > Optimization and Control

# Title: Strategy Complexity of Threshold Payoff with Applications to Optimal Expected Payoff

(Submitted on 23 Nov 2022)

Abstract: We study countably infinite Markov decision processes (MDPs) with transition rewards. The $\limsup$ (resp. $\liminf$) threshold objective is to maximize the probability that the $\limsup$ (resp. $\liminf$) of the infinite sequence of transition rewards is non-negative. We establish the complete picture of the strategy complexity of these objectives, i.e., the upper and lower bounds on the memory required by $\varepsilon$-optimal (resp. optimal) strategies. We then apply these results to solve two open problems from [Sudderth, Decisions in Economics and Finance, 2020] about the strategy complexity of optimal strategies for the expected $\limsup$ (resp. $\liminf$) payoff.

Link back to: arXiv, form interface, contact.