Current browse context:
math.OC
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: Fixed Points of the Set-Based Bellman Operator
(Submitted on 13 Jan 2020 (v1), last revised 1 Mar 2020 (this version, v2))
Abstract: Motivated by uncertain parameters encountered in Markov decision processes (MDPs), we study the effect of parameter uncertainty on Bellman operator-based methods. Specifically, we consider a family of MDPs where the cost parameters are from a given compact set. We then define a Bellman operator acting on an input set of value functions to produce a new set of value functions as the output under all possible variations in the cost parameters. Finally we prove the existence of a fixed point of this set-based Bellman operator by showing that it is a contractive operator on a complete metric space.
Submission history
From: Sarah Li Ms. [view email][v1] Mon, 13 Jan 2020 21:20:50 GMT (2365kb)
[v2] Sun, 1 Mar 2020 00:41:18 GMT (2459kb)
Link back to: arXiv, form interface, contact.