We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: Risk-Averse Control of Undiscounted Transient Markov Models

Abstract: We use Markov risk measures to formulate a risk-averse version of the undiscounted total cost problem for a transient controlled Markov process. We derive risk-averse dynamic programming equations and we show that a randomized policy may be strictly better than deterministic policies, when risk measures are employed. We illustrate the results on an optimal stopping problem and an organ transplant problem.
Subjects: Optimization and Control (math.OC)
MSC classes: 90C39, 90C40 (Primary) 91B30 (Secondary)
Cite as: arXiv:1203.5437 [math.OC]
  (or arXiv:1203.5437v2 [math.OC] for this version)

Submission history

From: Andrzej Ruszczyński [view email]
[v1] Sat, 24 Mar 2012 18:34:44 GMT (340kb,D)
[v2] Sat, 22 Mar 2014 15:44:59 GMT (344kb,D)

Link back to: arXiv, form interface, contact.