We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: Markov decision processes with Kusuoka-type conditional risk mappings

Abstract: Under suitable conditions, the Kusuoka representation of law invariant coherent risk measures allows one to cast them in terms of average value-at-risk. Here, we introduce the notion of Kusuoka-type conditional risk-mappings and use it to define a dynamic risk measure. We use such dynamic risk measures to study infinite horizon Markov decision processes with random costs and random actions. Under mild assumptions, we derive a dynamic programming principle and prove the existence of an optimal policy. We also derive the Q-learning version of the dynamic programming principle, which is important for applications. Furthermore, we provide a sufficient condition for when deterministic actions are optimal.
Subjects: Optimization and Control (math.OC); Mathematical Finance (q-fin.MF); Risk Management (q-fin.RM)
Cite as: arXiv:2203.09612 [math.OC]
  (or arXiv:2203.09612v2 [math.OC] for this version)

Submission history

From: Ziteng Cheng [view email]
[v1] Thu, 17 Mar 2022 21:01:02 GMT (172kb,D)
[v2] Mon, 23 May 2022 19:37:23 GMT (508kb,D)

Link back to: arXiv, form interface, contact.