We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.PR

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Probability

Title: The non-locality of Markov chain approximations to two-dimensional diffusions

Abstract: In this short paper, we consider discrete-time Markov chains on lattices as approximations to continuous-time diffusion processes. The approximations can be interpreted as finite difference schemes for the generator of the process. We derive conditions on the diffusion coefficients which permit transition probabilities to match locally first and second moments. We derive a novel formula which expresses how the matching becomes more difficult for larger (absolute) correlations and strongly anisotropic processes, such that instantaneous moves to more distant neighbours on the lattice have to be allowed. Roughly speaking, for non-zero correlations, the distance covered in one timestep is proportional to the ratio of volatilities in the two directions. We discuss the implications to Markov decision processes and the convergence analysis of approximations to Hamilton-Jacobi-Bellman equations in the Barles-Souganidis framework.
Comments: Corrected two errata from previous and journal version: definition of R in (5) and summations in (7)
Subjects: Probability (math.PR); Numerical Analysis (math.NA)
Cite as: arXiv:1605.06348 [math.PR]
  (or arXiv:1605.06348v2 [math.PR] for this version)

Submission history

From: Christoph Reisinger [view email]
[v1] Fri, 20 May 2016 13:29:01 GMT (781kb,D)
[v2] Mon, 7 Nov 2016 11:40:45 GMT (99kb)

Link back to: arXiv, form interface, contact.