Current browse context:
math.OC
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: A modified MSA for stochastic control problems
(Submitted on 10 Jul 2020 (v1), last revised 17 Nov 2020 (this version, v2))
Abstract: The classical Method of Successive Approximations (MSA) is an iterative method for solving stochastic control problems and is derived from Pontryagin's optimality principle. It is known that the MSA may fail to converge. Using careful estimates for the backward stochastic differential equation (BSDE) this paper suggests a modification to the MSA algorithm. This modified MSA is shown to converge for general stochastic control problems with control in both the drift and diffusion coefficients. Under some additional assumptions the rate of convergence is shown. The results are valid without restrictions on the time horizon of the control problem, in contrast to iterative methods based on the theory of forward-backward stochastic differential equations.
Submission history
From: David Šiška [view email][v1] Fri, 10 Jul 2020 07:21:16 GMT (14kb,D)
[v2] Tue, 17 Nov 2020 16:00:11 GMT (15kb)
Link back to: arXiv, form interface, contact.