We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Optimization and Control

Title: Convergence of a robust deep FBSDE method for stochastic control

Abstract: In this paper, we propose a deep learning based numerical scheme for strongly coupled FBSDEs, stemming from stochastic control. It is a modification of the deep BSDE method in which the initial value to the backward equation is not a free parameter, and with a new loss function being the weighted sum of the cost of the control problem, and a variance term which coincides with the mean squared error in the terminal condition. We show by a numerical example that a direct extension of the classical deep BSDE method to FBSDEs, fails for a simple linear-quadratic control problem, and motivate why the new method works. Under regularity and boundedness assumptions on the exact controls of time continuous and time discrete control problems, we provide an error analysis for our method. We show empirically that the method converges for three different problems, one being the one that failed for a direct extension of the deep BSDE method.
Comments: 27 pages, 5 figures, 2 tables
Subjects: Optimization and Control (math.OC); Numerical Analysis (math.NA); Probability (math.PR); Machine Learning (stat.ML)
MSC classes: 49M25, 60H30, 60H35, 65C30
Cite as: arXiv:2201.06854 [math.OC]
  (or arXiv:2201.06854v5 [math.OC] for this version)

Submission history

From: Adam Andersson [view email]
[v1] Tue, 18 Jan 2022 10:06:57 GMT (2687kb,D)
[v2] Sun, 6 Feb 2022 20:36:52 GMT (2717kb,D)
[v3] Sat, 26 Feb 2022 14:25:29 GMT (2674kb,D)
[v4] Sun, 14 Aug 2022 13:51:43 GMT (2957kb,D)
[v5] Thu, 9 Feb 2023 18:22:14 GMT (2958kb,D)

Link back to: arXiv, form interface, contact.