References & Citations
Computer Science > Systems and Control
Title: Nonparametric Infinite Horizon Kullback-Leibler Stochastic Control
(Submitted on 15 Apr 2014 (v1), last revised 15 Jun 2016 (this version, v4))
Abstract: We present two nonparametric approaches to Kullback-Leibler (KL) control, or linearly-solvable Markov decision problem (LMDP) based on Gaussian processes (GP) and Nystr\"{o}m approximation. Compared to recently developed parametric methods, the proposed data-driven frameworks feature accurate function approximation and efficient on-line operations. Theoretically, we derive the mathematical connection of KL control based on dynamic programming with earlier work in control theory which relies on information theoretic dualities for the infinite time horizon case. Algorithmically, we give explicit optimal control policies in nonparametric forms, and propose on-line update schemes with budgeted computational costs. Numerical results demonstrate the effectiveness and usefulness of the proposed frameworks.
Submission history
From: Yunpeng Pan [view email][v1] Tue, 15 Apr 2014 16:48:42 GMT (390kb)
[v2] Wed, 16 Apr 2014 01:44:11 GMT (390kb)
[v3] Sun, 15 Jun 2014 03:00:47 GMT (386kb)
[v4] Wed, 15 Jun 2016 22:00:07 GMT (386kb)
Link back to: arXiv, form interface, contact.