We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Heteroscedastic Bayesian Optimisation for Stochastic Model Predictive Control

Abstract: Model predictive control (MPC) has been successful in applications involving the control of complex physical systems. This class of controllers leverages the information provided by an approximate model of the system's dynamics to simulate the effect of control actions. MPC methods also present a few hyper-parameters which may require a relatively expensive tuning process by demanding interactions with the physical system. Therefore, we investigate fine-tuning MPC methods in the context of stochastic MPC, which presents extra challenges due to the randomness of the controller's actions. In these scenarios, performance outcomes present noise, which is not homogeneous across the domain of possible hyper-parameter settings, but which varies in an input-dependent way. To address these issues, we propose a Bayesian optimisation framework that accounts for heteroscedastic noise to tune hyper-parameters in control problems. Empirical results on benchmark continuous control tasks and a physical robot support the proposed framework's suitability relative to baselines, which do not take heteroscedasticity into account.
Comments: Paper to appear at the IEEE Robotics and Automation Letters (RA-L)
Subjects: Machine Learning (cs.LG); Robotics (cs.RO); Machine Learning (stat.ML)
Cite as: arXiv:2010.00202 [cs.LG]
  (or arXiv:2010.00202v2 [cs.LG] for this version)

Submission history

From: Rel Guzman [view email]
[v1] Thu, 1 Oct 2020 05:31:41 GMT (2016kb,D)
[v2] Thu, 8 Oct 2020 03:01:52 GMT (2016kb,D)

Link back to: arXiv, form interface, contact.