We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: Lessons from AlphaZero for Optimal, Model Predictive, and Adaptive Control

Abstract: In this paper we aim to provide analysis and insights (often based on visualization), which explain the beneficial effects of on-line decision making on top of off-line training. In particular, through a unifying abstract mathematical framework, we show that the principal AlphaZero/TD-Gammon ideas of approximation in value space and rollout apply very broadly to deterministic and stochastic optimal control problems, involving both discrete and continuous search spaces. Moreover, these ideas can be effectively integrated with other important methodologies such as model predictive control, adaptive control, decentralized control, discrete and Bayesian optimization, neural network-based value and policy approximations, and heuristic algorithms for discrete optimization.
Subjects: Optimization and Control (math.OC); Artificial Intelligence (cs.AI)
MSC classes: 49L20, 90C39
Cite as: arXiv:2108.10315 [math.OC]
  (or arXiv:2108.10315v1 [math.OC] for this version)

Submission history

From: Dimitri Bertsekas [view email]
[v1] Fri, 20 Aug 2021 19:17:35 GMT (8034kb)

Link back to: arXiv, form interface, contact.