We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Optimization and Control

Title: Probabilistic design of optimal sequential decision-making algorithms in learning and control

Abstract: This survey is focused on certain sequential decision-making problems that involve optimizing over probability functions. We discuss the relevance of these problems for learning and control. The survey is organized around a framework that combines a problem formulation and a set of resolution methods. The formulation consists of an infinite-dimensional optimization problem. The methods come from approaches to search optimal solutions in the space of probability functions. Through the lenses of this overarching framework we revisit popular learning and control algorithms, showing that these naturally arise from suitable variations on the formulation mixed with different resolution methods. A running example, for which we make the code available, complements the survey. Finally, a number of challenges arising from the survey are also outlined.
Subjects: Optimization and Control (math.OC); Systems and Control (eess.SY)
Cite as: arXiv:2201.05212 [math.OC]
  (or arXiv:2201.05212v2 [math.OC] for this version)

Submission history

From: Giovanni Russo [view email]
[v1] Thu, 13 Jan 2022 21:05:50 GMT (546kb,D)
[v2] Thu, 30 Jun 2022 07:42:42 GMT (561kb,D)

Link back to: arXiv, form interface, contact.