We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.RO

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Robotics

Title: Entropy-Guided Control Improvisation

Abstract: High level declarative constraints provide a powerful (and popular) way to define and construct control policies; however, most synthesis algorithms do not support specifying the degree of randomness (unpredictability) of the resulting controller. In many contexts, e.g., patrolling, testing, behavior prediction,and planning on idealized models, predictable or biased controllers are undesirable. To address these concerns, we introduce the \emph{Entropic Reactive Control Improvisation} (ERCI) framework and algorithm which supports synthesizing control policies for stochastic games that are declaratively specified by (i) a \emph{hard constraint} specifying what must occur, (ii) a \emph{soft constraint} specifying what typically occurs, and (iii) a \emph{randomization constraint} specifying the unpredictability and variety of the controller, as quantified using causal entropy. This framework, extends the state of the art by supporting arbitrary combinations of adversarial and probabilistic uncertainty in the environment. ERCI enables a flexible modeling formalism which we argue, theoretically and empirically, remains tractable.
Comments: RSS 21
Subjects: Robotics (cs.RO); Formal Languages and Automata Theory (cs.FL)
Cite as: arXiv:2103.05672 [cs.RO]
  (or arXiv:2103.05672v2 [cs.RO] for this version)

Submission history

From: Marcell Vazquez-Chanlatte [view email]
[v1] Tue, 9 Mar 2021 19:18:58 GMT (125kb,D)
[v2] Mon, 28 Jun 2021 23:16:38 GMT (139kb,D)

Link back to: arXiv, form interface, contact.