We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.OC

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Optimization and Control

Title: Wasserstein Contraction Bounds on Closed Convex Domains with Applications to Stochastic Adaptive Control

Abstract: This paper is motivated by the problem of quantitatively bounding the convergence of adaptive control methods for stochastic systems to a stationary distribution. Such bounds are useful for analyzing statistics of trajectories and determining appropriate step sizes for simulations. To this end, we extend a methodology from (unconstrained) stochastic differential equations (SDEs) which provides contractions in a specially chosen Wasserstein distance. This theory focuses on unconstrained SDEs with fairly restrictive assumptions on the drift terms. Typical adaptive control schemes place constraints on the learned parameters and their update rules violate the drift conditions. To this end, we extend the contraction theory to the case of constrained systems represented by reflected stochastic differential equations and generalize the allowable drifts. We show how the general theory can be used to derive quantitative contraction bounds on a nonlinear stochastic adaptive regulation problem.
Subjects: Optimization and Control (math.OC)
Cite as: arXiv:2109.12198 [math.OC]
  (or arXiv:2109.12198v2 [math.OC] for this version)

Submission history

From: Tyler Lekang [view email]
[v1] Fri, 24 Sep 2021 21:13:47 GMT (2948kb,D)
[v2] Fri, 15 Oct 2021 22:41:19 GMT (4634kb,D)

Link back to: arXiv, form interface, contact.