Current browse context:
math.OC
Change to browse by:
References & Citations
Mathematics > Optimization and Control
Title: Non-local Optimization: Imposing Structure on Optimization Problems by Relaxation
(Submitted on 11 Nov 2020 (v1), last revised 24 Jul 2021 (this version, v3))
Abstract: In stochastic optimization, particularly in evolutionary computation and reinforcement learning, the optimization of a function $f: \Omega \to \mathbb{R}$ is often addressed through optimizing a so-called relaxation $\theta \in \Theta \mapsto \mathbb{E}_\theta(f)$ of $f$, where $\Theta$ resembles the parameters of a family of probability measures on $\Omega$. We investigate the structure of such relaxations by means of measure theory and Fourier analysis, enabling us to shed light on the success of many associated stochastic optimization methods. The main structural traits we derive and that allow fast and reliable optimization of relaxations are the consistency of optimal values of $f$, Lipschitzness of gradients, and convexity. We emphasize settings where $f$ itself is not differentiable or convex, e.g., in the presence of (stochastic) disturbance.
Submission history
From: Nils Müller [view email][v1] Wed, 11 Nov 2020 20:45:47 GMT (93kb)
[v2] Mon, 4 Jan 2021 15:27:50 GMT (96kb)
[v3] Sat, 24 Jul 2021 13:20:12 GMT (97kb)
Link back to: arXiv, form interface, contact.