References & Citations
Computer Science > Neural and Evolutionary Computing
Title: Drift Theory in Continuous Search Spaces: Expected Hitting Time of the (1+1)-ES with 1/5 Success Rule
(Submitted on 9 Feb 2018 (v1), last revised 29 Jan 2019 (this version, v4))
Abstract: This paper explores the use of the standard approach for proving runtime bounds in discrete domains---often referred to as drift analysis---in the context of optimization on a continuous domain. Using this framework we analyze the (1+1) Evolution Strategy with one-fifth success rule on the sphere function. To deal with potential functions that are not lower-bounded, we formulate novel drift theorems. We then use the theorems to prove bounds on the expected hitting time to reach a certain target fitness in finite dimension $d$. The bounds are akin to linear convergence. We then study the dependency of the different terms on $d$ proving a convergence rate dependency of $\Theta(1/d)$. Our results constitute the first non-asymptotic analysis for the algorithm considered as well as the first explicit application of drift analysis to a randomized search heuristic with continuous domain.
Submission history
From: Youhei Akimoto [view email][v1] Fri, 9 Feb 2018 11:28:50 GMT (34kb,D)
[v2] Wed, 18 Apr 2018 12:23:44 GMT (34kb,D)
[v3] Wed, 9 Jan 2019 09:24:05 GMT (34kb,D)
[v4] Tue, 29 Jan 2019 23:00:06 GMT (34kb,D)
Link back to: arXiv, form interface, contact.