References & Citations
Computer Science > Neural and Evolutionary Computing
Title: Quality Diversity for Multi-task Optimization
(Submitted on 9 Mar 2020 (v1), last revised 17 Apr 2020 (this version, v2))
Abstract: Quality Diversity (QD) algorithms are a recent family of optimization algorithms that search for a large set of diverse but high-performing solutions. In some specific situations, they can solve multiple tasks at once. For instance, they can find the joint positions required for a robotic arm to reach a set of points, which can also be solved by running a classic optimizer for each target point. However, they cannot solve multiple tasks when the fitness needs to be evaluated independently for each task (e.g., optimizing policies to grasp many different objects). In this paper, we propose an extension of the MAP-Elites algorithm, called Multi-task MAP-Elites, that solves multiple tasks when the fitness function depends on the task. We evaluate it on a simulated parameterized planar arm (10-dimensional search space; 5000 tasks) and on a simulated 6-legged robot with legs of different lengths (36-dimensional search space; 2000 tasks). The results show that in both cases our algorithm outperforms the optimization of each task separately with the CMA-ES algorithm.
Submission history
From: Jean-Baptiste Mouret [view email][v1] Mon, 9 Mar 2020 20:48:07 GMT (3772kb,D)
[v2] Fri, 17 Apr 2020 09:53:07 GMT (3850kb,D)
Link back to: arXiv, form interface, contact.