Current browse context:
cs.NE
Change to browse by:
References & Citations
Computer Science > Neural and Evolutionary Computing
Title: Heterogeneous Multi-agent Zero-Shot Coordination by Coevolution
(Submitted on 9 Aug 2022 (v1), last revised 20 Jan 2024 (this version, v2))
Abstract: Generating agents that can achieve zero-shot coordination (ZSC) with unseen partners is a new challenge in cooperative multi-agent reinforcement learning (MARL). Recently, some studies have made progress in ZSC by exposing the agents to diverse partners during the training process. They usually involve self-play when training the partners, implicitly assuming that the tasks are homogeneous. However, many real-world tasks are heterogeneous, and hence previous methods may be inefficient. In this paper, we study the heterogeneous ZSC problem for the first time and propose a general method based on coevolution, which coevolves two populations of agents and partners through three sub-processes: pairing, updating and selection. Experimental results on various heterogeneous tasks highlight the necessity of considering the heterogeneous setting and demonstrate that our proposed method is a promising solution for heterogeneous ZSC tasks.
Submission history
From: Chao Qian [view email][v1] Tue, 9 Aug 2022 16:16:28 GMT (3563kb,D)
[v2] Sat, 20 Jan 2024 06:01:06 GMT (5850kb,D)
Link back to: arXiv, form interface, contact.