Current browse context:
cs.MA
Change to browse by:
References & Citations
Computer Science > Multiagent Systems
Title: Improved Reinforcement Learning in Cooperative Multi-agent Environments Using Knowledge Transfer
(Submitted on 20 Jul 2021 (v1), last revised 17 Jan 2022 (this version, v5))
Abstract: Nowadays, cooperative multi-agent systems are used to learn how to achieve goals in large-scale dynamic environments. However, learning in these environments is challenging: from the effect of search space size on learning time to inefficient cooperation among agents. Moreover, reinforcement learning algorithms may suffer from a long time of convergence in such environments. In this paper, a communication framework is introduced. In the proposed communication framework, agents learn to cooperate effectively and also by introduction of a new state calculation method the size of state space will decline considerably. Furthermore, a knowledge-transferring algorithm is presented to share the gained experiences among the different agents, and develop an effective knowledge-fusing mechanism to fuse the knowledge learnt utilizing the agents' own experiences with the knowledge received from other team members. Finally, the simulation results are provided to indicate the efficacy of the proposed method in the complex learning task. We have evaluated our approach on the shepherding problem and the results show that the learning process accelerates by making use of the knowledge transferring mechanism and the size of state space has declined by generating similar states based on state abstraction concept.
Submission history
From: Amin Nikanjam [view email][v1] Tue, 20 Jul 2021 23:42:39 GMT (478kb,D)
[v2] Sun, 25 Jul 2021 14:17:50 GMT (477kb,D)
[v3] Sun, 3 Oct 2021 14:04:33 GMT (1749kb)
[v4] Sun, 28 Nov 2021 22:55:52 GMT (1345kb)
[v5] Mon, 17 Jan 2022 19:23:02 GMT (2257kb)
Link back to: arXiv, form interface, contact.