Current browse context:
cs.AI
Change to browse by:
References & Citations
Computer Science > Artificial Intelligence
Title: The Power of Communication in a Distributed Multi-Agent System
(Submitted on 30 Nov 2021 (v1), last revised 14 Dec 2021 (this version, v3))
Abstract: Single-Agent (SA) Reinforcement Learning systems have shown outstanding re-sults on non-stationary problems. However, Multi-Agent Reinforcement Learning(MARL) can surpass SA systems generally and when scaling. Furthermore, MAsystems can be super-powered by collaboration, which can happen through ob-serving others, or a communication system used to share information betweencollaborators. Here, we developed a distributed MA learning mechanism withthe ability to communicate based on decentralised partially observable Markovdecision processes (Dec-POMDPs) and Graph Neural Networks (GNNs). Minimis-ing the time and energy consumed by training Machine Learning models whileimproving performance can be achieved by collaborative MA mechanisms. Wedemonstrate this in a real-world scenario, an offshore wind farm, including a set ofdistributed wind turbines, where the objective is to maximise collective efficiency.Compared to a SA system, MA collaboration has shown significantly reducedtraining time and higher cumulative rewards in unseen and scaled scenarios.
Submission history
From: Philipp Siedler [view email][v1] Tue, 30 Nov 2021 18:00:58 GMT (17022kb,D)
[v2] Wed, 1 Dec 2021 11:41:13 GMT (10404kb,D)
[v3] Tue, 14 Dec 2021 21:11:56 GMT (10404kb,D)
Link back to: arXiv, form interface, contact.