References & Citations
Computer Science > Artificial Intelligence
Title: Neighborhood Cognition Consistent Multi-Agent Reinforcement Learning
(Submitted on 3 Dec 2019 (v1), last revised 10 Feb 2020 (this version, v2))
Abstract: Social psychology and real experiences show that cognitive consistency plays an important role to keep human society in order: if people have a more consistent cognition about their environments, they are more likely to achieve better cooperation. Meanwhile, only cognitive consistency within a neighborhood matters because humans only interact directly with their neighbors. Inspired by these observations, we take the first step to introduce \emph{neighborhood cognitive consistency} (NCC) into multi-agent reinforcement learning (MARL). Our NCC design is quite general and can be easily combined with existing MARL methods. As examples, we propose neighborhood cognition consistent deep Q-learning and Actor-Critic to facilitate large-scale multi-agent cooperations. Extensive experiments on several challenging tasks (i.e., packet routing, wifi configuration, and Google football player control) justify the superior performance of our methods compared with state-of-the-art MARL approaches.
Submission history
From: Hangyu Mao [view email][v1] Tue, 3 Dec 2019 02:34:11 GMT (2909kb,I)
[v2] Mon, 10 Feb 2020 02:38:59 GMT (2909kb,D)
Link back to: arXiv, form interface, contact.