Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Logical Team Q-learning: An approach towards factored policies in cooperative MARL
(Submitted on 5 Jun 2020 (this version), latest version 28 Mar 2021 (v2))
Abstract: We address the challenge of learning factored policies in cooperative MARL scenarios. In particular, we consider the situation in which a team of agents collaborates to optimize a common cost. Our goal is to obtain factored policies that determine the individual behavior of each agent so that the resulting joint policy is optimal. In this work we make contributions to both the dynamic programming and reinforcement learning settings. In the dynamic programming case we provide a number of lemmas that prove the existence of such factored policies and we introduce an algorithm (along with proof of convergence) that provably leads to them. Then we introduce tabular and deep versions of Logical Team Q-learning, which is a stochastic version of the algorithm for the RL case. We conclude the paper by providing experiments that illustrate the claims.
Submission history
From: Lucas Cassano Dr. [view email][v1] Fri, 5 Jun 2020 17:02:36 GMT (3033kb,D)
[v2] Sun, 28 Mar 2021 19:05:57 GMT (3670kb,D)
Link back to: arXiv, form interface, contact.