We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Logical Team Q-learning: An approach towards factored policies in cooperative MARL

Abstract: We address the challenge of learning factored policies in cooperative MARL scenarios. In particular, we consider the situation in which a team of agents collaborates to optimize a common cost. Our goal is to obtain factored policies that determine the individual behavior of each agent so that the resulting joint policy is optimal. In this work we make contributions to both the dynamic programming and reinforcement learning settings. In the dynamic programming case we provide a number of lemmas that prove the existence of such factored policies and we introduce an algorithm (along with proof of convergence) that provably leads to them. Then we introduce tabular and deep versions of Logical Team Q-learning, which is a stochastic version of the algorithm for the RL case. We conclude the paper by providing experiments that illustrate the claims.
Subjects: Machine Learning (cs.LG); Artificial Intelligence (cs.AI); Multiagent Systems (cs.MA); Systems and Control (eess.SY); Machine Learning (stat.ML)
Cite as: arXiv:2006.03553 [cs.LG]
  (or arXiv:2006.03553v1 [cs.LG] for this version)

Submission history

From: Lucas Cassano Dr. [view email]
[v1] Fri, 5 Jun 2020 17:02:36 GMT (3033kb,D)
[v2] Sun, 28 Mar 2021 19:05:57 GMT (3670kb,D)

Link back to: arXiv, form interface, contact.