We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: An Information-theoretic On-line Learning Principle for Specialization in Hierarchical Decision-Making Systems

Abstract: Information-theoretic bounded rationality describes utility-optimizing decision-makers whose limited information-processing capabilities are formalized by information constraints. One of the consequences of bounded rationality is that resource-limited decision-makers can join together to solve decision-making problems that are beyond the capabilities of each individual. Here, we study an information-theoretic principle that drives division of labor and specialization when decision-makers with information constraints are joined together. We devise an on-line learning rule of this principle that learns a partitioning of the problem space such that it can be solved by specialized linear policies. We demonstrate the approach for decision-making problems whose complexity exceeds the capabilities of individual decision-makers, but can be solved by combining the decision-makers optimally. The strength of the model is that it is abstract and principled, yet has direct applications in classification, regression, reinforcement learning and adaptive control.
Subjects: Machine Learning (cs.LG); Information Theory (cs.IT); Machine Learning (stat.ML)
Cite as: arXiv:1907.11452 [cs.LG]
  (or arXiv:1907.11452v3 [cs.LG] for this version)

Submission history

From: Heinke Hihn [view email]
[v1] Fri, 26 Jul 2019 09:28:18 GMT (1666kb,D)
[v2] Thu, 31 Oct 2019 12:37:49 GMT (1852kb,D)
[v3] Thu, 5 Dec 2019 09:22:15 GMT (960kb,D)

Link back to: arXiv, form interface, contact.