References & Citations
Computer Science > Machine Learning
Title: Efficient search of active inference policy spaces using k-means
(Submitted on 6 Sep 2022 (v1), last revised 6 Oct 2022 (this version, v3))
Abstract: We develop an approach to policy selection in active inference that allows us to efficiently search large policy spaces by mapping each policy to its embedding in a vector space. We sample the expected free energy of representative points in the space, then perform a more thorough policy search around the most promising point in this initial sample. We consider various approaches to creating the policy embedding space, and propose using k-means clustering to select representative points. We apply our technique to a goal-oriented graph-traversal problem, for which naive policy selection is intractable for even moderately large graphs.
Submission history
From: Alexander Kiefer [view email][v1] Tue, 6 Sep 2022 14:57:43 GMT (1098kb)
[v2] Wed, 7 Sep 2022 04:09:49 GMT (861kb,D)
[v3] Thu, 6 Oct 2022 03:29:53 GMT (818kb,D)
Link back to: arXiv, form interface, contact.