References & Citations
Computer Science > Artificial Intelligence
Title: Loss Bounds for Approximate Influence-Based Abstraction
(Submitted on 3 Nov 2020 (v1), last revised 23 Feb 2021 (this version, v3))
Abstract: Sequential decision making techniques hold great promise to improve the performance of many real-world systems, but computational complexity hampers their principled application. Influence-based abstraction aims to gain leverage by modeling local subproblems together with the 'influence' that the rest of the system exerts on them. While computing exact representations of such influence might be intractable, learning approximate representations offers a promising approach to enable scalable solutions. This paper investigates the performance of such approaches from a theoretical perspective. The primary contribution is the derivation of sufficient conditions on approximate influence representations that can guarantee solutions with small value loss. In particular we show that neural networks trained with cross entropy are well suited to learn approximate influence representations. Moreover, we provide a sample based formulation of the bounds, which reduces the gap to applications. Finally, driven by our theoretical insights, we propose approximation error estimators, which empirically reveal to correlate well with the value loss.
Submission history
From: Elena Congeduti [view email][v1] Tue, 3 Nov 2020 15:33:10 GMT (476kb,D)
[v2] Thu, 18 Feb 2021 10:25:38 GMT (819kb,D)
[v3] Tue, 23 Feb 2021 15:31:22 GMT (819kb,D)
Link back to: arXiv, form interface, contact.