Current browse context:
cs.IT
Change to browse by:
References & Citations
Computer Science > Information Theory
Title: Reinforcement Learning with Budget-Constrained Nonparametric Function Approximation for Opportunistic Spectrum Access
(Submitted on 14 Jun 2017 (v1), last revised 20 Jun 2018 (this version, v2))
Abstract: Opportunistic spectrum access is one of the emerging techniques for maximizing throughput in congested bands and is enabled by predicting idle slots in spectrum. We propose a kernel-based reinforcement learning approach coupled with a novel budget-constrained sparsification technique that efficiently captures the environment to find the best channel access actions. This approach allows learning and planning over the intrinsic state-action space and extends well to large state spaces. We apply our methods to evaluate coexistence of a reinforcement learning-based radio with a multi-channel adversarial radio and a single-channel CSMA-CA radio. Numerical experiments show the performance gains over carrier-sense systems.
Submission history
From: Theodoros Tsiligkaridis [view email][v1] Wed, 14 Jun 2017 15:44:52 GMT (725kb,D)
[v2] Wed, 20 Jun 2018 19:46:21 GMT (90kb,D)
Link back to: arXiv, form interface, contact.