Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Online Learning in Contextual Bandits using Gated Linear Networks
(Submitted on 21 Feb 2020 (v1), last revised 20 Nov 2020 (this version, v2))
Abstract: We introduce a new and completely online contextual bandit algorithm called Gated Linear Contextual Bandits (GLCB). This algorithm is based on Gated Linear Networks (GLNs), a recently introduced deep learning architecture with properties well-suited to the online setting. Leveraging data-dependent gating properties of the GLN we are able to estimate prediction uncertainty with effectively zero algorithmic overhead. We empirically evaluate GLCB compared to 9 state-of-the-art algorithms that leverage deep neural networks, on a standard benchmark suite of discrete and continuous contextual bandit problems. GLCB obtains median first-place despite being the only online method, and we further support these results with a theoretical study of its convergence properties.
Submission history
From: Eren Sezener [view email][v1] Fri, 21 Feb 2020 11:50:43 GMT (1479kb,D)
[v2] Fri, 20 Nov 2020 09:38:19 GMT (8064kb,D)
Link back to: arXiv, form interface, contact.