Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Rotting Bandits
(Submitted on 23 Feb 2017 (v1), last revised 2 Nov 2017 (this version, v4))
Abstract: The Multi-Armed Bandits (MAB) framework highlights the tension between acquiring new knowledge (Exploration) and leveraging available knowledge (Exploitation). In the classical MAB problem, a decision maker must choose an arm at each time step, upon which she receives a reward. The decision maker's objective is to maximize her cumulative expected reward over the time horizon. The MAB problem has been studied extensively, specifically under the assumption of the arms' rewards distributions being stationary, or quasi-stationary, over time. We consider a variant of the MAB framework, which we termed Rotting Bandits, where each arm's expected reward decays as a function of the number of times it has been pulled. We are motivated by many real-world scenarios such as online advertising, content recommendation, crowdsourcing, and more. We present algorithms, accompanied by simulations, and derive theoretical guarantees.
Submission history
From: Nir Levine [view email][v1] Thu, 23 Feb 2017 16:03:30 GMT (320kb,D)
[v2] Fri, 24 Feb 2017 11:09:19 GMT (372kb,D)
[v3] Mon, 12 Jun 2017 13:48:30 GMT (208kb,D)
[v4] Thu, 2 Nov 2017 15:32:09 GMT (208kb,D)
Link back to: arXiv, form interface, contact.