We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Unreliable Multi-Armed Bandits: A Novel Approach to Recommendation Systems

Abstract: We use a novel modification of Multi-Armed Bandits to create a new model for recommendation systems. We model the recommendation system as a bandit seeking to maximize reward by pulling on arms with unknown rewards. The catch however is that this bandit can only access these arms through an unreliable intermediate that has some level of autonomy while choosing its arms. For example, in a streaming website the user has a lot of autonomy while choosing content they want to watch. The streaming sites can use targeted advertising as a means to bias opinions of these users. Here the streaming site is the bandit aiming to maximize reward and the user is the unreliable intermediate. We model the intermediate as accessing states via a Markov chain. The bandit is allowed to perturb this Markov chain. We prove fundamental theorems for this setting after which we show a close-to-optimal Explore-Commit algorithm.
Comments: 4 pages, 4 figures, Aditya Narayan Ravi and Pranav Poduval have equal contribution
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG); Applications (stat.AP)
Cite as: arXiv:1911.06239 [stat.ML]
  (or arXiv:1911.06239v1 [stat.ML] for this version)

Submission history

From: Aditya Narayan Ravi [view email]
[v1] Thu, 14 Nov 2019 16:55:29 GMT (131kb,D)

Link back to: arXiv, form interface, contact.