We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Sharp bounds on the price of bandit feedback for several models of mistake-bounded online learning

Abstract: We determine sharp bounds on the price of bandit feedback for several variants of the mistake-bound model. The first part of the paper presents bounds on the $r$-input weak reinforcement model and the $r$-input delayed, ambiguous reinforcement model. In both models, the adversary gives $r$ inputs in each round and only indicates a correct answer if all $r$ guesses are correct. The only difference between the two models is that in the delayed, ambiguous model, the learner must answer each input before receiving the next input of the round, while the learner receives all $r$ inputs at once in the weak reinforcement model. In the second part of the paper, we introduce models for online learning with permutation patterns, in which a learner attempts to learn a permutation from a set of permutations by guessing statistics related to sub-permutations. For these permutation models, we prove sharp bounds on the price of bandit feedback.
Subjects: Machine Learning (cs.LG); Discrete Mathematics (cs.DM); Combinatorics (math.CO)
Cite as: arXiv:2209.01366 [cs.LG]
  (or arXiv:2209.01366v1 [cs.LG] for this version)

Submission history

From: Jesse Geneson [view email]
[v1] Sat, 3 Sep 2022 08:29:09 GMT (18kb)

Link back to: arXiv, form interface, contact.