We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Neural and Evolutionary Computing

Title: Evolutionary Multi-Armed Bandits with Genetic Thompson Sampling

Authors: Baihan Lin
Abstract: As two popular schools of machine learning, online learning and evolutionary computations have become two important driving forces behind real-world decision making engines for applications in biomedicine, economics, and engineering fields. Although there are prior work that utilizes bandits to improve evolutionary algorithms' optimization process, it remains a field of blank on how evolutionary approach can help improve the sequential decision making tasks of online learning agents such as the multi-armed bandits. In this work, we propose the Genetic Thompson Sampling, a bandit algorithm that keeps a population of agents and update them with genetic principles such as elite selection, crossover and mutations. Empirical results in multi-armed bandit simulation environments and a practical epidemic control problem suggest that by incorporating the genetic algorithm into the bandit algorithm, our method significantly outperforms the baselines in nonstationary settings. Lastly, we introduce EvoBandit, a web-based interactive visualization to guide the readers through the entire learning process and perform lightweight evaluations on the fly. We hope to engage researchers into this growing field of research with this investigation.
Comments: Proceeding of IEEE CEC 2022. This work is one of the first works to solve the online learning problems with distributed evolutionary optimizations, and extends our prior work on contextual bandits (e.g. arXiv:2106.15808) by testing against similar simulated and real-world scenarios. Codes at this https URL
Subjects: Neural and Evolutionary Computing (cs.NE); Artificial Intelligence (cs.AI); Machine Learning (cs.LG); Multiagent Systems (cs.MA); Machine Learning (stat.ML)
Cite as: arXiv:2205.10113 [cs.NE]
  (or arXiv:2205.10113v1 [cs.NE] for this version)

Submission history

From: Baihan Lin [view email]
[v1] Tue, 26 Apr 2022 22:41:17 GMT (6508kb,D)

Link back to: arXiv, form interface, contact.