We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:


Current browse context:


Change to browse by:

References & Citations


(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Quantum Physics

Title: Quantum-enhanced reinforcement learning for finite-episode games with discrete state spaces

Abstract: Quantum annealing algorithms belong to the class of metaheuristic tools, applicable for solving binary optimization problems. Hardware implementations of quantum annealing, such as the quantum annealing machines produced by D-Wave Systems, have been subject to multiple analyses in research, with the aim of characterizing the technology's usefulness for optimization and sampling tasks. Here, we present a way to partially embed both Monte Carlo policy iteration for finding an optimal policy on random observations, as well as how to embed (n) sub-optimal state-value functions for approximating an improved state-value function given a policy for finite horizon games with discrete state spaces on a D-Wave 2000Q quantum processing unit (QPU). We explain how both problems can be expressed as a quadratic unconstrained binary optimization (QUBO) problem, and show that quantum-enhanced Monte Carlo policy evaluation allows for finding equivalent or better state-value functions for a given policy with the same number episodes compared to a purely classical Monte Carlo algorithm. Additionally, we describe a quantum-classical policy learning algorithm. Our first and foremost aim is to explain how to represent and solve parts of these problems with the help of the QPU, and not to prove supremacy over every existing classical policy evaluation algorithm.
Comments: 17 pages, 7 figures
Subjects: Quantum Physics (quant-ph); Information Theory (cs.IT)
Cite as: arXiv:1708.09354 [quant-ph]
  (or arXiv:1708.09354v3 [quant-ph] for this version)

Submission history

From: Florian Neukart [view email]
[v1] Wed, 30 Aug 2017 16:39:44 GMT (1341kb,D)
[v2] Fri, 1 Sep 2017 00:34:47 GMT (1341kb,D)
[v3] Fri, 15 Sep 2017 03:43:01 GMT (1820kb,D)

Link back to: arXiv, form interface, contact.