We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Ancillary-file links:

Ancillary files (details):

Current browse context:

quant-ph

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Quantum Physics

Title: Self-Correcting Quantum Many-Body Control using Reinforcement Learning with Tensor Networks

Abstract: Quantum many-body control is a central milestone en route to harnessing quantum technologies. However, the exponential growth of the Hilbert space dimension with the number of qubits makes it challenging to classically simulate quantum many-body systems and consequently, to devise reliable and robust optimal control protocols. Here, we present a novel framework for efficiently controlling quantum many-body systems based on reinforcement learning (RL). We tackle the quantum control problem by leveraging matrix product states (i) for representing the many-body state and, (ii) as part of the trainable machine learning architecture for our RL agent. The framework is applied to prepare ground states of the quantum Ising chain, including states in the critical region. It allows us to control systems far larger than neural-network-only architectures permit, while retaining the advantages of deep learning algorithms, such as generalizability and trainable robustness to noise. In particular, we demonstrate that RL agents are capable of finding universal controls, of learning how to optimally steer previously unseen many-body states, and of adapting control protocols on-the-fly when the quantum dynamics is subject to stochastic perturbations. Furthermore, we map the QMPS framework to a hybrid quantum-classical algorithm that can be performed on noisy intermediate-scale quantum devices and test it under the presence of experimentally relevant sources of noise.
Comments: 12 pages, 7 figures. App: 18 pages, 18 figures. 3 anc video files. New content: QMPS circuit framework for NISQ devices, novel MPO-based architecture, detailed analysis of effects of noise, etc
Subjects: Quantum Physics (quant-ph); Other Condensed Matter (cond-mat.other); Quantum Gases (cond-mat.quant-gas); Statistical Mechanics (cond-mat.stat-mech)
Journal reference: Nature Machine Intelligence 5, 780-791 (2023)
DOI: 10.1038/s42256-023-00687-5
Cite as: arXiv:2201.11790 [quant-ph]
  (or arXiv:2201.11790v2 [quant-ph] for this version)

Submission history

From: Friederike Metz [view email]
[v1] Thu, 27 Jan 2022 20:14:09 GMT (13401kb,AD)
[v2] Thu, 11 May 2023 20:36:00 GMT (19833kb,AD)

Link back to: arXiv, form interface, contact.