We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cond-mat.str-el

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Quantum-Inspired Tensor Neural Networks for Partial Differential Equations

Abstract: Partial Differential Equations (PDEs) are used to model a variety of dynamical systems in science and engineering. Recent advances in deep learning have enabled us to solve them in a higher dimension by addressing the curse of dimensionality in new ways. However, deep learning methods are constrained by training time and memory. To tackle these shortcomings, we implement Tensor Neural Networks (TNN), a quantum-inspired neural network architecture that leverages Tensor Network ideas to improve upon deep learning approaches. We demonstrate that TNN provide significant parameter savings while attaining the same accuracy as compared to the classical Dense Neural Network (DNN). In addition, we also show how TNN can be trained faster than DNN for the same accuracy. We benchmark TNN by applying them to solve parabolic PDEs, specifically the Black-Scholes-Barenblatt equation, widely used in financial pricing theory, empirically showing the advantages of TNN over DNN. Further examples, such as the Hamilton-Jacobi-Bellman equation, are also discussed.
Comments: 14 pages, 11 figures, minimal changes
Subjects: Machine Learning (cs.LG); Strongly Correlated Electrons (cond-mat.str-el); Artificial Intelligence (cs.AI); Computational Physics (physics.comp-ph); Quantum Physics (quant-ph)
Cite as: arXiv:2208.02235 [cs.LG]
  (or arXiv:2208.02235v2 [cs.LG] for this version)

Submission history

From: Roman Orus [view email]
[v1] Wed, 3 Aug 2022 17:41:11 GMT (12196kb,D)
[v2] Wed, 10 Aug 2022 08:07:10 GMT (1417kb,D)

Link back to: arXiv, form interface, contact.