We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.NA

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Mathematics > Numerical Analysis

Title: Machine Learning For Elliptic PDEs: Fast Rate Generalization Bound, Neural Scaling Law and Minimax Optimality

Abstract: In this paper, we study the statistical limits of deep learning techniques for solving elliptic partial differential equations (PDEs) from random samples using the Deep Ritz Method (DRM) and Physics-Informed Neural Networks (PINNs). To simplify the problem, we focus on a prototype elliptic PDE: the Schr\"odinger equation on a hypercube with zero Dirichlet boundary condition, which has wide application in the quantum-mechanical systems. We establish upper and lower bounds for both methods, which improves upon concurrently developed upper bounds for this problem via a fast rate generalization bound. We discover that the current Deep Ritz Methods is sub-optimal and propose a modified version of it. We also prove that PINN and the modified version of DRM can achieve minimax optimal bounds over Sobolev spaces. Empirically, following recent work which has shown that the deep model accuracy will improve with growing training sets according to a power law, we supply computational experiments to show a similar behavior of dimension dependent power law for deep PDE solvers.
Comments: add a proof Proof Sketch in section 4.1
Subjects: Numerical Analysis (math.NA); Machine Learning (cs.LG); Statistics Theory (math.ST); Computational Physics (physics.comp-ph); Machine Learning (stat.ML)
Cite as: arXiv:2110.06897 [math.NA]
  (or arXiv:2110.06897v2 [math.NA] for this version)

Submission history

From: Yiping Lu [view email]
[v1] Wed, 13 Oct 2021 17:26:31 GMT (1809kb,D)
[v2] Sat, 13 Nov 2021 02:25:51 GMT (1810kb,D)

Link back to: arXiv, form interface, contact.