References & Citations
Mathematics > Numerical Analysis
Title: A multiscale neural network based on hierarchical nested bases
(Submitted on 4 Aug 2018 (v1), revised 26 Sep 2018 (this version, v2), latest version 25 Feb 2019 (v3))
Abstract: In recent years, deep learning has led to impressive results in many fields. In this paper, we introduce a multi-scale artificial neural network for high-dimensional non-linear maps based on the idea of hierarchical nested bases in the fast multipole method and the $\mathcal{H}^2$-matrices. This approach allows us to efficiently approximate discretized nonlinear maps arising from partial differential equations or integral equations. It also naturally extends our recent work based on the generalization of hierarchical matrices [Fan et al. arXiv:1807.01883] but with a reduced number of parameters. In particular, the number of parameters of the neural network grows linearly with the dimension of the parameter space of the discretized PDE. We demonstrate the properties of the architecture by approximating the solution maps of non-linear Schr{\"o}dinger equation, the radiative transfer equation, and the Kohn-Sham map.
Submission history
From: Yuwei Fan [view email][v1] Sat, 4 Aug 2018 22:54:48 GMT (535kb,D)
[v2] Wed, 26 Sep 2018 22:19:26 GMT (535kb,D)
[v3] Mon, 25 Feb 2019 22:05:52 GMT (632kb,D)
Link back to: arXiv, form interface, contact.