We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Computer Science > Machine Learning

Title: Approximation in shift-invariant spaces with deep ReLU neural networks

Abstract: We study the expressive power of deep ReLU neural networks for approximating functions in dilated shift-invariant spaces, which are widely used in signal processing, image processing, communications and so on. Approximation error bounds are estimated with respect to the width and depth of neural networks. The network construction is based on the bit extraction and data-fitting capacity of deep neural networks. As applications of our main results, the approximation rates of classical function spaces such as Sobolev spaces and Besov spaces are obtained. We also give lower bounds of the $L^p (1\le p \le \infty)$ approximation error for Sobolev spaces, which show that our construction of neural network is asymptotically optimal up to a logarithmic factor.
Subjects: Machine Learning (cs.LG); Numerical Analysis (math.NA); Machine Learning (stat.ML)
Journal reference: Neural Networks, 153:269-281, 2022
DOI: 10.1016/j.neunet.2022.06.013
Cite as: arXiv:2005.11949 [cs.LG]
  (or arXiv:2005.11949v3 [cs.LG] for this version)

Submission history

From: Yunfei Yang [view email]
[v1] Mon, 25 May 2020 07:23:47 GMT (49kb,D)
[v2] Mon, 21 Jun 2021 08:47:13 GMT (64kb,D)
[v3] Sun, 19 Jun 2022 07:13:05 GMT (57kb,D)

Link back to: arXiv, form interface, contact.