We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.NA

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Numerical Analysis

Title: Computation complexity of deep ReLU neural networks in high-dimensional approximation

Abstract: The purpose of the present paper is to study the computation complexity of deep ReLU neural networks to approximate functions in H\"older-Nikol'skii spaces of mixed smoothness $H_\infty^\alpha(\mathbb{I}^d)$ on the unit cube $\mathbb{I}^d:=[0,1]^d$. In this context, for any function $f\in H_\infty^\alpha(\mathbb{I}^d)$, we explicitly construct nonadaptive and adaptive deep ReLU neural networks having an output that approximates $f$ with a prescribed accuracy $\varepsilon$, and prove dimension-dependent bounds for the computation complexity of this approximation, characterized by the size and the depth of this deep ReLU neural network, explicitly in $d$ and $\varepsilon$. Our results show the advantage of the adaptive method of approximation by deep ReLU neural networks over nonadaptive one.
Comments: 30 pages. arXiv admin note: text overlap with arXiv:2007.08729
Subjects: Numerical Analysis (math.NA)
Cite as: arXiv:2103.00815 [math.NA]
  (or arXiv:2103.00815v1 [math.NA] for this version)

Submission history

From: Van Kien Nguyen [view email]
[v1] Mon, 1 Mar 2021 07:30:31 GMT (31kb)

Link back to: arXiv, form interface, contact.