We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

math.FA

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo

Mathematics > Functional Analysis

Title: Neural network approximation and estimation of classifiers with classification boundary in a Barron class

Abstract: We prove bounds for the approximation and estimation of certain binary classification functions using ReLU neural networks. Our estimation bounds provide a priori performance guarantees for empirical risk minimization using networks of a suitable size, depending on the number of training samples available. The obtained approximation and estimation rates are independent of the dimension of the input, showing that the curse of dimensionality can be overcome in this setting; in fact, the input dimension only enters in the form of a polynomial factor. Regarding the regularity of the target classification function, we assume the interfaces between the different classes to be locally of Barron-type. We complement our results by studying the relations between various Barron-type spaces that have been proposed in the literature. These spaces differ substantially more from each other than the current literature suggests.
Subjects: Functional Analysis (math.FA); Machine Learning (stat.ML)
MSC classes: 68T07, 41A25, 41A46, 42B35, 46E15
Cite as: arXiv:2011.09363 [math.FA]
  (or arXiv:2011.09363v2 [math.FA] for this version)

Submission history

From: Philipp Petersen [view email]
[v1] Wed, 18 Nov 2020 16:00:31 GMT (106kb,D)
[v2] Thu, 10 Mar 2022 16:32:53 GMT (95kb,D)

Link back to: arXiv, form interface, contact.