Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: Provable approximation properties for deep neural networks
(Submitted on 24 Sep 2015 (v1), last revised 28 Mar 2016 (this version, v3))
Abstract: We discuss approximation of functions using deep neural nets. Given a function $f$ on a $d$-dimensional manifold $\Gamma \subset \mathbb{R}^m$, we construct a sparsely-connected depth-4 neural network and bound its error in approximating $f$. The size of the network depends on dimension and curvature of the manifold $\Gamma$, the complexity of $f$, in terms of its wavelet description, and only weakly on the ambient dimension $m$. Essentially, our network computes wavelet functions, which are computed from Rectified Linear Units (ReLU)
Submission history
From: Uri Shaham [view email][v1] Thu, 24 Sep 2015 14:20:29 GMT (315kb,D)
[v2] Thu, 1 Oct 2015 14:31:54 GMT (315kb,D)
[v3] Mon, 28 Mar 2016 13:46:06 GMT (444kb,D)
Link back to: arXiv, form interface, contact.