### Current browse context:

stat.ML

### Change to browse by:

### References & Citations

# Statistics > Machine Learning

# Title: Function approximation by deep neural networks with parameters $\{0,\pm \frac{1}{2}, \pm 1, 2\}$

(Submitted on 15 Mar 2021 (v1), last revised 23 Jul 2021 (this version, v3))

Abstract: In this paper it is shown that $C_\beta$-smooth functions can be approximated by deep neural networks with ReLU activation function and with parameters $\{0,\pm \frac{1}{2}, \pm 1, 2\}$. The $l_0$ and $l_1$ parameter norms of considered networks are thus equivalent. The depth, width and the number of active parameters of the constructed networks have, up to a logarithmic factor, the same dependence on the approximation error as the networks with parameters in $[-1,1]$. In particular, this means that the nonparametric regression estimation with the constructed networks attains the same convergence rate as with sparse networks with parameters in $[-1,1]$.

## Submission history

From: Aleksandr Beknazaryan [view email]**[v1]**Mon, 15 Mar 2021 19:10:02 GMT (10kb)

**[v2]**Mon, 12 Jul 2021 12:36:33 GMT (11kb)

**[v3]**Fri, 23 Jul 2021 02:08:44 GMT (11kb)

Link back to: arXiv, form interface, contact.