We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.LG

Change to browse by:

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Machine Learning

Title: Nonlinear Weighted Directed Acyclic Graph and A Priori Estimates for Neural Networks

Abstract: In an attempt to better understand structural benefits and generalization power of deep neural networks, we firstly present a novel graph theoretical formulation of neural network models, including fully connected, residual network (ResNet) and densely connected networks (DenseNet). Secondly, we extend the error analysis of the population risk for two layer network \cite{ew2019prioriTwo} and ResNet \cite{e2019prioriRes} to DenseNet, and show further that for neural networks satisfying certain mild conditions, similar estimates can be obtained. These estimates are a priori in nature since they depend sorely on the information prior to the training process, in particular, the bounds for the estimation errors are independent of the input dimension.
Subjects: Machine Learning (cs.LG); Machine Learning (stat.ML)
MSC classes: 05C62, 41A46, 41A63, 62J02
Cite as: arXiv:2103.16355 [cs.LG]
  (or arXiv:2103.16355v2 [cs.LG] for this version)

Submission history

From: Yuqing Li [view email]
[v1] Tue, 30 Mar 2021 13:54:33 GMT (160kb,D)
[v2] Mon, 6 Dec 2021 23:14:40 GMT (159kb,D)

Link back to: arXiv, form interface, contact.