Current browse context:
stat.ML
Change to browse by:
References & Citations
Statistics > Machine Learning
Title: A Novel Representation of Neural Networks
(Submitted on 5 Oct 2016 (v1), last revised 7 Oct 2016 (this version, v2))
Abstract: Deep Neural Networks (DNNs) have become very popular for prediction in many areas. Their strength is in representation with a high number of parameters that are commonly learned via gradient descent or similar optimization methods. However, the representation is non-standardized, and the gradient calculation methods are often performed using component-based approaches that break parameters down into scalar units, instead of considering the parameters as whole entities. In this work, these problems are addressed. Standard notation is used to represent DNNs in a compact framework. Gradients of DNN loss functions are calculated directly over the inner product space on which the parameters are defined. This framework is general and is applied to two common network types: the Multilayer Perceptron and the Deep Autoencoder.
Submission history
From: Anthony Caterini [view email][v1] Wed, 5 Oct 2016 18:06:44 GMT (24kb)
[v2] Fri, 7 Oct 2016 21:31:13 GMT (24kb)
Link back to: arXiv, form interface, contact.