Current browse context:
cs
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Dichotomize and Generalize: PAC-Bayesian Binary Activated Deep Neural Networks
(Submitted on 24 May 2019 (v1), last revised 4 Feb 2020 (this version, v5))
Abstract: We present a comprehensive study of multilayer neural networks with binary activation, relying on the PAC-Bayesian theory. Our contributions are twofold: (i) we develop an end-to-end framework to train a binary activated deep neural network, (ii) we provide nonvacuous PAC-Bayesian generalization bounds for binary activated deep neural networks. Our results are obtained by minimizing the expected loss of an architecture-dependent aggregation of binary activated deep neural networks. Our analysis inherently overcomes the fact that binary activation function is non-differentiable. The performance of our approach is assessed on a thorough numerical experiment protocol on real-life datasets.
Submission history
From: Benjamin Guedj [view email][v1] Fri, 24 May 2019 14:37:38 GMT (3812kb,D)
[v2] Wed, 29 May 2019 12:52:11 GMT (3797kb,D)
[v3] Tue, 12 Nov 2019 14:22:07 GMT (4237kb,D)
[v4] Wed, 13 Nov 2019 20:18:17 GMT (4237kb,D)
[v5] Tue, 4 Feb 2020 13:48:30 GMT (4224kb,D)
Link back to: arXiv, form interface, contact.