We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

stat.ML

Change to browse by:

References & Citations

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Statistics > Machine Learning

Title: Implicit Priors for Knowledge Sharing in Bayesian Neural Networks

Abstract: Bayesian interpretations of neural network have a long history, dating back to early work in the 1990's and have recently regained attention because of their desirable properties like uncertainty estimation, model robustness and regularisation. We want to discuss here the application of Bayesian models to knowledge sharing between neural networks. Knowledge sharing comes in different facets, such as transfer learning, model distillation and shared embeddings. All of these tasks have in common that learned "features" ought to be shared across different networks. Theoretically rooted in the concepts of Bayesian neural networks this work has widespread application to general deep learning.
Comments: 5 pages, 2 figures
Subjects: Machine Learning (stat.ML); Machine Learning (cs.LG)
Journal reference: 4th workshop on Bayesian Deep Learning (NeurIPS 2019)
Cite as: arXiv:1912.00874 [stat.ML]
  (or arXiv:1912.00874v1 [stat.ML] for this version)

Submission history

From: Sebastian Schmon [view email]
[v1] Mon, 2 Dec 2019 15:52:33 GMT (367kb,D)

Link back to: arXiv, form interface, contact.