Current browse context:
cs.LG
Change to browse by:
References & Citations
Computer Science > Machine Learning
Title: Continual Learning Through Synaptic Intelligence
(Submitted on 13 Mar 2017 (v1), last revised 12 Jun 2017 (this version, v3))
Abstract: While deep learning has led to remarkable advances across diverse applications, it struggles in domains where the data distribution changes over the course of learning. In stark contrast, biological neural networks continually adapt to changing domains, possibly by leveraging complex molecular machinery to solve many tasks simultaneously. In this study, we introduce intelligent synapses that bring some of this biological complexity into artificial neural networks. Each synapse accumulates task relevant information over time, and exploits this information to rapidly store new memories without forgetting old ones. We evaluate our approach on continual learning of classification tasks, and show that it dramatically reduces forgetting while maintaining computational efficiency.
Submission history
From: Ben Poole [view email][v1] Mon, 13 Mar 2017 00:02:48 GMT (255kb,D)
[v2] Mon, 10 Apr 2017 17:54:57 GMT (259kb,D)
[v3] Mon, 12 Jun 2017 19:57:42 GMT (1060kb,D)
Link back to: arXiv, form interface, contact.