We gratefully acknowledge support from
the Simons Foundation and member institutions.
Full-text links:

Download:

Current browse context:

cs.NE

Change to browse by:

cs

References & Citations

DBLP - CS Bibliography

Bookmark

(what is this?)
CiteULike logo BibSonomy logo Mendeley logo del.icio.us logo Digg logo Reddit logo ScienceWISE logo

Computer Science > Neural and Evolutionary Computing

Title: Synaptic Plasticity Dynamics for Deep Continuous Local Learning (DECOLLE)

Abstract: A growing body of work underlines striking similarities between biological neural networks and recurrent, binary neural networks. A relatively smaller body of work, however, discusses similarities between learning dynamics employed in deep artificial neural networks and synaptic plasticity in spiking neural networks. The challenge preventing this is largely caused by the discrepancy between the dynamical properties of synaptic plasticity and the requirements for gradient backpropagation. Learning algorithms that approximate gradient backpropagation using locally synthesized gradients can overcome this challenge. Here, we show that synthetic gradients enable the derivation of Deep Continuous Local Learning (DECOLLE) in spiking neural networks. DECOLLE is capable of learning deep spatio-temporal representations from spikes relying solely on local information. Synaptic plasticity rules are derived systematically from user-defined cost functions and neural dynamics by leveraging existing autodifferentiation methods of machine learning frameworks. We benchmark our approach on the MNIST and the event-based neuromorphic DvsGesture dataset, on which DECOLLE performs comparably to the state-of-the-art. DECOLLE networks provide continuously learning machines that are relevant to biology and supportive of event-based, low-power computer vision architectures matching the accuracies of conventional computers on tasks where temporal precision and speed are essential.
Comments: Published in Frontiers in Neuroscience - Neuromorphic Engineering
Subjects: Neural and Evolutionary Computing (cs.NE)
Journal reference: Frontiers in Neuroscience, 2020
DOI: 10.3389/fnins.2020.00424
Cite as: arXiv:1811.10766 [cs.NE]
  (or arXiv:1811.10766v4 [cs.NE] for this version)

Submission history

From: Emre Neftci [view email]
[v1] Tue, 27 Nov 2018 01:50:08 GMT (1697kb,D)
[v2] Mon, 4 Mar 2019 23:12:19 GMT (2283kb,D)
[v3] Fri, 31 May 2019 16:53:46 GMT (1345kb,D)
[v4] Wed, 20 May 2020 19:00:57 GMT (2631kb,D)

Link back to: arXiv, form interface, contact.