Current browse context:
cs.NE
Change to browse by:
References & Citations
Computer Science > Neural and Evolutionary Computing
Title: Leaky Integrate-and-Fire Spiking Neuron with Learnable Membrane Time Parameter
(Submitted on 11 Jul 2020 (this version), latest version 17 Aug 2021 (v5))
Abstract: The Spiking Neural Networks (SNNs) have attracted research interest due to its temporal information processing capability, low power consumption, and high biological plausibility. The Leaky Integrate-and-Fire (LIF) neuron model is one of the most popular spiking neuron models used in SNNs for it achieves a balance between computing cost and biological plausibility. The most important parameter of a LIF neuron is the membrane time constant $\tau$, which determines the decay rate of membrane potential. The value of $\tau$ plays a crucial role in SNNs containing LIF neurons. However, $\tau$ is usually treated as a hyper-parameter, which is preset before training SNNs and adjusted manually. In this article, we propose a novel spiking neuron, namely parametric Leaky Integrate-and-Fire (PLIF) neuron, whose $\tau$ is a learnable parameter rather than an empirical hyper-parameter. We evaluate the performance of SNNs with PLIF neurons for image classification tasks on both traditional static MNIST, Fashion-MNIST, CIFAR-10 datasets, and neuromorphic N-MNIST, CIFAR10-DVS datasets. The experiment results show that SNNs augmented by PLIF neurons outperform those with conventional spiking neurons.
Submission history
From: Wei Fang [view email][v1] Sat, 11 Jul 2020 14:35:42 GMT (12kb)
[v2] Mon, 16 Nov 2020 16:08:36 GMT (4873kb,D)
[v3] Tue, 24 Nov 2020 12:47:40 GMT (4875kb,D)
[v4] Fri, 27 Nov 2020 05:23:29 GMT (4875kb,D)
[v5] Tue, 17 Aug 2021 03:04:45 GMT (7676kb,D)
Link back to: arXiv, form interface, contact.