Current browse context:
cs.NE
Change to browse by:
References & Citations
Computer Science > Neural and Evolutionary Computing
Title: High-parallelism Inception-like Spiking Neural Networks for Unsupervised Feature Learning
(Submitted on 2 Dec 2019 (v1), revised 4 Jun 2020 (this version, v4), latest version 9 Mar 2021 (v5))
Abstract: Spiking Neural Network (SNN) is a brain-inspired, event-driven machine learning algorithm that has recognized potential in producing ultra-high-energy-efficient hardware. Among existing SNNs, unsupervised SNNs are based on synaptic plasticity and considered to have more potential in imitating the learning process of biological brain. Most unsupervised SNNs are trained through competitive learning with Spike-Timing-Dependent Plasticity (STDP). However, the STDP-based SNNs are limited by slow learning speed and/or constrained learning capability. In this paper, to overcome these limitations, we: 1) designed a high-parallelism network architecture, inspired by the Inception module in the Artificial Neural Network (ANN) literature; 2) extended a widely used vote-based spike decoding scheme to a Vote-for-All (VFA) decoding layer to reduce the information loss in the spike decoding; 3) proposed to use adaptive repolarization (i.e. resetting) in the spiking neuron model to enhance the spiking activities and thus further accelerate the network's learning. We evaluated our contributions on the two established benchmark datasets (MNIST/EMNIST). Our experimental results show that our architecture exhibits superior performance than widely used Fully-Connected (FC) and Locally-Connected (LC) architectures. Our SNN not only achieves comparable results with the state-of-the-art unsupervised SNNs (95.64%/80.11% accuracy on the MNIST/EMNISE dataset), but also shows superior learning efficiency and robustness against hardware damage. Our SNN trained with only hundreds of iterations can achieve a great classification accuracy, and random destruction of large numbers of synapses and neurons only leads to negligible performance degradation.
Submission history
From: Mingyuan Meng [view email][v1] Mon, 2 Dec 2019 17:19:17 GMT (1308kb)
[v2] Sat, 18 Jan 2020 17:53:25 GMT (1437kb)
[v3] Sun, 12 Apr 2020 14:25:23 GMT (1104kb)
[v4] Thu, 4 Jun 2020 16:05:09 GMT (2614kb)
[v5] Tue, 9 Mar 2021 04:00:23 GMT (2147kb)
Link back to: arXiv, form interface, contact.