Supervised learning in spiking neural networks: A review of algorithms and evaluations
- PMID: 32146356
- DOI: 10.1016/j.neunet.2020.02.011
Supervised learning in spiking neural networks: A review of algorithms and evaluations
Abstract
As a new brain-inspired computational model of the artificial neural network, a spiking neural network encodes and processes neural information through precisely timed spike trains. Spiking neural networks are composed of biologically plausible spiking neurons, which have become suitable tools for processing complex temporal or spatiotemporal information. However, because of their intricately discontinuous and implicit nonlinear mechanisms, the formulation of efficient supervised learning algorithms for spiking neural networks is difficult, and has become an important problem in this research field. This article presents a comprehensive review of supervised learning algorithms for spiking neural networks and evaluates them qualitatively and quantitatively. First, a comparison between spiking neural networks and traditional artificial neural networks is provided. The general framework and some related theories of supervised learning for spiking neural networks are then introduced. Furthermore, the state-of-the-art supervised learning algorithms in recent years are reviewed from the perspectives of applicability to spiking neural network architecture and the inherent mechanisms of supervised learning algorithms. A performance comparison of spike train learning of some representative algorithms is also made. In addition, we provide five qualitative performance evaluation criteria for supervised learning algorithms for spiking neural networks and further present a new taxonomy for supervised learning algorithms depending on these five performance evaluation criteria. Finally, some future research directions in this research field are outlined.
Keywords: Performance evaluation; Spike train; Spiking neural network; Spiking neuron; Supervised learning.
Copyright © 2020 Elsevier Ltd. All rights reserved.
Similar articles
-
Supervised Learning Algorithm for Multilayer Spiking Neural Networks with Long-Term Memory Spike Response Model.Comput Intell Neurosci. 2021 Nov 24;2021:8592824. doi: 10.1155/2021/8592824. eCollection 2021. Comput Intell Neurosci. 2021. PMID: 34868299 Free PMC article.
-
Event-driven implementation of deep spiking convolutional neural networks for supervised classification using the SpiNNaker neuromorphic platform.Neural Netw. 2020 Jan;121:319-328. doi: 10.1016/j.neunet.2019.09.008. Epub 2019 Sep 24. Neural Netw. 2020. PMID: 31590013
-
A review of learning in biologically plausible spiking neural networks.Neural Netw. 2020 Feb;122:253-272. doi: 10.1016/j.neunet.2019.09.036. Epub 2019 Oct 11. Neural Netw. 2020. PMID: 31726331 Review.
-
A Highly Effective and Robust Membrane Potential-Driven Supervised Learning Method for Spiking Neurons.IEEE Trans Neural Netw Learn Syst. 2019 Jan;30(1):123-137. doi: 10.1109/TNNLS.2018.2833077. Epub 2018 May 28. IEEE Trans Neural Netw Learn Syst. 2019. PMID: 29993588
-
Deep learning in spiking neural networks.Neural Netw. 2019 Mar;111:47-63. doi: 10.1016/j.neunet.2018.12.002. Epub 2018 Dec 18. Neural Netw. 2019. PMID: 30682710 Review.
Cited by
-
ReplaceNet: real-time replacement of a biological neural circuit with a hardware-assisted spiking neural network.Front Neurosci. 2023 Aug 10;17:1161592. doi: 10.3389/fnins.2023.1161592. eCollection 2023. Front Neurosci. 2023. PMID: 37638314 Free PMC article.
-
Machine learning without a processor: Emergent learning in a nonlinear analog network.Proc Natl Acad Sci U S A. 2024 Jul 9;121(28):e2319718121. doi: 10.1073/pnas.2319718121. Epub 2024 Jul 2. Proc Natl Acad Sci U S A. 2024. PMID: 38954545 Free PMC article.
-
Incorporating structural plasticity into self-organization recurrent networks for sequence learning.Front Neurosci. 2023 Aug 1;17:1224752. doi: 10.3389/fnins.2023.1224752. eCollection 2023. Front Neurosci. 2023. PMID: 37592946 Free PMC article.
-
NIR sensors combined with chemometric algorithms in intelligent quality evaluation of sweetpotato roots from 'Farm' to 'Table': Progresses, challenges, trends, and prospects.Food Chem X. 2024 May 7;22:101449. doi: 10.1016/j.fochx.2024.101449. eCollection 2024 Jun 30. Food Chem X. 2024. PMID: 38784692 Free PMC article. Review.
-
Supervised Learning Algorithm for Multilayer Spiking Neural Networks with Long-Term Memory Spike Response Model.Comput Intell Neurosci. 2021 Nov 24;2021:8592824. doi: 10.1155/2021/8592824. eCollection 2021. Comput Intell Neurosci. 2021. PMID: 34868299 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources
Research Materials