EqSpike: spike-driven equilibrium propagation for neuromorphic implementations
- PMID: 33748709
- PMCID: PMC7970361
- DOI: 10.1016/j.isci.2021.102222
EqSpike: spike-driven equilibrium propagation for neuromorphic implementations
Abstract
Finding spike-based learning algorithms that can be implemented within the local constraints of neuromorphic systems, while achieving high accuracy, remains a formidable challenge. Equilibrium propagation is a promising alternative to backpropagation as it only involves local computations, but hardware-oriented studies have so far focused on rate-based networks. In this work, we develop a spiking neural network algorithm called EqSpike, compatible with neuromorphic systems, which learns by equilibrium propagation. Through simulations, we obtain a test recognition accuracy of 97.6% on the MNIST handwritten digits dataset (Mixed National Institute of Standards and Technology), similar to rate-based equilibrium propagation, and comparing favorably to alternative learning techniques for spiking neural networks. We show that EqSpike implemented in silicon neuromorphic technology could reduce the energy consumption of inference and training, respectively, by three orders and two orders of magnitude compared to graphics processing units. Finally, we also show that during learning, EqSpike weight updates exhibit a form of spike-timing-dependent plasticity, highlighting a possible connection with biology.
Keywords: Algorithms; Artificial Intelligence; Computer Science.
© 2021 The Authors.
Conflict of interest statement
The authors declare no competing interests.
Figures






References
-
- Bengio Y., Mesnard T., Fischer A., Zhang S., Wu Y. STDP-compatible approximation of backpropagation in an energy-based model. Neural Comput. 2017;29:555–577. - PubMed
-
- Bi G., Poo M. Synaptic modification by correlated activity: hebb’s postulate revisited. Annu. Rev. Neurosci. 2001;24:139–166. - PubMed
-
- Bichler O., Querlioz D., Thorpe S., J., Bourgoin J.-P., Gamrat C. Extraction of temporally correlated features from dynamic vision sensors with spike-timing-dependent plasticity. Neural Networks. 2012;32:339–348. - PubMed
-
- Davies M., Srinivasa N., Lin T.-H., Chinya G., Cao Y., Choday S., H., Dimou G., Joshi P., Imam N., Jain S. Loihi: a neuromorphic manycore processor with on-chip learning. IEEE Micro. 2018;38:82–99.
LinkOut - more resources
Full Text Sources
Other Literature Sources