Dendrocentric learning for synthetic intelligence
- PMID: 36450907
- DOI: 10.1038/s41586-022-05340-6
Dendrocentric learning for synthetic intelligence
Abstract
Artificial intelligence now advances by performing twice as many floating-point multiplications every two months, but the semiconductor industry tiles twice as many multipliers on a chip every two years. Moreover, the returns from tiling these multipliers ever more densely now diminish because signals must travel relatively farther and farther. Although travel can be shortened by stacking tiled multipliers in a three-dimensional chip, such a solution acutely reduces the available surface area for dissipating heat. Here I propose to transcend this three-dimensional thermal constraint by moving away from learning with synapses to learning with dendrites. Synaptic inputs are not weighted precisely but rather ordered meticulously along a short stretch of dendrite, termed dendrocentric learning. With the help of a computational model of a dendrite and a conceptual model of a ferroelectric device that emulates it, I illustrate how dendrocentric learning artificial intelligence-or synthetic intelligence for short-could run not with megawatts in the cloud but rather with watts on a smartphone.
© 2022. Springer Nature Limited.
Similar articles
-
Artificial Optoelectronic Synapses Based on Ferroelectric Field-Effect Enabled 2D Transition Metal Dichalcogenide Memristive Transistors.ACS Nano. 2020 Jan 28;14(1):746-754. doi: 10.1021/acsnano.9b07687. Epub 2020 Jan 3. ACS Nano. 2020. PMID: 31887010
-
Arrangement of Excitatory Synaptic Inputs on Dendrites of the Medial Superior Olive.J Neurosci. 2021 Jan 13;41(2):269-283. doi: 10.1523/JNEUROSCI.1055-20.2020. Epub 2020 Nov 18. J Neurosci. 2021. PMID: 33208467 Free PMC article.
-
Modulation of synaptic plasticity by the coactivation of spatially distinct synaptic inputs in rat hippocampal CA1 apical dendrites.Brain Res. 2013 Aug 14;1526:1-14. doi: 10.1016/j.brainres.2013.05.023. Epub 2013 May 24. Brain Res. 2013. PMID: 23711890
-
The integrative properties of spiny distal dendrites.Neuroscience. 1992;47(3):495-519. doi: 10.1016/0306-4522(92)90161-t. Neuroscience. 1992. PMID: 1584406 Review.
-
Artificial intelligence in dermatology and healthcare: An overview.Indian J Dermatol Venereol Leprol. 2021 [SEASON];87(4):457-467. doi: 10.25259/IJDVL_518_19. Indian J Dermatol Venereol Leprol. 2021. PMID: 34114421 Review.
Cited by
-
Perspective: an optoelectronic future for heterogeneous, dendritic computing.Front Neurosci. 2024 Apr 17;18:1394271. doi: 10.3389/fnins.2024.1394271. eCollection 2024. Front Neurosci. 2024. PMID: 38699677 Free PMC article.
-
Evaluation of fluxon synapse device based on superconducting loops for energy efficient neuromorphic computing.Front Neurosci. 2025 Feb 14;19:1511371. doi: 10.3389/fnins.2025.1511371. eCollection 2025. Front Neurosci. 2025. PMID: 40027464 Free PMC article.
-
DenRAM: neuromorphic dendritic architecture with RRAM for efficient temporal processing with delays.Nat Commun. 2024 Apr 24;15(1):3446. doi: 10.1038/s41467-024-47764-w. Nat Commun. 2024. PMID: 38658524 Free PMC article.
-
Temporal dendritic heterogeneity incorporated with spiking neural networks for learning multi-timescale dynamics.Nat Commun. 2024 Jan 4;15(1):277. doi: 10.1038/s41467-023-44614-z. Nat Commun. 2024. PMID: 38177124 Free PMC article.
-
Cellular computation and cognition.Front Comput Neurosci. 2023 Nov 23;17:1107876. doi: 10.3389/fncom.2023.1107876. eCollection 2023. Front Comput Neurosci. 2023. PMID: 38077750 Free PMC article.
References
-
- Brown, T. et al. Language models are few-shot learners. Adv. Neural Inf. Process. Syst. 33, 1877–1901 (2020).
-
- GPT-3. A robot wrote this article. Are you scared yet, human? The Guardian (2020); https://www.theguardian.com/commentisfree/2020/sep/08/robot-wrote-this-a... .
-
- Dally, W., Turakhia, Y. & Han, S. Domain-specific hardware accelerators. Commun. ACM 63, 48–57 (2020). - DOI
-
- Jouppi, N. et al. A domain-specific supercomputer for training deep neural networks. Commun. ACM 63, 67–78 (2020). - DOI
Publication types
LinkOut - more resources
Full Text Sources