Beyond simple reinforcement learning: the computational neurobiology of reward-learning and valuation
- PMID: 22487029
- DOI: 10.1111/j.1460-9568.2012.08074.x
Beyond simple reinforcement learning: the computational neurobiology of reward-learning and valuation
Abstract
Neural computational accounts of reward-learning have been dominated by the hypothesis that dopamine neurons behave like a reward-prediction error and thus facilitate reinforcement learning in striatal target neurons. While this framework is consistent with a lot of behavioral and neural evidence, this theory fails to account for a number of behavioral and neurobiological observations. In this special issue of EJN we feature a combination of theoretical and experimental papers highlighting some of the explanatory challenges faced by simple reinforcement-learning models and describing some of the ways in which the framework is being extended in order to address these challenges.
© 2012 The Author. European Journal of Neuroscience © 2012 Federation of European Neuroscience Societies and Blackwell Publishing Ltd.
Similar articles
-
How we learn to make decisions: rapid propagation of reinforcement learning prediction errors in humans.J Cogn Neurosci. 2014 Mar;26(3):635-44. doi: 10.1162/jocn_a_00509. Epub 2013 Oct 29. J Cogn Neurosci. 2014. PMID: 24168216
-
Deep and beautiful. The reward prediction error hypothesis of dopamine.Stud Hist Philos Biol Biomed Sci. 2014 Mar;45:57-67. doi: 10.1016/j.shpsc.2013.10.006. Epub 2013 Nov 16. Stud Hist Philos Biol Biomed Sci. 2014. PMID: 24252364
-
Deficient reinforcement learning in medial frontal cortex as a model of dopamine-related motivational deficits in ADHD.Neural Netw. 2013 Oct;46:199-209. doi: 10.1016/j.neunet.2013.05.008. Epub 2013 May 21. Neural Netw. 2013. PMID: 23811383
-
The computational neurobiology of learning and reward.Curr Opin Neurobiol. 2006 Apr;16(2):199-204. doi: 10.1016/j.conb.2006.03.006. Epub 2006 Mar 24. Curr Opin Neurobiol. 2006. PMID: 16563737 Review.
-
The role of learning-related dopamine signals in addiction vulnerability.Prog Brain Res. 2014;211:31-77. doi: 10.1016/B978-0-444-63425-2.00003-9. Prog Brain Res. 2014. PMID: 24968776 Review.
Cited by
-
Traits of empathy and anger: implications for psychopathy and other disorders associated with aggression.Philos Trans R Soc Lond B Biol Sci. 2018 Apr 19;373(1744):20170155. doi: 10.1098/rstb.2017.0155. Philos Trans R Soc Lond B Biol Sci. 2018. PMID: 29483341 Free PMC article. Review.
-
Conduct disorder and callous-unemotional traits in youth.N Engl J Med. 2014 Dec 4;371(23):2207-16. doi: 10.1056/NEJMra1315612. N Engl J Med. 2014. PMID: 25470696 Free PMC article. Review.
-
Neurons in the cingulate motor area signal context-based and outcome-based volitional selection of action.Exp Brain Res. 2013 Sep;229(3):407-17. doi: 10.1007/s00221-013-3442-3. Epub 2013 Mar 2. Exp Brain Res. 2013. PMID: 23455722
-
Reinforcement learning with associative or discriminative generalization across states and actions: fMRI at 3 T and 7 T.Hum Brain Mapp. 2022 Oct 15;43(15):4750-4790. doi: 10.1002/hbm.25988. Epub 2022 Jul 21. Hum Brain Mapp. 2022. PMID: 35860954 Free PMC article.
-
The mixed instrumental controller: using value of information to combine habitual choice and mental simulation.Front Psychol. 2013 Mar 4;4:92. doi: 10.3389/fpsyg.2013.00092. eCollection 2013. Front Psychol. 2013. PMID: 23459512 Free PMC article.
Publication types
MeSH terms
Substances
LinkOut - more resources
Full Text Sources