Prefrontal cortex and decision making in a mixed-strategy game
- PMID: 15004564
- DOI: 10.1038/nn1209
Prefrontal cortex and decision making in a mixed-strategy game
Abstract
In a multi-agent environment, where the outcomes of one's actions change dynamically because they are related to the behavior of other beings, it becomes difficult to make an optimal decision about how to act. Although game theory provides normative solutions for decision making in groups, how such decision-making strategies are altered by experience is poorly understood. These adaptive processes might resemble reinforcement learning algorithms, which provide a general framework for finding optimal strategies in a dynamic environment. Here we investigated the role of prefrontal cortex (PFC) in dynamic decision making in monkeys. As in reinforcement learning, the animal's choice during a competitive game was biased by its choice and reward history, as well as by the strategies of its opponent. Furthermore, neurons in the dorsolateral prefrontal cortex (DLPFC) encoded the animal's past decisions and payoffs, as well as the conjunction between the two, providing signals necessary to update the estimates of expected reward. Thus, PFC might have a key role in optimizing decision-making strategies.
Comment in
-
Unpredictable primates and prefrontal cortex.Nat Neurosci. 2004 Apr;7(4):319-20. doi: 10.1038/nn0404-319. Nat Neurosci. 2004. PMID: 15048115 No abstract available.
Similar articles
-
Reinforcement learning and decision making in monkeys during a competitive game.Brain Res Cogn Brain Res. 2004 Dec;22(1):45-58. doi: 10.1016/j.cogbrainres.2004.07.007. Brain Res Cogn Brain Res. 2004. PMID: 15561500
-
Learning and decision making in monkeys during a rock-paper-scissors game.Brain Res Cogn Brain Res. 2005 Oct;25(2):416-30. doi: 10.1016/j.cogbrainres.2005.07.003. Epub 2005 Aug 10. Brain Res Cogn Brain Res. 2005. PMID: 16095886
-
Unpredictable primates and prefrontal cortex.Nat Neurosci. 2004 Apr;7(4):319-20. doi: 10.1038/nn0404-319. Nat Neurosci. 2004. PMID: 15048115 No abstract available.
-
[Neural mechanisms of decision making].Brain Nerve. 2008 Sep;60(9):1017-27. Brain Nerve. 2008. PMID: 18807936 Review. Japanese.
-
Mechanisms of reinforcement learning and decision making in the primate dorsolateral prefrontal cortex.Ann N Y Acad Sci. 2007 May;1104:108-22. doi: 10.1196/annals.1390.007. Epub 2007 Mar 8. Ann N Y Acad Sci. 2007. PMID: 17347332 Review.
Cited by
-
Uncertainty in action-value estimation affects both action choice and learning rate of the choice behaviors of rats.Eur J Neurosci. 2012 Apr;35(7):1180-9. doi: 10.1111/j.1460-9568.2012.08025.x. Eur J Neurosci. 2012. PMID: 22487046 Free PMC article.
-
Neuronal correlates of metacognition in primate frontal cortex.Neuron. 2012 Aug 9;75(3):517-30. doi: 10.1016/j.neuron.2012.05.028. Neuron. 2012. PMID: 22884334 Free PMC article.
-
Reward foraging task and model-based analysis reveal how fruit flies learn value of available options.PLoS One. 2020 Oct 2;15(10):e0239616. doi: 10.1371/journal.pone.0239616. eCollection 2020. PLoS One. 2020. PMID: 33007023 Free PMC article.
-
Functional connectivity between prefrontal cortex and striatum estimated by phase locking value.Cogn Neurodyn. 2016 Jun;10(3):245-54. doi: 10.1007/s11571-016-9376-2. Epub 2016 Jan 29. Cogn Neurodyn. 2016. PMID: 27275380 Free PMC article.
-
Adaptive Regulation of Motor Variability.Curr Biol. 2019 Nov 4;29(21):3551-3562.e7. doi: 10.1016/j.cub.2019.08.052. Epub 2019 Oct 17. Curr Biol. 2019. PMID: 31630947 Free PMC article.
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Other Literature Sources
Research Materials
Miscellaneous