Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2017;26(5):422-428.
doi: 10.1177/0963721417704394. Epub 2017 Oct 9.

Self-Control as Value-Based Choice

Affiliations

Self-Control as Value-Based Choice

Elliot T Berkman et al. Curr Dir Psychol Sci. 2017.

Abstract

Self-control is often conceived as a battle between "hot" impulsive processes and "cold" deliberative ones. Heeding the angel on one shoulder leads to success; following the demon on the other leads to failure. Self-control feels like a duality. What if that sensation is misleading, and, despite how they feel, self-control decisions are just like any other choice? We argue that self-control is a form of value-based choice wherein options are assigned a subjective value and a decision is made through a dynamic integration process. We articulate how a value-based choice model of self-control can capture its phenomenology and account for relevant behavioral and neuroscientific data. This conceptualization of self-control links divergent scientific approaches, allows for more robust and precise hypothesis testing, and suggests novel pathways to improve self-control.

PubMed Disclaimer

Figures

Figure 1
Figure 1
Value-based choice model of self-control. The cumulative subjective value of each each response option (middle column) is a weighted sum of value inputs based on the option’s attributes (left column). Example attributes for a choice option include primary rewards, effort costs, social acceptance or rejection, and self-consistency and -verification. The subjective value integration is not strictly rational, but instead is modulated by a number of choice “anomalies” such as the tendency to discount delayed gains. Value accumulates dynamically and stochastically across time until a threshold is reached, and attention can influence the accumulation process by altering the relevant attributes. The option with the greatest value when the threshold is reached or time runs out is enacted.
Figure 2
Figure 2
Value accumulation across time for two hypothetical choice options. Action A (solid line) accumulates subjective value rapidly then drops off, whereas Action B (dashed line) accumulates value more slowly but it eventually reaches a greater value. These temporal dynamics could occur either due to randomly-accumulated fluctuations, or due to systematic differences in the nature of A and B (e.g., more abstract versus more concrete attributes). In either case, Action A would tend to be selected (and more quickly) if a low decision threshold were used because it reaches the threshold first, but Action B would be selected (and more slowly) if a higher decision threshold were set. The selected action also depends on the time available for the decision: Action A would tend to be selected if a short limit were imposed. Also, the noise depicted in the lines indicates stochasticity in the valuation process: repetitions of the same choice might result in selection of Action B occasionally, even in a short response window, due to random variation; for the same reason, Action A would sometimes be selected in a long response window.

References

    1. Basten U, Biele G, Heekeren HR, Fiebach CJ. How the brain integrates costs and benefits during decision making. Proceedings of the National Academy of Sciences. 2010;107(50):21767–21772. - PMC - PubMed
    1. Boureau YL, Sokol-Hessner P, Daw ND. Deciding how to decide: Self-control and meta-decision making. Trends in Cognitive Sciences. 2015;19(11):700–710. - PubMed
    1. Busemeyer JR, Townsend JT. Decision field theory: A dynamic-cognitive approach to decision making in an uncertain environment. Psychological Review. 1993;100(3):432–459. - PubMed
    1. Clithero JA, Rangel A. Informatic parcellation of the network involved in the computation of subjective value. Social Cognitive and Affective Neuroscience. 2014;9(9):1289–1302. - PMC - PubMed
    1. Deci EL, Ryan RM. The “what” and “why” of goal pursuits: Human needs and the self-determination of behavior. Psychological Inquiry. 2000;11(4):227–268.

Recommended Readings

    1. Hare TA, Camerer CF, Rangel A. Self-control in decision-making involves modulation of the vmPFC valuation system. Science. 2009;324(5927):646–648. One of the first papers to demonstrate the role of the vmPFC in self-control. Provides evidence that lateral prefrontal regions influence self-control by modulating an integrated value signal rather than by inhibiting subcortical emotion or reward regions. - PubMed
    1. Hutcherson C, Bushong B, Rangel A. A neurocomputational model of altruistic choice and its implications. Neuron. 2015;87(2):451–462. Develops a computational model of altruism that accurately predicts choice, response time, and neural activity. The model suggests that many patterns of data interpreted as evidence for dual-process (e.g., intuitive versus deliberative) systems, including RT, response to time pressure, and neural response, can be explained by a simpler value computation. - PMC - PubMed
    1. Polanía R, Krajbich I, Grueschow M, Ruff CC. Neural oscillations and synchronization differentially support evidence accumulation in perceptual and value-based decision making. Neuron. 2014;82(3):709–720. An empirical article illustrating how brain activity (measured here with electroencephalography) can be characterized using evidence accumulator models. The paper also shows how different types of choices (e.g., perceptual versus value-based) integrate different sources of evidence. - PubMed
    1. Ratcliff R, Smith PL, Brown SD, McKoon G. Diffusion decision model: Current issues and history. Trends in Cognitive Sciences. 2016;20(4):260–281. An accessible overview of a variety of sequential sampling models, including drift-diffusion models, that describes their features, compares them to each other, and reviews how they have been used in psychological research. - PMC - PubMed
    1. Shenhav A, Musslick S, Lieder F, Kool W, Griffiths TL, Cohen JD, Botvinick MM. Toward a rational and mechanistic account of mental effort. Annual Review of Neuroscience. in press. A detailed review of the psychological and neuroscientific literatures on the experienced effort costs of cognitive control. Summarizes potential causes of effort costs, such as opportunity costs, and storage and processing limits, and describes computational models of effort allocation.

LinkOut - more resources