Optimal choice
- PMID: 16812224
- PMCID: PMC1333092
- DOI: 10.1901/jeab.1981.35-397
Optimal choice
Abstract
We present a classification and theoretical analysis of discrete-trial and free-operant choice procedures in which reinforcement is assigned to one alternative only, or independently to both, is either always available or conditionally available, and is either "held" or not from trial to trial. Momentary-maximizing and (globally) optimal choice sequences are defined in terms of initializing and marker events. Free-operant choice is analyzed in terms of a clock space whose axes are the times since the last A and B choices. The analysis shows that most molar matching data are derivable from momentary maximizing, and that the momentary-maximizing hypothesis has not been adequately tested in either discrete-trial or free-operant situations.
Similar articles
-
Interresponse-time sensitivity during discrete-trial and free-operant concurrent variable-interval schedules.J Exp Anal Behav. 1999 Nov;72(3):317-39. doi: 10.1901/jeab.1999.72-317. J Exp Anal Behav. 1999. PMID: 10605102 Free PMC article.
-
Momentary maximizing and optimal foraging theories of performance on concurrent VR schedules.Behav Processes. 2006 Jun 1;72(3):283-99. doi: 10.1016/j.beproc.2006.03.005. Epub 2006 Mar 7. Behav Processes. 2006. PMID: 16631321
-
Reinforcement of least-frequent sequences of choices.J Exp Anal Behav. 1967 Jan;10(1):57-65. doi: 10.1901/jeab.1967.10-57. J Exp Anal Behav. 1967. PMID: 16811306 Free PMC article.
-
Matching, maximizing, and hill-climbing.J Exp Anal Behav. 1983 Nov;40(3):321-31. doi: 10.1901/jeab.1983.40-321. J Exp Anal Behav. 1983. PMID: 16812350 Free PMC article.
-
Extending unified-theory-of-reinforcement neural networks to steady-state operant behavior.Behav Processes. 2016 Jun;127:52-61. doi: 10.1016/j.beproc.2016.03.016. Epub 2016 Mar 24. Behav Processes. 2016. PMID: 27018201 Review.
Cited by
-
Quasi-dynamic choice models: Melioration and ratio invariance.J Exp Anal Behav. 1988 Mar;49(2):303-20. doi: 10.1901/jeab.1988.49-303. J Exp Anal Behav. 1988. PMID: 16812541 Free PMC article.
-
Choice as a function of reinforcer "hold": from probability learning to concurrent reinforcement.J Exp Psychol Anim Behav Process. 2008 Oct;34(4):437-60. doi: 10.1037/0097-7403.34.4.437. J Exp Psychol Anim Behav Process. 2008. PMID: 18954229 Free PMC article.
-
Interresponse-time sensitivity during discrete-trial and free-operant concurrent variable-interval schedules.J Exp Anal Behav. 1999 Nov;72(3):317-39. doi: 10.1901/jeab.1999.72-317. J Exp Anal Behav. 1999. PMID: 10605102 Free PMC article.
-
Hill-climbing by pigeons.J Exp Anal Behav. 1983 Jan;39(1):25-47. doi: 10.1901/jeab.1983.39-25. J Exp Anal Behav. 1983. PMID: 16812310 Free PMC article.
-
Increased response switching, perseveration and perseverative switching following d-amphetamine in the rat.Psychopharmacology (Berl). 1983;80(1):67-73. doi: 10.1007/BF00427498. Psychopharmacology (Berl). 1983. PMID: 6408674
References
LinkOut - more resources
Full Text Sources