Stability and variability in extinction
- PMID: 11199517
Stability and variability in extinction
Abstract
Some studies have found that extinction leaves response structures unaltered; others have found that response variability is increased. Responding by Long-Evans rats was extinguished after 3 schedules. In one, reinforcement depended on repetitions of a particular response sequence across 3 operanda. In another, sequences were reinforced only if they varied. In the third, reinforcement was yoked: not contingent upon repetitions or variations. In all cases, rare sequences increased during extinction--variability increased--but the ordering of sequence probabilities was generally unchanged, the most common sequences during reinforcement continuing to be most frequent in extinction. The rats' combination of generally doing what worked before but occasionally doing something very different may maximize the possibility of reinforcement from a previously bountiful source while providing necessary variations for new learning.
Similar articles
-
Responses eliminated by noncontingent or negatively contingent reinforcement recover in extinction.J Exp Psychol Anim Behav Process. 1981 Apr;7(2):175-90. J Exp Psychol Anim Behav Process. 1981. PMID: 7241053
-
Extinction of Sidman avoidance behavior.J Exp Anal Behav. 1968 Mar;11(2):153-6. doi: 10.1901/jeab.1968.11-153. J Exp Anal Behav. 1968. PMID: 5645871 Free PMC article.
-
Response rate and sensitivity to the molar feedback function relating response and reinforcement rate on VI+ schedules of reinforcement.J Exp Psychol Anim Behav Process. 2007 Oct;33(4):428-39. doi: 10.1037/0097-7403.33.4.428. J Exp Psychol Anim Behav Process. 2007. PMID: 17924790
-
Reinstatement of a food-maintained operant produced by compounding discriminative stimuli.Behav Processes. 2005 Sep 30;70(2):194-202. doi: 10.1016/j.beproc.2005.04.007. Behav Processes. 2005. PMID: 15939551
-
Second-order schedules of drug self-administration in animals.Psychopharmacology (Berl). 2002 Oct;163(3-4):327-44. doi: 10.1007/s00213-002-1157-4. Epub 2002 Aug 8. Psychopharmacology (Berl). 2002. PMID: 12373434 Review.
Cited by
-
Unexpected downshifts in reward magnitude induce variation in human behavior.Psychon Bull Rev. 2014 Apr;21(2):436-44. doi: 10.3758/s13423-013-0490-4. Psychon Bull Rev. 2014. PMID: 23884690 Free PMC article.
-
The Modulation of Operant Variation by the Probability, Magnitude, and Delay of Reinforcement.Learn Motiv. 2011 Aug 1;42(3):221-236. doi: 10.1016/j.lmot.2011.05.001. Learn Motiv. 2011. PMID: 21731111 Free PMC article.
-
Variability as a subject matter in a science of behavior: reply to commentaries.Behav Anal. 2012 Fall;35(2):257-63. doi: 10.1007/BF03392285. Behav Anal. 2012. PMID: 23450918 Free PMC article. No abstract available.
-
An investigation of resurgence of reinforced behavioral variability in humans.J Exp Anal Behav. 2020 Nov;114(3):381-393. doi: 10.1002/jeab.637. Epub 2020 Nov 12. J Exp Anal Behav. 2020. PMID: 33179789 Free PMC article.
-
The effects of delayed reinforcement on variability and repetition of response sequences.J Exp Anal Behav. 2006 Sep;86(2):159-79. doi: 10.1901/jeab.2006.58-05. J Exp Anal Behav. 2006. PMID: 17002225 Free PMC article.
Publication types
MeSH terms
LinkOut - more resources
Full Text Sources