The partial reinforcement extinction effect: The proportion of trials reinforced during conditioning predicts the number of trials to extinction
- PMID: 30604994
- DOI: 10.1037/xan0000190
The partial reinforcement extinction effect: The proportion of trials reinforced during conditioning predicts the number of trials to extinction
Abstract
Four experiments compared the extinction of responding to a continuously reinforced (CRf) conditioned stimulus (conditional stimulus [CS]) consistently reinforced on every trial, with extinction of responding to a partially reinforced (PRf) CS that had been inconsistently reinforced. To equate the acquisition of responding between the two CSs, the average duration of the CRf CS was extended so that it scheduled the same overall rate of reinforcement per unit time as the PRf CS. Experiment 1 used a within-subjects design to compare the rates of extinction for a 10-s PRf CS reinforced on 33% of trials versus a 30-s CRf CS. Experiment 2 made the same comparison but using a between-subjects design. Experiment 3 compared extinction in a group trained with a 10-s PRf CS reinforced on 20% of trials and a group trained with a 50-s CRf CS. Experiment 4 compared the rates of extinction following two partial reinforcement schedules: a 10-s PRf CS reinforced on 33% of trial versus a 20-s CRf CS reinforced on 66% of trials. In each experiment, responding took longer to extinguish for the CS that scheduled a lower per-trial probability of reinforcement. Modeling of individual extinction curves using Weibull functions indicated that the latency to initiate extinction was directly related to the per-trial probability of reinforcement learned during acquisition. For example, compared with training with a CRf CS, rats reinforced on 33% of trials took approximately 3 times as many trials to initiate extinction, and rats reinforced on 20% of trials took 5 times as many trials to initiate extinction. These results provide support for trial-based accounts of extinction (e.g., Capaldi & Deutsch, 1967), whereby rats learn about the expected number of trials per reinforcer, and extinction depends on the number of expected reinforcers that have been omitted rather than on the number of extinction trials per se. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
Similar articles
-
The partial-reinforcement extinction effect does not result from reduced sensitivity to nonreinforcement.J Exp Psychol Anim Learn Cogn. 2019 Apr;45(2):185-202. doi: 10.1037/xan0000200. J Exp Psychol Anim Learn Cogn. 2019. PMID: 30945926
-
The partial reinforcement extinction effect depends on learning about nonreinforced trials rather than reinforcement rate.J Exp Psychol Anim Learn Cogn. 2019 Oct;45(4):485-501. doi: 10.1037/xan0000220. Epub 2019 Aug 1. J Exp Psychol Anim Learn Cogn. 2019. PMID: 31368769
-
The probability of reinforcement per trial affects posttrial responding and subsequent extinction but not within-trial responding.J Exp Psychol Anim Learn Cogn. 2018 Jan;44(1):23-35. doi: 10.1037/xan0000158. J Exp Psychol Anim Learn Cogn. 2018. PMID: 29323516
-
Extinction of Pavlovian conditioning: The influence of trial number and reinforcement history.Behav Processes. 2017 Aug;141(Pt 1):19-25. doi: 10.1016/j.beproc.2017.04.017. Epub 2017 May 1. Behav Processes. 2017. PMID: 28473250 Review.
-
Resurgence as Choice.Behav Processes. 2017 Aug;141(Pt 1):100-127. doi: 10.1016/j.beproc.2016.10.006. Epub 2016 Oct 26. Behav Processes. 2017. PMID: 27794452 Free PMC article. Review.
Cited by
-
Learning depends on the information conveyed by temporal relationships between events and is reflected in the dopamine response to cues.Sci Adv. 2024 Sep 6;10(36):eadi7137. doi: 10.1126/sciadv.adi7137. Epub 2024 Sep 6. Sci Adv. 2024. PMID: 39241065 Free PMC article.
-
Benefiting from trial spacing without the cost of prolonged training: Frequency, not duration, of trials with absent stimuli enhances perceived contingency.J Exp Psychol Gen. 2022 Aug;151(8):1772-1792. doi: 10.1037/xge0001166. Epub 2022 Jan 6. J Exp Psychol Gen. 2022. PMID: 34990159 Free PMC article.
-
Partial reinforcement extinction and omission effects in the elimination and recovery of discriminated operant behavior.J Exp Psychol Anim Learn Cogn. 2023 Jul;49(3):194-207. doi: 10.1037/xan0000354. Epub 2023 Jun 1. J Exp Psychol Anim Learn Cogn. 2023. PMID: 37261748 Free PMC article.
-
Dorsolateral striatum dopamine-dependent cocaine seeking is resistant to pavlovian cue extinction in male and female rats.Neuropharmacology. 2021 Jan;182:108403. doi: 10.1016/j.neuropharm.2020.108403. Epub 2020 Nov 13. Neuropharmacology. 2021. PMID: 33197468 Free PMC article.
-
Both probability and rate of reinforcement can affect the acquisition and maintenance of conditioned responses.J Exp Psychol Anim Learn Cogn. 2024 Oct;50(4):254-266. doi: 10.1037/xan0000386. J Exp Psychol Anim Learn Cogn. 2024. PMID: 39432328
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources