Contextual control of operant behavior: evidence for hierarchical associations in instrumental learning
- PMID: 24961749
- PMCID: PMC4131442
- DOI: 10.3758/s13420-014-0145-y
Contextual control of operant behavior: evidence for hierarchical associations in instrumental learning
Abstract
Recent research has suggested that operant responses can be weakened when they are tested in new contexts. The present experiment was therefore designed to test whether animals can learn a context-(R-O) relation. Rats were given training sessions in context A, in which one response (R1; lever pressing or chain pulling) produced one outcome (O1) and another response (R2; chain pulling or lever pressing) produced another outcome (O2) on variable interval reinforcement schedules. These sessions were intermixed with training in context B, where R1 now produced O2 and R2 produced O1. Given the arrangement, it was possible for the animal to learn two distinct R-O associations in each specific context. To test for them, rats were then given aversion conditioning with O2 by pairing its presentation with lithium-chloride-induced illness. Following the aversion conditioning, the rats were given an extinction test with both R1 and R2 available in each context. During testing, rats showed a selective suppression in each context of the response that had been paired with the reinforcer subsequently associated with illness. Rats could not have performed this way without knowledge of the R-O associations in effect in each specific context, lending support to the hypothesis that rats learn context-(R-O) associations. However, despite a complete aversion to O2, responding was not completely suppressed, leaving the possibility open that rats form context-R associations in addition to context-(R-O) associations.
Figures






Similar articles
-
Effect of context on the instrumental reinforcer devaluation effect produced by taste-aversion learning.J Exp Psychol Anim Learn Cogn. 2021 Oct;47(4):476-489. doi: 10.1037/xan0000295. Epub 2021 Sep 13. J Exp Psychol Anim Learn Cogn. 2021. PMID: 34516195 Free PMC article.
-
A reminder of extinction reduces relapse in an animal model of voluntary behavior.Learn Mem. 2017 Jan 17;24(2):76-80. doi: 10.1101/lm.044495.116. Print 2017 Feb. Learn Mem. 2017. PMID: 28096496 Free PMC article.
-
Factors that encourage generalization from extinction to test reduce resurgence of an extinguished operant response.J Exp Anal Behav. 2018 Jul;110(1):11-23. doi: 10.1002/jeab.446. Epub 2018 Jun 17. J Exp Anal Behav. 2018. PMID: 29911341 Free PMC article.
-
Extinction of instrumental (operant) learning: interference, varieties of context, and mechanisms of contextual control.Psychopharmacology (Berl). 2019 Jan;236(1):7-19. doi: 10.1007/s00213-018-5076-4. Epub 2018 Oct 22. Psychopharmacology (Berl). 2019. PMID: 30350221 Free PMC article. Review.
-
Preventing relapse after incentivized choice treatment: A laboratory model.Behav Processes. 2017 Aug;141(Pt 1):11-18. doi: 10.1016/j.beproc.2017.02.005. Epub 2017 Feb 7. Behav Processes. 2017. PMID: 28188809 Free PMC article. Review.
Cited by
-
Negative mood reverses devaluation of goal-directed drug-seeking favouring an incentive learning account of drug dependence.Psychopharmacology (Berl). 2015 Sep;232(17):3235-47. doi: 10.1007/s00213-015-3977-z. Epub 2015 Jun 5. Psychopharmacology (Berl). 2015. PMID: 26041336 Free PMC article.
-
Retrieval practice after multiple context changes, but not long retention intervals, reduces the impact of a final context change on instrumental behavior.Learn Behav. 2018 Jun;46(2):213-221. doi: 10.3758/s13420-017-0304-z. Learn Behav. 2018. PMID: 29234996 Free PMC article.
-
Occasion setting.Behav Neurosci. 2019 Apr;133(2):145-175. doi: 10.1037/bne0000306. Behav Neurosci. 2019. PMID: 30907616 Free PMC article. Review.
-
Inactivation of prelimbic and infralimbic cortex respectively affects minimally-trained and extensively-trained goal-directed actions.Neurobiol Learn Mem. 2018 Nov;155:164-172. doi: 10.1016/j.nlm.2018.07.010. Epub 2018 Jul 24. Neurobiol Learn Mem. 2018. PMID: 30053577 Free PMC article.
-
Context, attention, and the switch between habit and goal-direction in behavior.Learn Behav. 2021 Dec;49(4):349-362. doi: 10.3758/s13420-021-00488-z. Epub 2021 Oct 28. Learn Behav. 2021. PMID: 34713424 Free PMC article. Review.
References
-
- Adams CD. Post-conditioning devaluation of an instrumental reinforcer has no effect on extinction performance. Quarterly Journal of Experimental Psychology. 1980;32:447–458.
-
- Adams CD, Dickinson A. Instrumental responding following reinforcer devaluation. Quarterly Journal of Experimental Psychology. 1981;33B:109–121.
-
- Bouton ME, King DA. Contextual control of the extinction of conditioned fear: Tests for the associative value of the context. Journal of Experimental Psychology: Animal Behavior Processes. 1983;9:248–265. - PubMed
-
- Bouton ME, Peck CA. Context effects on conditioning, extinction, and reinstatement in an appetitive conditioning preparation. Animal Learning & Behavior. 1989;17:188–198.
Publication types
MeSH terms
Grants and funding
LinkOut - more resources
Full Text Sources
Other Literature Sources
Research Materials