Effects of rate of reinforcement and rate of change on choice behaviour in transition

Abstract

In two experiments with pigeons, a single variable-interval schedule assigned reinforcers to two response keys on a percentage basis. The percentage of reinforcers assigned to each key was changed every few sessions, and subjects' choice responses were recorded before and after each change. In Experiment 1, the overall rate of reinforcement was varied across conditions. The pigeons' choice responses adapted more quickly to a change in the reinforcement percentages when the overall reinforcement rates were higher, but acquisition rates varied by only about a factor of 3, whereas reinforcement rates were varied by about a factor of 9. In Experiment 2, the reinforcement percentages changed about every 8 sessions in Phases 1 and 3, but every 1 or 2 sessions in Phase 2. Pigeons' choice responses adapted to a change in reinforcement percentages more quickly in Phase 2 than in Phases 1 and 3. The results from both experiments pose difficulties for several prominent models of transitional choice behaviour. The results suggest that each successive reinforcer has more impact on a subject's subsequent choice behaviour when the overall rate of reinforcement is lower and when the reinforcement contingencies have changed frequently in the recent past.