Elicited responding to signals for reinforcement: the effects of overall versus local changes in reinforcement probability

Abstract

Pigeons were studied on a three-component multiple schedule where all reinforcement was independent of responding. Two components were cued by different keylights and were associated with different rates of reinforcement. The third was always a no-key period associated with extinction. After a few sessions, pecking was elicited by the keylights signalling the reinforcement and continued to be maintained indefinitely. The duration and sequence of the three components were varied to determine if the primary controlling variable was differences in the overall probability of reinforcement, or if it was the immediate change in reinforcement signalled by the onset and/or offset of the stimulus. Both variables were found to control behavior. When 30-sec components were used, the primary controlling variable was the overall probability of reinforcement, but when 3-min components were used, overall probability had little effect. Control by local changes in reinforcement also occurred, although the type of local control varied both across subjects and experimental conditions. Some behaviors were controlled more by the change in reinforcement signalled by the onset of the stimulus, while others were controlled more by the change signalled by the offset of the stimulus.