Reinforcement delay of one second severely impairs acquisition of brain self-stimulation

Abstract

The effect of delayed reinforcement on the acquisition of lateral hypothalamic self-stimulation was investigated. Brain stimulation reinforcement minimizes cues associated with reinforcement delivery (secondary reinforcement) and, by eliminating consummatory responses, permits precise temporal control of the interval between the operant response and reinforcement. Different groups were trained in daily 1-h sessions for brain stimulation reinforcement at one of 4 delay intervals (1, 2, 3 or 6 s). Responses made during the delay interval were not reinforced and reset the delay timer. Control groups (IMMEDIATE) were reinforced immediately, but were required to space responses--according to a delayed reinforcement of low rates (DRL) schedule--for an interval corresponding to one of the delay of reinforcement intervals. The DRL schedule equalized opportunities for reinforcement and non-reinforcement. At all intervals, rats trained with delayed reinforcement had significantly lower bar-press rates than controls trained with immediate reinforcement under DRL. When reinforcement schedules were switched (DELAY groups now get IMMEDIATE and vice versa), response rates rapidly shifted to levels appropriate to the new schedule. The pre-switch results indicate that delays even as short as 1 s markedly impede the acquisition of self-stimulation behavior. The post-switch results suggest that delay of reinforcement, like stimulation intensity, may determine the strength of hypothalamic reinforcement and hence final levels of performance.