No impact of repeated extinction exposures on operant responding maintained by different reinforcer rates

Intermittent access training produces greater motivation for a non-drug reinforcer than long access training

It has recently been proposed that the intermittent access (IntA) drug self-administration procedure better produces behavioral changes relevant to addiction than the long access (LgA) procedure. In this version of the IntA procedure, the drug is made available for a 5-min period during each half hour of a 6-h session. In contrast, on the LgA procedure, the drug is available continuously for 6 h. Previous studies have found that IntA drug self-administration produces greater drug motivation, measured by increased progressive ratio breakpoints, than LgA self-administration. It has been hypothesized that this effect is due to the rapid, "spiking" brain levels of the drug, and consequent neuroadaptations, experienced by rats during IntA sessions. However, no study has compared the effects of IntA versus LgA training on reinforcer motivation when using a non-drug reinforcer. The present study compared motivation for a saccharin reinforcer after IntA or LgA training. In Experiment 1, separate groups of rats lever-pressed for saccharin on the IntA or LgA procedures. In Experiment 2, a within-subjects design was used where rats pressed one lever on the IntA procedure and another lever on the LgA procedure for saccharin. In both experiments, IntA training produced greater breakpoints than LgA training. As no drug was used here, spiking drug levels could not have been responsible for the increased saccharin motivation observed after IntA training. Instead, it is proposed that differences in stimulus-reinforcer associations learned during IntA versus LgA training may be responsible for the effect. Future research is needed to determine the extent to which such learning factors may contribute to the increased motivation observed after IntA training with drug reinforcers.

Emergence of complex dynamics of choice due to repeated exposures to extinction learning

Extinction learning, the process of ceasing an acquired behavior in response to altered reinforcement contingencies, is not only essential for survival in a changing environment, but also plays a fundamental role in the treatment of pathological behaviors. During therapy and other forms of training involving extinction, subjects are typically exposed to several sessions with a similar structure. The effects of this repeated exposure are not well understood. Here, we studied the behavior of pigeons across several sessions of a discrimination-learning task in context A, extinction in context B, and a return to context A to test the context-dependent return of the learned responses (ABA renewal). By focusing on individual learning curves across animals, we uncovered a session-dependent variability of behavior: (1) during extinction, pigeons preferred the unrewarded alternative choice in one-third of the sessions, predominantly during the first one. (2) In later sessions, abrupt transitions of behavior at the onset of context B emerged, and (3) the renewal effect decayed as sessions progressed. We show that the observed results can be parsimoniously accounted for by a computational model based only on associative learning between stimuli and actions. Our work thus demonstrates the critical importance of studying the trial-by-trial dynamics of learning in individual sessions, and the power of “simple” associative learning processes.

Resistance to extinction versus extinction as discrimination

The hypothesis that response strength might be measured by persistence of responding in the face of extinction was discredited in the 1960s because experiments showed that responding persists longer following intermittent reinforcers than following continuous reinforcers. Instead, researchers proposed that the longer persistence following intermittent reinforcers arises because intermittent reinforcement more closely resembles extinction-a discrimination theory. Attention to resistance to extinction revived because one observation seemed to support the persistence hypothesis: Following training on a multiple schedule with unequal components, responding usually persisted longer in the formerly richer component than in the formerly lean component. This observation represents an anomaly, however, because results with single schedules and concurrent schedules contradict it. We suggest that the difference in results arises because the multiple-schedule procedure, while including extensive training on stimulus discrimination, includes no training on discrimination between food available and food unavailable, whereas comparable single- and concurrent-schedule procedures include such training with repeated extinction. In Experiment 1, we replicated the original result, and in Experiment 2 showed that when the multiple-schedule procedure includes training on food/no-food discrimination, extinction following multiple schedules contradicts behavioral momentum theory and agrees with the discrimination theory and research with single and concurrent schedules.

Does Individual Performance Feedback Increase the Use of Retrieval Practice?

The testing effect—the power of retrieval practice to enhance long-term knowledge retention more than restudying does—is a well-known phenomenon in learning. However, retrieval practice is hardly appreciated by students and underutilized when studying. One of the reasons is that learners usually do not experience immediate benefits of such practice which often present only after a delay. We therefore conducted 2 experiments to examine whether students choose retrieval practice more often as their learning strategy after having experienced its benefits. In Experiment 1, students received individual feedback about the extent to which their 7-day delayed test scores after retrieval practice differed from their test scores after restudy. Those students who had actually experienced the benefits of retrieval practice appreciated the strategy more and used it more often after receiving feedback. In Experiment 2, we compared the short-term and long-term effects on retrieval practice use of individual performance feedback and general instruction about the testing effect. Although both interventions enhanced its use in the short term, only the individual feedback led to enhanced use in the long term by those who had actually experienced its benefits, demonstrating the superiority of the individual feedback in terms of its ability to promote retrieval practice use.

Changes in the elimination and resurgence of alcohol-maintained behavior in rats and the effects of naltrexone

Resurgence may be a mechanism of relapse in alcohol use disorder patients upon discharge from treatment as part of an abuse-treatment-relapse cycle. Adjunctive pharmacotherapies may be a means to facilitate behavioral treatments and block resurgence. Experiments were conducted using a model of alcohol self-administration to assess the repeatability of the elimination and resurgence of alcohol-maintained behavior and the effects of naltrexone. Experiments had three phases. In Phase 1, behavior was maintained by oral alcohol under a fixed-ratio schedule. In Phase 2, behavior was extinguished via condensed milk delivery under a differential-reinforcement-of-other-behavior (DRO) schedule. In Phase 3, the DRO schedule was eliminated. In Experiment 1, this 3-phase cycle was replicated 4 times. Across replications, response rates and dose of alcohol consumed did not differ in Phase 1, alcohol-maintained behavior was eliminated more rapidly in Phase 2, and the resurgence effect was generally stable in Phase 3. In Experiment 2, naltrexone was administered in Phase 2, Phase 3, or both Phases 2 and 3, to separate groups of rats. Naltrexone facilitated the elimination of alcohol-maintained behavior in Phase 2 and, the resurgence of alcohol-maintained behavior was reduced only for those rats that received naltrexone in both phases. Together, these experiments demonstrate that the resurgence of alcohol-maintained behavior is replicable within-subjects and, further, resurgence of alcohol-maintained behavior may be a useful model to evaluate pharmacological interventions to facilitate behavioral treatments and reduce the likelihood of relapse. Results with naltrexone support the use of medication-assisted therapy approaches to reduce relapse risk in patients. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Behavioral momentum and resistance to extinction across repeated extinction tests

The present experiments assessed whether resistance to extinction of pigeons' key pecking decreased across repeated extinction tests. An additional impetus for this research was to determine how the quantitative framework provided by behavioral momentum theory might be used to describe any such changes across tests. Pigeons pecked keys in two-component multiple schedules (one component associated with a higher reinforcer rate and the other with a lower rate) in which baseline and extinction conditions alternated. In Experiment 1, baseline and extinction conditions alternated every session, and, in Experiment 2, these conditions lasted for 10 and 7 sessions, respectively. Resistance to extinction decreased across successive extinction conditions in both experiments. Fits of the behavioral-momentum based model of extinction to the data returned uncertain results in Experiment 1 but implicated both generalization decrement and response-reinforcer contingency termination as the possible mechanisms responsible for behavior change in Experiment 2. Thus, these data suggest that experimental manipulations that affect discrimination of changes in reinforcement contingencies may influence resistance to extinction by modulating the disruptive impacts of removing reinforcers from the experimental context and of suspending response-reinforcer contingencies.

Behavioral persistence is associated with poorer olfactory discrimination learning in domestic dogs

Domestic dogs are trained for a wide variety of jobs; however, half of dogs that enter working dog training organizations never become certified. The aim of this study was to identify whether a basic measure of behavioral persistence was associated with sixteen dogs' performance on an odor discrimination learning task. Further, we evaluated whether dogs that adopted more of a win-stay or win-shift strategy during discrimination learning was associated with greater persistence. Lastly, we tested if measures of a standardized canine behavior questionnaire (the CBARQ) predicted discrimination learning. We found greater persistence during extinction was associated with poorer discrimination learning. Further, dogs that employed more of a win-stay strategy (compared to win-shift) during the discrimination learning phase showed greater persistence in the persistence task and poorer performance on the odor discrimination task. Lastly, the CBARQ measure of trainability showed a trend association with odor discrimination performance, but no other behavioral characteristics were related. Overall, high levels of behavioral persistence is detrimental to olfactory discrimination learning.

Multiple schedules, off-baseline reinforcement shifts, and resistance to extinction

Resistance to extinction in a target multiple-schedule component varies inversely with the rate of reinforcement arranged in an alternative component during baseline. The present experiment asked whether changing the reinforcer rate in an alternative component would impact extinction of target component responding if those changes occurred in an off-baseline phase during which the target component was never experienced. Pigeons' key pecking was studied in three types of conditions, and each condition consisted of three phases. In Phase 1, pecking produced food in the target and alternative components of a multiple schedule according to variable-interval 60-s schedules. In Phase 2, the alternative-component stimulus was presented alone in a single schedule. Pecking during this phase produced the same reinforcer rate as in baseline in the Control condition, a higher rate of food (variable-interval 15 s) in the High-Rate condition, or was extinguished in the Extinction condition. Extinction of target- and alternative-component key pecking then was assessed in a multiple schedule during the final phase of each condition. Resistance to extinction of target-component key pecking was the same between the Control and High-Rate conditions but lower in the Extinction condition. These findings are discussed in terms of discrimination and generalization processes.

Stimuli previously associated with reinforcement mitigate resurgence

Resurgence refers to the recurrence of an extinguished target behavior following subsequent suspension of alternative reinforcement. Delivery of reinforcers during extinction of alternative behavior has been shown to mitigate resurgence. The present experiment aimed to determine whether delivering stimuli associated with reinforcers during resurgence testing similarly mitigates resurgence. Three groups of rats pressed target levers for food according to variable-interval 15-s schedules during Phase 1. In Phase 2, lever pressing was extinguished, and an alternative nose-poke response produced alternative reinforcement according to a variable-interval 15-s schedule. Food reinforcement was always associated with illumination of the food aperture and an audible click from the pellet dispenser during Phases 1 and 2. Phase 3 treatments differed between groups. For one group, nose poking continued to produce food and food-correlated stimuli. Both of these consequences were suspended for a second group. Finally, nose poking produced food-correlated stimuli but not food for a third group. Target-lever pressing resurged in the group that received no consequences and in the group that received only food-correlated stimuli for nose poking. Resurgence, however, was smaller for the group that received food-correlated stimuli than for the group that received no consequences for nose poking. Target-lever pressing did not increase between phases in the group that continued to receive food and associated stimuli. Thus, delivery of stimuli associated with food reinforcement after suspension of food reduced but did not eliminate resurgence of extinguished lever pressing. These findings contribute to potential methodologies for preventing relapse of extinguished problem behavior in clinical settings.