Increased responsiveness to punishment of cocaine self-administration after experience with high punishment

The importance of choice and agency in animal models of addiction

The aim of this short commentary is twofold. First, it uncovers and outlines in broad strokes a historical, albeit oft-overlooked, trend toward a growing place for choice and agency in the design of animal models of addiction. Next, it tries to draw from this historical trend some perspectives and implications for future research.

Delay of punishment highlights differential vulnerability to developing addiction-like behavior toward sweet food

Resistance to punishment is commonly used to measure the difficulty in refraining from rewarding activities when negative consequences ensue, which is a hallmark of addictive behavior. We recently developed a progressive shock strength (PSS) procedure in which individual rats can titrate the amount of punishment that they are willing to tolerate to obtain food rewards. Here, we investigated the effects of a range of delays (0-12 s) on resistance to punishment measured by PSS break points. As expected from delay discounting principles, we found that delayed shock was less effective as a punisher, as revealed by higher PSS breakpoints. However, this discounting effect was not equally distributed in the population of rats, and the introduction of a delay highlighted the existence of two populations: rats that were sensitive to immediate punishment were also sensitive to delayed shock, whereas rats that were resistant to immediate punishment showed strong temporal discounting of delayed punishment. Importantly, shock-sensitive rats suppressed responding even in subsequent non-punishment sessions, and they differed from shock-resistant rats in anxiety-like behavior, but not in sensitivity to pain. These results show that manipulation of temporal contingencies of punishment in the PSS procedure provides a valuable tool to identify individuals with a double vulnerability to addiction: low sensitivity to aversion and excessive discounting of negative future consequences. Conversely, the shock-sensitive population may provide a model of humans who are vulnerable to opportunity loss due to excessive anxiety.

DREADD activation of the lateral orbitofrontal increases cocaine-taking and cocaine-seeking in male and female rats during intermittent access self-administration under risky conditions

Addiction is a disorder that can be characterized in part as the constant pursuit of a particular substance despite negative consequences. Although the orbitofrontal cortex (OFC) is known to regulate risk-taking more generally and be critical to the development of addiction, its role in regulating drug use under risk-taking conditions is unknown. To address this, we examined drug-taking and drug-seeking in male and female rats under conditions where cocaine infusions were paired with foot shock punishment 50% of the time and combined this paradigm with cFos immunohistochemistry. We found that rats that showed higher levels of drug-taking and drug-seeking prior to punishment showed decreased responding during self-administration sessions under risky conditions and lower levels of c-Fos expression in the lateral but not medial OFC. However, despite these initial differences in responses to infusions paired with foot shocks, all rats showed decreased responding with additional punishment sessions. We then used chemogenetic viral approaches to examine how altering activity of the lateral OFC affects drug-taking and drug-seeking during punished drug use. Although there was no effect of Gi/o DREADD-mediated inhibition of the lateral OFC on these behaviors, Gq DREADD-mediated activation increased drug-taking and drug-seeking when drug use was associated with foot shock 50% of the time. Interestingly, this manipulation had no effect on non-risky self-administration behavior. These results suggest that the involvement of lateral OFC in cocaine use is context-sensitive and influences decision-making based on negative outcomes.

Effects of environmental and pharmacological manipulations on cocaine-vs-negative reinforcer choice in male and female rats

RATIONALE

The adverse consequences of human addictive drug use could be the result of either addictive drug consumption resulting in punishment (e.g., incarceration) or failure to engage in negative-reinforced behaviors that might compete with drug-maintained behaviors (e.g., contingency management strategies that reset payment amounts for drug free urines).

OBJECTIVE

The goal of the present study was to establish a discrete-trial cocaine-vs-negative reinforcer (SNR) choice procedure where rats were presented with a simplified model of this conflict: choose negative reinforcement (i.e., escape or avoid foot shock) or choose an intravenous (IV) cocaine infusion followed by an inescapable shock.

METHODS

Responding was maintained in male and female rats by IV cocaine infusions (0.32-1.8 mg/kg/inf) and a SNR (0.1-0.7 mA shock) under a discrete-trial concurrent "choice" schedule during daily sessions. Following parametric reinforcer magnitude and response requirement experiments, the effects of 12 h extended access cocaine self-administration and acute diazepam (0.32-10 mg/kg, IP) pretreatment were determined on cocaine-vs-SNR choice.

RESULTS

Negative reinforcement was chosen over all cocaine doses. Lowering shock magnitude or increasing SNR response requirement failed to promote behavioral reallocation towards cocaine. Extended access cocaine self-administration sessions resulted in high daily cocaine intakes but failed to significantly increase cocaine choice in all (19) but one rat. Acute diazepam pretreatment also did not alter choice behavior up to doses that produced behavioral depression.

CONCLUSIONS

These results suggest that SNRs may be a source of reinforcement that effectively compete with and mitigate maladaptive addictive drug-maintained behaviors in the general population.

Pathways to the persistence of drug use despite its adverse consequences

The persistence of drug taking despite its adverse consequences plays a central role in the presentation, diagnosis, and impacts of addiction. Eventual recognition and appraisal of these adverse consequences is central to decisions to reduce or cease use. However, the most appropriate ways of conceptualizing persistence in the face of adverse consequences remain unclear. Here we review evidence that there are at least three pathways to persistent use despite the negative consequences of that use. A cognitive pathway for recognition of adverse consequences, a motivational pathway for valuation of these consequences, and a behavioral pathway for responding to these adverse consequences. These pathways are dynamic, not linear, with multiple possible trajectories between them, and each is sufficient to produce persistence. We describe these pathways, their characteristics, brain cellular and circuit substrates, and we highlight their relevance to different pathways to self- and treatment-guided behavior change.

A concurrently available negative reinforcer robustly decreases cocaine self-administration in male and female rats

Continued drug-taking despite adverse consequences is hypothesized to be an insidious behavioral hallmark of drug addiction. Although most preclinical research has focused on drug self-administration in the presence of positive punishment, another source of potential adverse consequences is behavioral allocation away from negative reinforcers (i.e., escape/avoid electric shock) and towards drug reinforcers. The goals of the present study were to establish a discrete-trial cocaine-vs-negative reinforcer choice procedure in male and female rats and determine sensitivity of choice behavior to environmental and pharmacological manipulations. Rats could make up to nine discrete choices between an intravenous cocaine infusion (0.32 - 1.8 mg/kg/inf) under a fixed-ratio (FR) 3 schedule and a negative reinforcer (escape or avoidance of electric shock, 0.1 - 0.7 mA) under an FR1 schedule. The negative reinforcer was consistently chosen over all cocaine doses. Lowering shock magnitude decreased negative reinforcer trials, increased omitted trials, and failed to promote behavioral reallocation towards cocaine. Increasing the negative reinforcement response requirement between sessions only increased omitted trials. Introduction of 12-hr extended access cocaine self-administration sessions across two weeks resulted in high daily cocaine intakes but failed to significantly increase cocaine choice. Acute diazepam pretreatment also did not impact choice behavior up to doses that produced behavioral depression. Overall, the lack of behavioral allocation between cocaine infusions and a negative reinforcer suggests these two reinforcers may be economic independents. Additionally, the failure of extended cocaine access to increase cocaine choice highlights the importance of alternative reinforcers and environmental context in preclinical models of drug addiction.

Effects of repeated exposure to escalating versus constant punishment intensity on response allocation

The present experiment investigated the effects of 1) repeated exposures to escalating punishment intensities and 2) repeated exposure to punishment after periods of vacation on response allocation between punished and unpunished responding in three groups of rats. The first group (intensity + vacation) experienced repeated exposures to escalating punishment intensities after a period of vacation (i.e., return to baseline) from punishment. The second group (intensity-only) experienced repeated exposures to escalating punishment intensities without vacation from punishment. The third group (vacation-only) experienced repeated exposures to a constant punishment intensity after a period of vacation from punishment. Results showed that superimposition of punishment on one of two concurrently available responses decreased allocation toward the punished response and increased allocation toward the unpunished response. Furthermore, greater changes in allocation were observed with the introduction of a moderate constant intensity than with the introduction of a low intensity that increased across sessions. Reexposure to punishment had different effects between the groups. Although there was evidence that high shock intensities can enhance the efficacy of lower intensities to shift allocation away from the punished response and toward the unpunished response, there was little evidence of changes in response allocation with reintroduction of punishment after a period of vacation.