Nucleus accumbens and delay discounting in rats: evidence from a new quantitative protocol for analysing inter-temporal choice

Poke And Delayed Drink Intertemporal Choice Task (POKE-ADDICT): An open-source behavioral apparatus for intertemporal choice testing in rodents

Advancements in neuroscience research present opportunities and challenges, requiring substantial resources and funding. To address this, we describe here "Poke And Delayed Drink Intertemporal Choice Task (POKE-ADDICT)", an open-source, versatile, and cost-effective apparatus for intertemporal choice testing in rodents. This allows quantification of delay discounting (DD), a cross-species phenomenon observed in decision making which provides valuable insights into higher-order cognitive functioning. In DD, the subjective value of a delayed reward is reduced as a function of the delay for its receipt. Using our apparatus, we implemented an effective intertemporal choice paradigm for the quantification of DD based on an adjusting delayed amount (ADA) algorithm using mango juice as a reward. Our paradigm requires limited training, a few 3D-printed parts and inexpensive electrical components, including a Raspberry Pi control unit. Furthermore, it is compatible with several in vivo procedures and the use of nose pokes instead of levers allows for faster task learning. Besides the main application described here, the apparatus can be further extended to implement other behavioral tests and protocols, including standard operant conditioning. In conclusion, we describe a versatile and cost-effective design based on Raspberry Pi that can support research in animal behavior, decision making and, more specifically, delay discounting.

Selective chemogenetic inactivation of corticoaccumbal projections disrupts trait choice impulsivity

Impulsive choice has enduring trait-like characteristics and is defined by preference for small immediate rewards over larger delayed ones. Importantly, it is a determining factor in the development and persistence of substance use disorder (SUD). Emerging evidence from human and animal studies suggests frontal cortical regions exert influence over striatal reward processing areas during decision-making in impulsive choice or delay discounting (DD) tasks. The goal of this study was to examine how these circuits are involved in decision-making in animals with defined trait impulsivity. To this end, we trained adolescent male rats to stable behavior on a DD procedure and then re-trained them in adulthood to assess trait-like, conserved impulsive choice across development. We then used chemogenetic tools to selectively and reversibly target corticostriatal projections during performance of the DD task. The prelimbic region of the medial prefrontal cortex (mPFC) was injected with a viral vector expressing inhibitory designer receptors exclusively activated by designer drugs (Gi-DREADD), and then mPFC projections to the nucleus accumbens core (NAc) were selectively suppressed by intra-NAc administration of the Gi-DREADD actuator clozapine-n-oxide (CNO). Inactivation of the mPFC-NAc projection elicited a robust increase in impulsive choice in rats with lower vs. higher baseline impulsivity. This demonstrates a fundamental role for mPFC afferents to the NAc during choice impulsivity and suggests that maladaptive hypofrontality may underlie decreased executive control in animals with higher levels of choice impulsivity. Results such as these may have important implications for the pathophysiology and treatment of impulse control, SUDs, and related psychiatric disorders.

Global Cerebral Ischemia in Male Long Evans Rats Impairs Dopaminergic/ΔFosB Signalling in the Mesocorticolimbic Pathway Without Altering Delay Discounting Rates

Global cerebral ischemia (GCI) in rats has been shown to promote exploration of anxiogenic zones of the Elevated-Plus Maze (EPM) and Open Field Test (OFT). This study investigated changes in impulsive choice and/or defensive responses as possible contributors of heightened anxiogenic exploration observed after ischemia. Impulsivity was assessed using delay discounting (DD) paradigms, while the Predator Odour Test (PO) served to assess changes in defensive responses towards a naturally aversive stimulus. Male Long Evans rats underwent 9 days of autoshaping training and 24 days of DD training prior to GCI or sham surgery (n = 9/group). Post-surgery, rats completed the OFT, EPM, and PO, followed by 6 days of DD sessions. Blood droplets served to evaluate corticosterone secretion associated with PO exposure. With impulsivity being regulated through mesocorticolimbic monoaminergic pathways, we also characterised post-ischemic changes in the expression of dopamine D₂ receptors (DRD₂), dopamine transporters (DAT), and 1FosB in the basolateral amygdala (BLA), nucleus accumbens core (NAcC) and shell (NAcS), and ventromedial prefrontal cortex (vmPFC) using immunohistofluorescence. Our findings revealed no impact of GCI on delay discounting rates, while PO approach behaviours were minimally affected. Nonetheless, GCI significantly reduced DRD₂ and ΔFosB-ir in the NAcS and NAcC, respectively, while DAT-ir was diminished in both NAc subregions. Collectively, our findings refine the understanding of cognitive-behavioural and biochemical responses following stroke or cardiac arrest. They support significant alterations to the dopaminergic mesocorticolimbic pathway after ischemia, which are not associated with altered impulsive choice in a DD task but may influence locomotor exploration of the OFT and EPM.

Which came first: Cannabis use or deficits in impulse control?

Impulse control deficits are often found to co-occur with substance use disorders (SUDs). On the one hand, it is well known that chronic intake of drugs of abuse remodels the brain with significant consequences for a range of cognitive behaviors. On the other hand, individual variation in impulse control may contribute to differences in susceptibility to SUDs. Both of these relationships have been described, thus leading to a "chicken or the egg" debate which remains to be fully resolved. Does impulsivity precede drug use or does it manifest as a function of problematic drug usage? The link between impulsivity and SUDs has been most strongly established for cocaine and alcohol use disorders using both preclinical models and clinical data. Much less is known about the potential link between impulsivity and cannabis use disorder (CUD) or the directionality of this relationship. The initiation of cannabis use occurs most often during adolescence prior to the brain's maturation, which is recognized as a critical period of development. The long-term effects of chronic cannabis use on the brain and behavior have started to be explored. In this review we will summarize these observations, especially as they pertain to the relationship between impulsivity and CUD, from both a psychological and biological perspective. We will discuss impulsivity as a multi-dimensional construct and attempt to reconcile the results obtained across modalities. Finally, we will discuss possible avenues for future research with emerging longitudinal data.

In search of a definition of reinforcer value: Some successes and failures of the multiplicative hyperbolic model

The concept of 'value' has enjoyed a central position in many theoretical accounts of choice behaviour. Several definitions of 'value' are contrasted in this paper, and one particular approach is defended, whereby value is defined as a dimensionless intervening variable. This definition is a cornerstone of the multiplicative hyperbolic model of choice (MHM), which was proposed twenty years ago as a modification of Mazur's (1987) hyperbolic model of delay discounting. This paper reviews some of the merits and shortcomings of MHM, and suggests some ways in which MHM might be extended and improved. A formal link between 'value' and the related concept of 'response strength' is suggested, and revisions of the model are proposed which may enable it to accommodate several behavioural phenomena not considered in the original formulation. Broadening the scope of MHM comes at the cost of adding to its burden of free parameters, and it is emphasised that addition of any new parameters needs empirical justification. The status of value as a dimensionless intervening variable is upheld; however it is noted that a growing body of empirical evidence for links between neurobiological phenomena and value suggests that interpretation of value as a hypothetical construct may be warranted.

Effects of sucrose concentration on choice in an adjusting-magnitude schedule

Rats were trained under a discrete-trials adjusting-magnitude schedule in which a response on lever A delivered either a larger or a smaller sucrose reinforcer (q_A1 = 8 μl, q_A2 = 64 μl) with equal probability, while a response on B delivered a reinforcer whose size q_B was adjusted according to the rats' choices. When A was preferred in a given block of trials, q_B was increased in the following block; when B was preferred, q_B was reduced in the following block. The oscillating changes in q_B, analysed by the Fourier transform, could be described by a power spectrum whose dominant frequency corresponded to a period of 40-50 trial blocks. The equilibrium value of q_B (q_B(50)) was inversely related to sucrose concentration; it significantly exceeded the arithmetic mean of q_A1 and q_A2 when the concentration was 0.2 or 0.4 M, but not when it was 0.8 or 1.6 M. Analysis by mixed-effects modelling revealed a trend for the power of oscillation of q_B to increase monotonically with sucrose concentration; the period of oscillation was not systematically related to sucrose concentration. These results are consistent with predictions derived from a revised version of the multiplicative hyperbolic model of intertemporal choice.

Dissecting drug effects in preclinical models of impulsive choice: emphasis on glutamatergic compounds

RATIONALE

Impulsive choice is often measured with delay discounting paradigms. Because there are multiple discounting procedures, as well as different statistical analyses that can be applied to data generated from these paradigms, there are some inconsistencies in the literature regarding drug effects on impulsive choice.

OBJECTIVES

The goal of the current paper is to review the methodological and analytic approaches used to measure discounting and to discuss how these differences can account for differential drug effects observed across studies.

RESULTS

Because some procedures/analyses use a single data point as the dependent variable, changes in this value following pharmacological treatment may be interpreted as alterations in sensitivity to delayed reinforcement, but when other procedures/analyses are used, no changes in behavior are observed. Even when multiple data points are included, some studies show that the statistical analysis (e.g., ANOVA on raw proportion of responses vs. using hyperbolic/exponential functions) can lead to different interpretations. Finally, procedural differences (e.g., delay presentation order, signaling the delay to reinforcement, etc.) in the same discounting paradigm can alter how drugs affect sensitivity to delayed reinforcement.

CONCLUSIONS

Future studies should utilize paradigms that allow one to observe alterations in responding at each delay (e.g., concurrent-chains schedules). Concerning statistical analyses, using parameter estimates derived from nonlinear functions or incorporating the generalized matching law can allow one to determine if drugs affect sensitivity to delayed reinforcement or impair discrimination of the large and small magnitude reinforcers. Using these approaches can help further our understanding of the neurochemical underpinnings of delay discounting.

Nucleus accumbens core lesions induce sub-optimal choice and reduce sensitivity to magnitude and delay in impulsive choice tasks

The nucleus accumbens core (NAc) has long been recognized as an important contributor to the computation of reward value that is critical for impulsive choice behavior. Impulsive choice refers to choosing a smaller-sooner (SS) over a larger-later (LL) reward when the LL is more optimal in terms of the rate of reward delivery. Two experiments examined the role of the NAc in impulsive choice and its component processes of delay and magnitude processing. Experiment 1 delivered an impulsive choice task with manipulations of LL reward magnitude, followed by a reward magnitude discrimination task. Experiment 2 tested impulsive choice under manipulations of LL delay, followed by temporal bisection and progressive interval tasks. NAc lesions, in comparison to sham control lesions, produced suboptimal preferences that resulted in lower reward earning rates, and led to reduced sensitivity to magnitude and delay within the impulsive choice task. The secondary tasks revealed intact reward magnitude and delay discrimination abilities, but the lesion rats persisted in responding more as the progressive interval increased during the session. The results suggest that the NAc is most critical for demonstrating good sensitivity to magnitude and delay, and adjusting behavior accordingly. Ultimately, the NAc lesions induced suboptimal choice behavior rather than simply promoting impulsive choice, suggesting that an intact NAc is necessary for optimal decision making.

Effects of intra-accumbal administration of dopamine and ionotropic glutamate receptor drugs on delay discounting performance in rats

Nucleus accumbens core (NAcc) has been implicated in impulsive choice, as measured in delay discounting. The role of dopamine (DA) in impulsive choice has received considerable attention, whereas glutamate (Glu) has recently been shown to be an important mediator of discounting. However, research has not examined how DA or Glu receptors in NAcc mediate different aspects of delay discounting performance, that is, (a) sensitivity to reinforcer magnitude and (b) sensitivity to delayed reinforcement. Adult male Sprague-Dawley rats were first trained in a delay discounting task, in which the delay to a large magnitude food reinforcer increased across blocks of trials. Following behavioral training, rats received bilateral implantation of guide cannulas into NAcc. Half of the rats (n = 12) received infusions of the DA-selective ligands SKF 38393 (D1-like agonist: 0.03 or 0.1 μg), SCH 23390 (D1-like antagonist: 0.3 or 1.0 μg), quinpirole (D2-like agonist: 0.3 or 1.0 μg), and eticlopride (D2-like antagonist: 0.3 or 1.0 μg). The other half received infusions of the ionotropic Glu ligands MK-801 (NMDA uncompetitive antagonist: 0.3 or 1.0 μg), AP-5 (NMDA competitive antagonist: 0.3 or 1.0 μg), ifenprodil (noncompetitive antagonist at NR2B-containing NMDA receptors: 0.3 or 1.0 μg), and CNQX (AMPA competitive antagonist: 0.2 or 0.5 μg). Results showed that SCH 23390 (0.3 μg) decreased sensitivity to reinforcer magnitude without altering impulsive choice, whereas ifenprodil (1.0 μg) decreased sensitivity to delayed reinforcement (i.e., impulsive choice). The current results show that DA and NMDA receptors in NAcc mediate distinct aspects of discounting performance. (PsycINFO Database Record

Effects of Ventral Striatum Lesions on Stimulus-Based versus Action-Based Reinforcement Learning

Learning the values of actions versus stimuli may depend on separable neural circuits. In the current study, we evaluated the performance of rhesus macaques with ventral striatum (VS) lesions on a two-arm bandit task that had randomly interleaved blocks of stimulus-based and action-based reinforcement learning (RL). Compared with controls, monkeys with VS lesions had deficits in learning to select rewarding images but not rewarding actions. We used a RL model to quantify learning and choice consistency and found that, in stimulus-based RL, the VS lesion monkeys were more influenced by negative feedback and had lower choice consistency than controls. Using a Bayesian model to parse the groups' learning strategies, we also found that VS lesion monkeys defaulted to an action-based choice strategy. Therefore, the VS is involved specifically in learning the value of stimuli, not actions.SIGNIFICANCE STATEMENT Reinforcement learning models of the ventral striatum (VS) often assume that it maintains an estimate of state value. This suggests that it plays a general role in learning whether rewards are assigned based on a chosen action or stimulus. In the present experiment, we examined the effects of VS lesions on monkeys' ability to learn that choosing a particular action or stimulus was more likely to lead to reward. We found that VS lesions caused a specific deficit in the monkeys' ability to discriminate between images with different values, whereas their ability to discriminate between actions with different values remained intact. Our results therefore suggest that the VS plays a specific role in learning to select rewarded stimuli.

Increased temporal discounting after chronic stress in CHL1-deficient mice is reversed by 5-HT2C agonist Ro 60-0175

Schizophrenia is a neurodevelopmental disorder in which impaired decision-making and goal-directed behaviors are core features. One of the genes associated with schizophrenia is the Close Homolog of L1 (CHL1); CHL1-deficient mice are considered a model of schizophrenia-like deficits, including sensorimotor gating, interval timing and spatial memory impairments. Here we investigated temporal discounting in CHL1-deficient (KO) mice and their wild-type littermates. Although no discounting differences were found under baseline conditions, CHL1-KO mice showed increased impulsive choice following chronic unpredictable stress (fewer % larger-later choices, and reduced area under the discounting curve). Stressed CHL1-KO mice also showed decreased neuronal activation (number of cFos positive neurons) in the discounting task in the prelimbic cortex and dorsal striatum, areas thought to be part of executive and temporal processing circuits. Impulsive choice alterations were reversed by the 5-HT2C agonist Ro 60-0175. Our results provide evidence for a gene x environment, double-hit model of stress-related decision-making impairments, and identify CHL1-deficient mice as a mouse model for these deficits in regard to schizophrenia-like phenotypes.

Some properties of an adjusting-magnitude schedule of reinforcement: Implications for models of choice

Rats were trained under a discrete-trials adjusting-magnitude schedule in which a response on lever A delivered either a larger or a smaller reinforcer (q_A1 and q_A2) with equal probability, while a response on B delivered a reinforcer whose size q_B was adjusted according to the rats' choices. When A was preferred in a given block of trials, q_B was increased in the following block; when B was preferred, q_B was reduced in the following block. The oscillating changes in q_B, analysed by the Fourier transform, could be described by a power spectrum with a dominant period of about 50 trial blocks. With q_A1 held constant, the equilibrium value of q_B (q_B(50)) was monotonically related to q_A2, and exceeded the arithmetic mean of q_A1 and q_A2 when q_A1 was substantially greater than q_A2. A model derived from the multiplicative model of intertemporal choice provided a post hoc description of the data. Simulation of block-by-block changes in q_B derived from the model were generally consistent with the experimental data. Implications of the results for models of risky choice and for future use of the schedule in neurobehavioural experiments are discussed.

A framework for understanding and advancing intertemporal choice research using rodent models

Intertemporal choices are common and consequential to private and public life. Thus, there is considerable interest in understanding the neural basis of intertemporal decision making. In this minireview, we briefly describe conceptual and psychological perspectives on intertemporal choice and then provide a comprehensive evaluation of the neural structures and signals that comprise the underlying cortico-limbic-striatal circuit. Even though great advances have been made, our understanding of the neurobiology of intertemporal choice is still in its infancy because of the complex and dynamic nature of this form of decision making. We close by briefly discussing recommendations for the future study of intertemporal choice research.

Impulsivity and sensitivity to amount and delay of reinforcement in an animal model of ADHD

Previous research has been inconclusive about the degree of impulsivity displayed by spontaneously hypertensive rats (SHR), an animal model of Attention Deficit Hyperactivity Disorder (ADHD). In the present set of experiments, concurrent-chains schedules were employed in order to explore SHR's impulsivity, sensitivity to delay, and sensitivity to amount of reinforcement; Wistar rats (WIS) were used as comparison group. In the three experiments - performed with different subjects - non-independent variable interval 30s schedules were presented in the initial links; the difference between experiments was in the terminal links. For exploring impulsivity, one of the terminal links (SS) was associated to a short delay (2s) and a small reinforcer (1 pellet), whereas the other terminal link (LL) was associated to a longer delay (28s) and a larger reinforcer (4 pellets). The results indicated a remarkably higher impulsivity in SHR. Because this impulsivity may have as potential mechanisms an increased sensitivity to delay and/or a decreased sensitivity to the amount of reinforcement, in experiments 2 and 3 these possibilities were examined. For assessing sensitivity to delay, the following pairs of fixed interval (FI) schedules were used in the terminal links in five conditions: 2-28, 6-24, 15-15, 24-6, 28-2s; the magnitude of reinforcement was 1 pellet in all conditions for both alternatives. For assessing sensitivity to amount, in five conditions the alternatives were associated with different magnitudes of reinforcement: 1-5 pellets, 2-4, 3-3, 4-2 and 5-1 in left-right alternatives, respectively; the delay to reinforcement was controlled by a FI 15s in all conditions and for both alternatives. The sensitivity to delay and the sensitivity to amount were calculated according to the Generalized Matching Law. The results indicated a higher sensitivity to delay in SHR, and the same sensitivity to amount in SHR and WIS rats. These results suggest that the increased sensitivity to delay influences the high level of impulsivity observed in SHR.

Ramping single unit activity in the medial prefrontal cortex and ventral striatum reflects the onset of waiting but not imminent impulsive actions

The medial prefrontal cortex (mPFC) and ventral striatum (VS), including the nucleus accumbens, are key forebrain regions involved in regulating behaviour for future rewards. Dysfunction of these regions can result in impulsivity, characterized by actions that are mistimed and executed without due consideration of their consequences. Here we recorded the activity of single neurons in the mPFC and VS of 16 rats during performance on a five-choice serial reaction time task of sustained visual attention and impulsivity. Impulsive responses were assessed by the number of premature responses made before target stimuli were presented. We found that the majority of cells signalled trial outcome after an action was made (both rewarded and unrewarded). Positive and negative ramping activity was a feature of population activity in the mPFC and VS (49.5 and 50.4% of cells, respectively). This delay-related activity increased at the same rate and reached the same maximum (or minimum) for trials terminated by either correct or premature responses. However, on premature trials, the ramping activity started earlier and coincided with shorter latencies to begin waiting. For all trial types the pattern of ramping activity was unchanged when the pre-stimulus delay period was made variable. Thus, premature responses may result from a failure in the timing of the initiation of a waiting process, combined with a reduced reliance on external sensory cues, rather than a primary failure in delay activity. Our findings further show that the neural locus of this aberrant timing signal may emanate from structures outside the mPFC and VS.

Recent Insights into the Neurobiology of Impulsivity

Impulsivity is associated with various psychopathologies, and elevated impulsivity is typically disadvantageous. This manuscript reviews recent investigations into the neurobiology of impulsivity using human imaging techniques and animal models. Both human imaging and preclinical pharmacological manipulations have yielded important insights into the neurobiological underpinnings of impulsivity. A more thorough understanding of the complex neurobiology underlying aspects of impulsivity may provide insight into new treatment options that target elevated impulsivity and psychopathologies such as addictions.

Intake-dependent effects of cocaine self-administration on impulsive choice in a delay discounting task

Cocaine use is associated with high levels of impulsive choice (greater discounting of delayed rewards) in humans, but the cause/effect relationships between cocaine use and impulsive choice are not fully understood. In previous work, we found that both experimenter- and self-administration of fixed quantities of cocaine caused lasting increases in impulsive choice in rats. The present study extended these findings by taking into account baseline impulsive choice prior to self-administration and by allowing rats free access to cocaine. Male Long-Evans rats were trained in a delay discounting task in which they made discrete-trial choices between small immediate and large delayed food rewards. Half of the rats were then implanted with intravenous catheters and, following recovery, allowed to self-administer cocaine HCl (1.0 mg/kg/infusion) in 6-hr sessions over 14 days. Control rats orally self-administered a sucrose solution under similar conditions. Upon completion of self-administration, rats remained abstinent for 3 weeks before retesting in the delay discounting task. Cocaine and control groups did not differ prior to self-administration, but afterward, the cocaine group showed greater impulsive choice (fewer choices of large, delayed rewards) than controls. Additional analyses revealed that the effects of cocaine on impulsive choice were intake-dependent; rats classified as "low intake" did not differ from controls, whereas rats classified as "high intake" were significantly more impulsive than both controls and their precocaine baseline. These findings are consistent with the idea that cocaine-induced, pharmacologically based neural adaptations promote the development of impulsive decision making.

Prefrontal cortical-striatal dopamine receptor mRNA expression predicts distinct forms of impulsivity

Variation in dopamine receptor levels has been associated with different facets of impulsivity. To further delineate the neural substrates underlying impulsive action (inability to withhold a prepotent motor response) and impulsive choice (delay aversion), we characterised rats in the Differential Reinforcement of Low Rates of Responding task and a delay discounting task. We also measured performance on an effort-based discounting task. We then assessed D1 and D2 dopamine receptor mRNA expression in subregions of the prefrontal cortex and nucleus accumbens using in situ hybridisation, and compared these data with behavioral performance. Expression of D1 and D2 receptor mRNA in distinct brain regions was predictive of impulsive action. A dissociation within the nucleus accumbens was observed between subregions and receptor subtypes; higher D1 mRNA expression in the shell predicted greater impulsive action, whereas lower D2 mRNA expression in the core predicted greater impulsive action. We also observed a negative correlation between impulsive action and D2 mRNA expression in the prelimbic cortex. Interestingly, a similar relationship was present between impulsive choice and prelimbic cortex D2 mRNA, despite the fact that behavioral indices of impulsive action and impulsive choice were uncorrelated. Finally, we found that both high D1 mRNA expression in the insular cortex and low D2 mRNA expression in the infralimbic cortex were associated with willingness to exert effort for rewards. Notably, dopamine receptor mRNA in these regions was not associated with either facet of impulsivity. The data presented here provide novel molecular and neuroanatomical distinctions between different forms of impulsivity, as well as effort-based decision-making.

Pharmacological studies of performance on the free-operant psychophysical procedure

In the free-operant psychophysical procedure (FOPP), reinforcement is provided intermittently for responding on lever A in the first half and lever B in the second half of a trial. Temporal differentiation is measured from the psychometric function (percent responding on B, %B, versus time from trial onset, t), the index of timing being T50, the value of t at %B=50. T50 is reduced by acute treatment with 5-hydroxytryptamine (5-HT1A, 5-HT2A) and dopamine (D1-like, D2-like) receptor agonists. The effects of the agonists can be reversed by the respective antagonists of these receptors. Evidence is reviewed suggesting that the effect of endogenous 5-HT is mediated by 5-HT2A receptors and the effect of endogenous dopamine by D1-like receptors. Data are presented on the effects of lesions of the prefrontal cortex and corpus striatum on the sensitivity of performance on the FOPP to D1-like and D2-like receptor agonists. Lesions of the nucleus accumbens, but not the dorsal striatum or prefrontal cortex, attenuated the effects of a D1-like receptor agonist, 6-chloro-2,3,4,5-tetrahydro-1-phenyl-1H-3-benzazepine [SKF-81297], but not a D2-like receptor agonist, quinpirole, on T50. The results indicate that a population of D1-like receptors in the ventral striatum may contribute to the control of timing performance on the FOPP.

Fos expression in the prefrontal cortex and ventral striatum after exposure to a free-operant timing schedule

It has been proposed that cortico-striato-thalamo-cortical circuits that incorporate the prefrontal cortex and corpus striatum regulate interval timing behaviour. In the present experiment regional Fos expression was compared between rats trained under an immediate timing schedule, the free-operant psychophysical procedure (FOPP), which entails temporally regulated switching between two operanda, and a yoked variable-interval (VI) schedule matched to the timing task for food deprivation level, reinforcement rate and overall response rate. The density of Fos-positive neurones (counts mm⁻²) in the orbital prefrontal cortex (OPFC) and the shell of the nucleus accumbens (AcbS) was greater in rats exposed to the FOPP than in rats exposed to the VI schedule, suggesting a greater activation of these areas during the performance of the former task. The enhancement of Fos expression in the OPFC is consistent with previous findings with both immediate and retrospective timing schedules. Enhanced Fos expression in the AcbS was previously found in retrospective timing schedules based on conditional discrimination tasks, but not in a single-operandum immediate timing schedule, the fixed-interval peak procedure. It is suggested that the ventral striatum may be engaged during performance on timing schedules that entail operant choice, irrespective of whether they belong to the immediate or retrospective categories.

A theory of behaviour on progressive ratio schedules, with applications in behavioural pharmacology

RATIONALE

Mathematical principles of reinforcement (MPR) provide the theoretical basis for a family of models of schedule-controlled behaviour. A model of fixed-ratio schedule performance that was applied to behaviour on progressive ratio (PR) schedules showed systematic departures from the data.

OBJECTIVE

This study aims to derive a new model from MPR that will account for overall and running response rates in the component ratios of PR schedules, and their decline toward 0, the breakpoint.

METHOD

The role of pausing is represented in a real-time model containing four parameters: T (0) and k are the intercept and slope of the linear relation between post-reinforcement pause duration and the prior inter-reinforcer interval; a (specific activation) measures the incentive value of the reinforcer; δ (response time) sets biomechanical limits on response rate. Running rate is predicted to decrease with negative acceleration as ratio size increments, overall rate to increase and then decrease. Differences due to type of progression are explained as hysteresis in the control by reinforcement rates. Re-analysis of extant data focuses on the effects of acute treatment with antipsychotic drugs, lesions of the nucleus accumbens core, and destruction of orexinergic neurones of the lateral hypothalamus.

RESULTS

The new model resolves some anomalies evident in earlier analyses, and provides new insights to the results of these interventions.

CONCLUSIONS

Because they can render biologically relevant parameters, mathematical models can provide greater power in interpreting the effects of interventions on the processes underlying schedule-controlled behaviour than is possible for first-order data such as the breakpoint.

Fos expression in the orbital prefrontal cortex after exposure to the fixed-interval peak procedure

It has been proposed that cortico-striato-thalamo-cortical circuits that incorporate the prefrontal cortex and dorsal striatum regulate interval timing behaviour. The present experiment examined whether performance on the fixed-interval peak procedure (FIPP), an immediate timing schedule, would induce neuronal activity in cortical and striatal areas, as revealed by enhanced expression of the Fos protein, a marker for neuronal activation. Regional Fos expression was compared between rats trained on the FIPP and rats trained on a variable-interval (VI) schedule matched to the FIPP for overall response rate and reinforcer delivery. Response rate in the peak trials of the FIPP conformed to a temporally differentiated pattern, which was well described by a modified Gaussian function; in agreement with previous findings, the peak time occurred close to the time at which the reinforcer was delivered in the fixed-interval trials, and the Weber fraction was within the range of values reported previously. The density of Fos-positive neurones (counts mm⁻²) in the orbital prefrontal cortex (OPFC) was greater in rats exposed to the FIPP than in rats exposed to the VI schedule, suggesting a greater activation of this area during the performance of the former task. This is consistent with the results of previous studies that have implicated the OPFC in interval timing behaviour. However, there was no significant difference between the levels of Fos expression in the dorsal or ventral striatum of the rats trained under the two schedules.