Dissociable and Paradoxical Roles of Rat Medial and Lateral Orbitofrontal Cortex in Visual Serial Reversal Learning

From compulsivity to compulsion: the neural basis of compulsive disorders

Compulsive behaviour, an apparently irrational perseveration in often maladaptive acts, is a potential transdiagnostic symptom of several neuropsychiatric disorders, including obsessive-compulsive disorder and addiction, and may reflect the severe manifestation of a dimensional trait termed compulsivity. In this Review, we examine the psychological basis of compulsions and compulsivity and their underlying neural circuitry using evidence from human neuroimaging and animal models. Several main elements of this circuitry are identified, focused on fronto-striatal systems implicated in goal-directed behaviour and habits. These systems include the orbitofrontal, prefrontal, anterior cingulate and insular cortices and their connections with the basal ganglia as well as sensoriomotor and parietal cortices and cerebellum. We also consider the implications for future classification of impulsive-compulsive disorders and their treatment.

5-HT 2A and 5-HT 2C receptor antagonism differentially modulate reinforcement learning and cognitive flexibility: behavioural and computational evidence

RATIONALE

Cognitive flexibility, the ability to adapt behaviour in response to a changing environment, is disrupted in several neuropsychiatric disorders, including obsessive-compulsive disorder and major depressive disorder. Evidence suggests that flexibility, which can be operationalised using reversal learning tasks, is modulated by serotonergic transmission. However, how exactly flexible behaviour and associated reinforcement learning (RL) processes are modulated by 5-HT action on specific receptors is unknown.

OBJECTIVES

We investigated the effects of 5-HT2A receptor (5-HT2AR) and 5-HT2C receptor (5-HT2CR) antagonism on flexibility and underlying RL mechanisms.

METHODS

Thirty-six male Lister hooded rats were trained on a touchscreen visual discrimination and reversal task. We evaluated the effects of systemic treatments with the 5-HT2AR and 5-HT2CR antagonists M100907 and SB-242084, respectively, on reversal learning and performance on probe trials where correct and incorrect stimuli were presented with a third, probabilistically rewarded, stimulus. Computational models were fitted to task choice data to extract RL parameters, including a novel model designed specifically for this task.

RESULTS

5-HT2AR antagonism impaired reversal learning only after an initial perseverative phase, during a period of random choice and then new learning. 5-HT2CR antagonism, on the other hand, impaired learning from positive feedback. RL models further differentiated these effects. 5-HT2AR antagonism decreased punishment learning rate (i.e. negative feedback) at high and low doses. The low dose also decreased reinforcement sensitivity (beta) and increased stimulus and side stickiness (i.e., the tendency to repeat a choice regardless of outcome). 5-HT2CR antagonism also decreased beta, but reduced side stickiness.

CONCLUSIONS

These data indicate that 5-HT2A and 5-HT2CRs both modulate different aspects of flexibility, with 5-HT2ARs modulating learning from negative feedback as measured using RL parameters and 5-HT2CRs for learning from positive feedback assessed through conventional measures.

Four Streams Within the Prefrontal Cortex: Integrating Structural and Functional Connectivity

Merging functional evidence derived from studies of autism spectrum disorder and attention-deficit/hyperactivity disorder converges in four neural streams of the prefrontal cortex, hence suggesting a model of information processing through four streams: motor through Brodmann area (BA) 8, emotion through BA 9, memory through BA 10, and emotional-related sensory through BA 11. A growing body of functional data has been supporting this model of information processing. Nevertheless, the underlying structural connectivity was only recently unveiled by a population-based high-definition tractography study with data from 1,065 individuals. This update provides a brief overview of recent evidence supporting the anatomofunctional integration of the four streams of the prefrontal cortex and reviews the white matter fiber tracts subserving the four streams.

Engagement for alcohol escalates in the 5-choice serial reaction time task after intermittent access

Excessive intake plays a significant role in the development of alcohol use disorder and impacts 15 million Americans annually, with approximately 88 000 dying from alcohol related deaths. Several facets we contribute to alcohol use disorder include impulsivity, motivation, and attention. Previous studies have used the 5-Choice Serial Reaction Time Task (5-Choice) to analyze these types of behaviors using sugar, but recently we have published using 10% alcohol as the reward. This study analyzed 48 mice that were trained to respond for alcohol in the 5-Choice. All mice distributed and analyzed first by alcohol preference and then by consumption. Here, we became interested in a new classification called "engagement". High-engaged and low-engaged mice were determined by the number of correct responses during final Late-Stage training sessions. Interestingly, during Early-Stage training, the mice began to separate themselves into two groups based on their interaction with the task. Throughout both training stages, high-engaged mice displayed a greater number of trials and correct responses, as well as a lower percentage of omissions compared to low-engaged mice. Following three weeks of intermittent access homecage drinking, low-engaged mice showed greater increase in perseverative responding relative to high-engaged. Additionally, low-engaged mice decreased their reward and correct latencies compared to high-engaged mice suggesting an increase in motivation for alcohol. Overall, engagement analysis presents two clearly different groups, with only one being motivated to work for alcohol. These two distinct phenotypes in the 5-Choice could be used to model alcohol motivated behavior, which could help us further understand alcohol use disorder.

Dissociable Contributions of Basolateral Amygdala and Ventrolateral Orbitofrontal Cortex to Flexible Learning Under Uncertainty

Reversal learning measures the ability to form flexible associations between choice outcomes with stimuli and actions that precede them. This type of learning is thought to rely on several cortical and subcortical areas, including the highly interconnected orbitofrontal cortex (OFC) and basolateral amygdala (BLA), and is often impaired in various neuropsychiatric and substance use disorders. However, the unique contributions of these regions to stimulus- and action-based reversal learning have not been systematically compared using a chemogenetic approach particularly before and after the first reversal that introduces new uncertainty. Here, we examined the roles of ventrolateral OFC (vlOFC) and BLA during reversal learning. Male and female rats were prepared with inhibitory designer receptors exclusively activated by designer drugs targeting projection neurons in these regions and tested on a series of deterministic and probabilistic reversals during which they learned about stimulus identity or side (left or right) associated with different reward probabilities. Using a counterbalanced within-subject design, we inhibited these regions prior to reversal sessions. We assessed initial and pre-/post-reversal changes in performance to measure learning and adjustments to reversals, respectively. We found that inhibition of the ventrolateral orbitofrontal cortex (vlOFC), but not BLA, eliminated adjustments to stimulus-based reversals. Inhibition of BLA, but not vlOFC, selectively impaired action-based probabilistic reversal learning, leaving deterministic reversal learning intact. vlOFC exhibited a sex-dependent role in early adjustment to action-based reversals, but not in overall learning. These results reveal dissociable roles for BLA and vlOFC in flexible learning and highlight a more crucial role for BLA in learning meaningful changes in the reward environment.

Postnatal Phencyclidine-Induced Deficits in Decision Making Are Ameliorated by Optogenetic Inhibition of Ventromedial Orbitofrontal Cortical Glutamate Neurons

Background

The orbitofrontal cortex (OFC) is essential for decision making, and functional disruptions within the OFC are evident in schizophrenia. Postnatal phencyclidine (PCP) administration in rats is a neurodevelopmental manipulation that induces schizophrenia-relevant cognitive impairments. We aimed to determine whether manipulating OFC glutamate cell activity could ameliorate postnatal PCP-induced deficits in decision making.

Methods

Male and female Wistar rats (n = 110) were administered saline or PCP on postnatal days 7, 9, and 11. In adulthood, we expressed YFP (yellow fluorescent protein) (control), ChR2 (channelrhodopsin-2) (activation), or eNpHR 3.0 (enhanced halorhodopsin) (inhibition) in glutamate neurons within the ventromedial OFC (vmOFC). Rats were tested on the probabilistic reversal learning task once daily for 20 days while we manipulated the activity of vmOFC glutamate cells. Behavioral performance was analyzed using a Q-learning computational model of reinforcement learning.

Results

Compared with saline-treated rats expressing YFP, PCP-treated rats expressing YFP completed fewer reversals, made fewer win-stay responses, and had lower learning rates. We induced similar performance impairments in saline-treated rats by activating vmOFC glutamate cells (ChR2). Strikingly, PCP-induced performance deficits were ameliorated when the activity of vmOFC glutamate cells was inhibited (halorhodopsin).

Conclusions

Postnatal PCP-induced deficits in decision making are associated with hyperactivity of vmOFC glutamate cells. Thus, normalizing vmOFC activity may represent a potential therapeutic target for decision-making deficits in patients with schizophrenia.

Dissociable contributions of basolateral amygdala and ventrolateral orbitofrontal cortex to flexible learning under uncertainty

Reversal learning measures the ability to form flexible associations between choice outcomes with stimuli and actions that precede them. This type of learning is thought to rely on several cortical and subcortical areas, including highly interconnected orbitofrontal cortex (OFC) and basolateral amygdala (BLA), and is often impaired in various neuropsychiatric and substance use disorders. However, unique contributions of these regions to stimulus- and action-based reversal learning have not been systematically compared using a chemogenetic approach and particularly before and after the first reversal that introduces new uncertainty. Here, we examined the roles of ventrolateral OFC (vlOFC) and BLA during reversal learning. Male and female rats were prepared with inhibitory DREADDs targeting projection neurons in these regions and tested on a series of deterministic and probabilistic reversals during which they learned about stimulus identity or side (left or right) associated with different reward probabilities. Using a counterbalanced within-subject design, we inhibited these regions prior to reversal sessions. We assessed initial and pre-post reversal changes in performance to measure learning and adjustments to reversals, respectively. We found that inhibition of vlOFC, but not BLA, eliminated adjustments to stimulus-based reversals. Inhibition of BLA, but not vlOFC, selectively impaired action-based probabilistic reversal learning, leaving deterministic reversal learning intact. vlOFC exhibited a sex-dependent role in early adjustment to action-based reversals, but not in overall learning. These results reveal dissociable roles for BLA and vlOFC in flexible learning and highlight a more crucial role for BLA in learning meaningful changes in the reward environment.

Activity in the Dorsomedial Striatum Underlies Serial Reversal Learning Performance Under Probabilistic Uncertainty

Background

Corticostriatal circuits, particularly the dorsomedial striatum (DMS) and lateral orbitofrontal cortex, are critical for navigating reversal learning under probabilistic uncertainty. These same areas are implicated in the reversal learning impairments observed in individuals with psychosis as well as their psychotic symptoms, suggesting that they may share a common neurobiological substrate. To address this question, we used psychostimulant exposure and specific activation of the DMS during reversal learning in mice to assess corticostriatal activity.

Methods

We used amphetamine treatment to induce psychosis-relevant neurobiology in male mice during reversal learning and to examine pathway-specific corticostriatal activation. To determine the causal role of DMS activity, we used chemogenetics to drive midbrain inputs during a range of probabilistic contingencies.

Results

Mice treated with amphetamine showed altered punishment learning, which was associated with decreased shifting after losses and increased perseverative errors after reversals. Reversal learning performance and strategies were dependent on increased activity in lateral orbitofrontal cortex to DMS circuits as well as in the DMS itself. Specific activation of midbrain to DMS circuits also decreased shifting after losses and reversal learning performance. However, these alterations were dependent on the probabilistic contingency.

Conclusions

Our work suggests that the DMS plays a multifaceted role in reversal learning. Increasing DMS activity impairs multiple reversal learning processes dependent on the level of uncertainty, confirming its role in the maintenance and selection of incoming cortical inputs. Together, these outcomes suggest that elevated dopamine levels in the DMS could contribute to decision-making impairments in individuals with psychosis.

Emotion, motivation, decision-making, the orbitofrontal cortex, anterior cingulate cortex, and the amygdala

The orbitofrontal cortex and amygdala are involved in emotion and in motivation, but the relationship between these functions performed by these brain structures is not clear. To address this, a unified theory of emotion and motivation is described in which motivational states are states in which instrumental goal-directed actions are performed to obtain rewards or avoid punishers, and emotional states are states that are elicited when the reward or punisher is or is not received. This greatly simplifies our understanding of emotion and motivation, for the same set of genes and associated brain systems can define the primary or unlearned rewards and punishers such as sweet taste or pain. Recent evidence on the connectivity of human brain systems involved in emotion and motivation indicates that the orbitofrontal cortex is involved in reward value and experienced emotion with outputs to cortical regions including those involved in language, and is a key brain region involved in depression and the associated changes in motivation. The amygdala has weak effective connectivity back to the cortex in humans, and is implicated in brainstem-mediated responses to stimuli such as freezing and autonomic activity, rather than in declarative emotion. The anterior cingulate cortex is involved in learning actions to obtain rewards, and with the orbitofrontal cortex and ventromedial prefrontal cortex in providing the goals for navigation and in reward-related effects on memory consolidation mediated partly via the cholinergic system.

Medial orbitofrontal cortical regulation of different aspects of Pavlovian and instrumental reward seeking

RATIONALE

The medial subregion of the orbitofrontal cortex (mOFC) is thought to play an important role representing the expected outcome of a given course of action, as lesioning or inactivating this cortical region results in the adoption of choice strategies based more on observable (rather than previously learned) information. Despite this, its role in mediating basic associative learning remains to be fully clarified.

OBJECTIVE

The present series of experiments examined the role of the mOFC in (1) Pavlovian conditioned approach, (2) conditioned reinforcement, (3) extinction, and (4) cue-induced reinstatement of food-seeking behavior.

METHODS

Separate cohorts of rats went through Pavlovian or instrumental training. Intra-mOFC infusions of either saline or GABA agonists (to temporarily inactivate neural activity) were given prior to Pavlovian approach, conditioned reinforcement, first or second day of instrumental extinction training, or cue-induced reinstatement test days.

RESULTS

mOFC inactivation increased lever-CS contacts in Pavlovian conditioned approach and (2) had no effect on conditioned reinforcement. These manipulations (3) accelerated within-session instrumental extinction during the initial extinction session, but impaired subsequent extinction learning on drug-free days. (4) mOFC inactivation induced differential effects on reinstatement that depended on baseline performance. mOFC inactivation abolished reinstatement in "Reinstater" rats (who displayed robust responding under control conditions) and robustly increased reinstatement in "Non-Reinstater" rats (who showed little reinstatement under control conditions) suggesting that individual differences in reinstatement may be supported by differences in mOFC mediated representations of expected outcomes.

CONCLUSIONS

These findings have important implications for understanding how the mOFC uses stimulus-outcome and action-outcome expectancies to guide behavior, and how dysfunction within this region may contribute to pathological patterns of reward seeking.

Projections from the five divisions of the orbital cortex to the thalamus in the rat

The orbital cortex (ORB) of the rat consists of five divisions: the medial (MO), ventral (VO), ventrolateral (VLO), lateral (LO), and dorsolateral (DLO) orbital cortices. No previous report has comprehensively examined and compared projections from each division of the ORB to the thalamus. Using the anterograde anatomical tracer, Phaseolus vulgaris leucoagglutinin, we describe the efferent projections from the five divisions of the ORB to the thalamus in the rat. We demonstrated that, with some overlap, each division of the ORB distributed in a distinct (and unique) manner to nuclei of the thalamus. Overall, ORB projected to a relatively restricted number of sites in the thalamus, and strikingly distributed entirely to structures of the medial/midline thalamus, while completely avoiding lateral regions or principal nuclei of the thalamus. The main termination sites in the thalamus were the paratenial nucleus (PT) and nucleus reuniens (RE) of the midline thalamus, the medial (MDm) and central (MDc) divisions of the mediodorsal nucleus, the intermediodorsal nucleus, the central lateral, paracentral, and central medial nuclei of the rostral intralaminar complex and the submedial nucleus (SM). With some exceptions, medial divisions of the ORB (MO, VO) mainly targeted "limbic-associated" nuclei such as PT, RE, and MDm, whereas lateral division (VLO, LO, DLO) primarily distributed to "sensorimotor-associated" nuclei including MDc, SM, and the rostral intralaminar complex. As discussed herein, the medial/midline thalamus may represent an important link (or bridge) between the orbital cortex and the hippocampus and between the ORB and medial prefrontal cortex. In summary, the present results demonstrate that each division of the orbital cortex projects in a distinct manner to nuclei of the thalamus which suggests unique functions for each division of the orbital cortex.

Compulsive drug-taking is associated with habenula-frontal cortex connectivity

As a critical node connecting the forebrain with the midbrain, the lateral habenula (LHb) processes negative feedback in response to aversive events and plays an essential role in value-based decision-making. Compulsive drug use, a hallmark of substance use disorder, is attributed to maladaptive decision-making regarding aversive drug-use-related events and has been associated with dysregulation of various frontal-midbrain circuits. To understand the contributions of frontal-habenula-midbrain circuits in the development of drug dependence, we employed a rat model of methamphetamine self-administration (SA) in the presence of concomitant footshock, which has been proposed to model compulsive drug-taking in humans. In this longitudinal study, functional MRI data were collected at pretraining baseline, after 20 d of long-access SA phase, and after 5 d of concomitant footshock coupled with SA (punishment phase). Individual differences in response to punishment were quantified by a "compulsivity index (CI)," defined as drug infusions at the end of punishment phase, normalized by those at the end of SA phase. Functional connectivity of LHb with the frontal cortices and substantia nigra (SN) after the punishment phase was positively correlated with the CI in rats that maintained drug SA despite receiving increasing-intensity footshock. In contrast, functional connectivity of the same circuits was negatively correlated with CI in rats that significantly reduced SA. These findings suggest that individual differences in compulsive drug-taking are reflected by alterations within frontal-LHb-SN circuits after experiencing the negative consequences from SA, suggesting these circuits may serve as unique biomarkers and potential therapeutic targets for individualized treatment of addiction.

Role of Orbitofrontal Cortex and Differential Effects of Acute and Chronic Stress on Motor Impulsivity Measured With 1-Choice Serial Reaction Time Test in Male Rats

BACKGROUND

Deficits in motor impulsivity, that is, the inability to inhibit a prepotent response, are frequently observed in psychiatric conditions. Several studies suggest that stress often correlates with higher impulsivity. Among the brain areas affected by stress, the orbitofrontal cortex (OFC) is notable because of its role in impulse control. OFC subregions with unique afferent and efferent circuitry play distinct roles in impulse control, yet it is not clear what OFC subregions are engaged during motor impulsivity tasks.

METHODS

In this study we used a rodent test of motor impulsivity, the 1-choice serial reaction time test, to explore activation of OFC subregions either during a well-learned motor impulsivity task or in a challenge task with a longer wait time that increases premature responding. We also examined the effects of acute inescapable stress, chronic intermittent cold stress and chronic unpredictable stress on motor impulsivity.

RESULTS

Fos expression increased in the lateral OFC and agranular insular cortex during performance in both the mastered and challenge conditions. In the ventral OFC, Fos expression increased only during challenge, and within the medial OFC, Fos was not induced in either condition. Inescapable stress produced a transient effect on premature responses in the mastered task, whereas chronic intermittent cold stress and chronic unpredictable stress altered premature responses in both conditions in ways specific to each stressor.

CONCLUSIONS

These results suggest that different OFC subregions have different roles in motor impulse control, and the effects of stress vary depending on the nature and duration of the stressor.

Cognitive performance during adulthood in a rat model of neonatal diffuse white matter injury

RATIONALE

Infants born prematurely risk developing diffuse white matter injury (WMI), which is associated with impaired cognitive functioning and an increased risk of autism spectrum disorder. Recently, our rat model of preterm diffuse WMI induced by combined fetal inflammation and postnatal hypoxia showed impaired motor performance, anxiety-like behaviour and autism-like behaviour in juvenile rats, especially males. Immunohistochemistry showed delayed myelination in the sensory cortex and impaired oligodendrocyte differentiation.

OBJECTIVE

To assess long-term cognitive deficits in this double-hit rat model of diffuse WMI, animals were screened on impulsivity, attention and cognitive flexibility in adulthood using the 5-choice serial reaction time task (5CSRTT) and a probabilistic reversal learning task, tests that require a proper functioning prefrontal cortex. Thereafter, myelination deficits were evaluated by immunofluorescent staining in adulthood.

RESULTS

Overall, little effect of WMI or sex was found in the cognitive tasks. WMI animals showed subtle differences in performance in the 5CSRTT. Manipulating 5CSRTT parameters resulted in performance patterns previously seen in the literature. Sex differences were found in perseverative responses and omitted trials: female WMI rats seem to be less flexible in the 5CSRTT but not in the reversal learning task. Males collected rewards faster in the probabilistic reversal learning task. These findings are explained by temporally rather than permanently affected myelination and by the absence of extensive injury to prefrontal cortical subregions, confirmed by immunofluorescent staining in both adolescence and adulthood.

CONCLUSION

This rat model of preterm WMI does not lead to long-term cognitive deficits as observed in prematurely born human infants.

Foraging with the frontal cortex: A cross-species evaluation of reward-guided behavior

Efficient foraging is essential to survival and depends on frontal cortex in mammals. Because of its role in psychiatric disorders, frontal cortex and its contributions to reward procurement have been studied extensively in both rodents and non-human primates. How frontal cortex of these animal models compares is a source of intense debate. Here we argue that translating findings from rodents to non-human primates requires an appreciation of both the niche in which each animal forages as well as the similarities in frontal cortex anatomy and function. Consequently, we highlight similarities and differences in behavior and anatomy, before focusing on points of convergence in how parts of frontal cortex contribute to distinct aspects of foraging in rats and macaques, more specifically. In doing so, our aim is to emphasize where translation of frontal cortex function between species is clearer, where there is divergence, and where future work should focus. We finish by highlighting aspects of foraging for which have received less attention but we believe are critical to uncovering how frontal cortex promotes survival in each species.

Effects of Maternal Deprivation on the Prefrontal Cortex of Male Rats: Cellular, Neurochemical, and Behavioral Outcomes

Stressful events experienced during early life are associated with increased vulnerability of developing psychopathology in adulthood. In the present study, we exposed 9-day-old Wistar rats to 24 h maternal deprivation (MD) with the aim to investigate the impact of early life stress (ELS) on morphological, biochemical, and functional aspects of the prefrontal cortex (PFC), a brain region particularly sensitive to stress. We found that in the superficial medial orbital cortex (MO), young adult male rats had reduced density of GAD67 and CCK immunopositive cells, while the rostral part of the ventral lateral orbital cortex (roVLO) showed a decrease in the density of GAD67 immunopositive cells in both superficial and deep layers. In addition, the superficial rostral part of area 1 of the cingulate cortex (roCg1) and deep prelimbic cortex (PrL) was also affected by MD indicated by the reduction in PV immunopositive cellular density. Furthermore, MD induced upregulation of brain-derived neurotrophic factor (BDNF), while it did not affect the overall expression of Iba1 in neonatal or young adult PFC as measured by Western blot, however, microglial activation in young adult MD rats was detected immunohistochemically in deep layers of MO and infralimbic cortex (IL). Interestingly, when young adult male rats were subjected to a behavioral flexibility test in a T-maze, MD rats showed a subtle impairment in T-maze reversal learning indicating a mildly affected PFC function. Taken together, our findings demonstrated that MD reduced the density of interneurons and induced microglial activation, in particular, PFC areas at young adulthood, and could alter synaptic plasticity accompanied by PFC dysfunction.

Adaptive aspects of impulsivity and interactions with effects of catecholaminergic agents in the 5-choice serial reaction time task: implications for ADHD

BACKGROUND

Work in humans has shown that impulsivity can be advantageous in certain settings. However, evidence for so-called functional impulsivity is lacking in experimental animals.

AIMS

This study investigated the contexts in which high impulsive (HI) rats show an advantage in performance compared with mid- (MI) and low impulsive (LI) rats. We also assessed the effects of dopaminergic and noradrenergic agents to investigate underlying neurotransmitter mechanisms.

METHODS

We tested rats on a variable inter-trial interval (ITI) version of the 5-choice serial reaction time task (5CSRTT). Rats received systemic injections of methylphenidate (MPH, 1 mg/kg and 3 mg/kg), atomoxetine (ATO, 0.3 mg/kg and 1 mg/kg), amphetamine (AMPH, 0.2 mg/kg), the alpha-2a adrenoceptor antagonist atipamezole (ATI, 0.3 mg/kg) and the alpha-1 adrenoceptor agonist phenylephrine (PHEN, 1 mg/kg) prior to behavioural testing.

RESULTS

Unlike LI rats, HI rats exhibited superior performance, earning more reinforcers, on short ITI trials, when the task required rapid responding. MPH, AMPH and ATI improved performance on short ITI trials and increased impulsivity in long ITI trials, recapitulating the behavioural profile of HI. In contrast, ATO and PHEN impaired performance on short ITI trials and decreased impulsivity, thus mimicking the behavioural profile of LI rats. The effects of ATO were greater on MI rats and LI rats.

CONCLUSIONS

These findings indicate that impulsivity can be advantageous when rapid focusing and actions are required, an effect that may depend on increased dopamine neurotransmission. Conversely, activation of the noradrenergic system, with ATO and PHEN, led to a general inhibition of responding.

Secondary rewards acquire enhanced incentive motivation via increasing anticipatory activity of the lateral orbitofrontal cortex

The motivation to strive for and consume primary rewards such as palatable food is bound by devaluation mechanisms, yet secondary rewards such as money may not be bound by these regulatory mechanisms. The present study therefore aimed at determining diverging devaluation trajectories for primary (chocolate milk) and secondary (money) reinforcers on the behavioral and neural level. Devaluation procedures with repeated exposure to reward combined with a choice (Experiment 1) and an incentive delay (Experiment 2) paradigm consistently revealed decreasing hedonic value for the primary reward as reflected by decreasing hedonic evaluation and choice preference with repeated receipt, while hedonic value and preferences for the secondary reward increased. Concomitantly acquired functional near-infrared spectroscopy (fNIRS) data during the incentive delay paradigm revealed that increasing value of the secondary reward was accompanied by increasing anticipatory activation in the lateral orbitofrontal cortex, while during the consummatory phase the secondary reinforcer associated with higher medial orbitofrontal activity irrespective of devaluation stage. Overall, the findings suggest that-in contrast to primary reinforcers-secondary reinforcers, i.e. money, can acquire progressively enhanced incentive motivation with repeated receipt, suggesting a mechanism which could promote escalating striving to obtain secondary rewards.

Hidden talents: Poly (I:C)-induced maternal immune activation improves mouse visual discrimination performance and reversal learning in a sex-dependent manner

While there is a strong focus on the negative consequences of maternal immune activation (MIA) on developing brains, very little attention is directed towards potential advantages of early life challenges. In this study, we utilized a polyinosine-polycytidylic acid (poly(I:C)) MIA model to test visual pairwise discrimination (PD) and reversal learning (RL) in mice using touchscreen technology. Significant sex differences emerged in that MIA reduced the latency for males to make a correct choice in the PD task while females reached criterion sooner, made fewer errors, and utilized fewer correction trials in RL compared to saline controls. These surprising improvements were accompanied by the sex-specific upregulation of several genes critical to cognitive functioning, indicative of compensatory plasticity in response to MIA. In contrast, when exposed to a 'two-hit' stress model (MIA + loss of the social component of environmental enrichment [EE]), mice did not display anhedonia but required an increased number of PD and RL correction trials. These animals also had significant reductions of CamK2a mRNA in the prefrontal cortex. Appropriate functioning of synaptic plasticity, via mediators such as this protein kinase and others, are critical for behavioral flexibility. Although EE has been implicated in, delaying the appearance of symptoms associated with certain brain disorders, these findings are in line with evidence that it also makes individuals more vulnerable to its loss. Overall, with the right 'dose', early life stress exposure can confer at least some functional advantages, which are lost when the number or magnitude of these exposures become too great.

Medial orbitofrontal cortex dopamine D1/D2 receptors differentially modulate distinct forms of probabilistic decision-making

Efficient decision-making involves weighing the costs and benefits associated with different actions and outcomes to maximize long-term utility. The medial orbitofrontal cortex (mOFC) has been implicated in guiding choice in situations involving reward uncertainty, as inactivation in rats alters choice involving probabilistic rewards. The mOFC receives considerable dopaminergic input, yet how dopamine (DA) modulates mOFC function has been virtually unexplored. Here, we assessed how mOFC D₁ and D₂ receptors modulate two forms of reward seeking mediated by this region, probabilistic reversal learning and probabilistic discounting. Separate groups of well-trained rats received intra-mOFC microinfusions of selective D₁ or D₂ antagonists or agonists prior to task performance. mOFC D₁ and D₂ blockade had opposing effects on performance during probabilistic reversal learning and probabilistic discounting. D₁ blockade impaired, while D₂ blockade increased the number of reversals completed, both mediated by changes in errors and negative feedback sensitivity apparent during the initial discrimination of the task, which suggests changes in probabilistic reinforcement learning rather than flexibility. Similarly, D₁ blockade reduced, while D₂ blockade increased preference for larger/risky rewards. Excess D₁ stimulation had no effect on either task, while excessive D₂ stimulation impaired probabilistic reversal performance, and reduced both profitable risky choice and overall task engagement. These findings highlight a previously uncharacterized role for mOFC DA, showing that D₁ and D₂ receptors play dissociable and opposing roles in different forms of reward-related action selection. Elucidating how DA biases behavior in these situations will expand our understanding of the mechanisms regulating optimal and aberrant decision-making.

Unlocking the reinforcement-learning circuits of the orbitofrontal cortex

Neuroimaging studies have consistently identified the orbitofrontal cortex (OFC) as being affected in individuals with neuropsychiatric disorders. OFC dysfunction has been proposed to be a key mechanism by which decision-making impairments emerge in diverse clinical populations, and recent studies employing computational approaches have revealed that distinct reinforcement-learning mechanisms of decision-making differ among diagnoses. In this perspective, we propose that these computational differences may be linked to select OFC circuits and present our recent work that has used a neurocomputational approach to understand the biobehavioral mechanisms of addiction pathology in rodent models. We describe how combining translationally analogous behavioral paradigms with reinforcement-learning algorithms and sophisticated neuroscience techniques in animals can provide critical insights into OFC pathology in biobehavioral disorders. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Defining an orbitofrontal compass: Functional and anatomical heterogeneity across anterior-posterior and medial-lateral axes

The orbitofrontal cortex (OFC) plays a critical role in the flexible control of behaviors and has been the focus of increasing research interest. However, there have been a number of controversies around the exact theoretical role of the OFC. One potential source of these issues is the comparison of evidence from different studies, particularly across species, which focus on different specific sub-regions within the OFC. Furthermore, there is emerging evidence that there may be functional diversity across the OFC which may account for these theoretical differences. Therefore, in this review we consider evidence supporting functional heterogeneity within the OFC and how it relates to underlying anatomical heterogeneity. We highlight the importance of anatomical and functional distinctions within the traditionally defined OFC subregions across the medial-lateral axis, which are often not differentiated for practical and historical reasons. We then consider emerging evidence of even finer-grained distinctions within these defined subregions along the anterior-posterior axis. These fine-grained anatomical considerations reveal a pattern of dissociable, but often complementary functions within the OFC. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

The orbitofrontal cortex in temporal cognition

One of the most important factors in decision-making is estimating the value of available options. Subregions of the prefrontal cortex, including the orbitofrontal cortex (OFC), have been deemed essential for this process. Value computations require a complex integration across numerous dimensions, including, reward magnitude, effort, internal state, and time. The importance of the temporal dimension is well illustrated by temporal discounting tasks, in which subjects select between smaller-sooner versus larger-later rewards. The specific role of OFC in telling time and integrating temporal information into decision-making remains unclear. Based on the current literature, in this review we reevaluate current theories of OFC function, accounting for the influence of time. Incorporating temporal information into value estimation and decision-making requires distinct, yet interrelated, forms of temporal information including the ability to tell time, represent time, create temporal expectations, and the ability to use this information for optimal decision-making in a wide range of tasks, including temporal discounting and wagering. We use the term "temporal cognition" to refer to the integrated use of these different aspects of temporal information. We suggest that the OFC may be a critical site for the integration of reward magnitude and delay, and thus important for temporal cognition. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Animal Models for OCD Research

OCD has lagged behind other psychiatric illnesses in the identification of molecular treatment targets, due in part to a lack of significant findings in genome-wide association studies. However, while progress in this area is being made, OCD's symptoms of obsessions, compulsions, and anxiety can be deconstructed into distinct neural functions that can be dissected in animal models. Studies in rodents and non-human primates have highlighted the importance of cortico-basal ganglia-thalamic circuits in OCD pathophysiology, and emerging studies in human post-mortem brain tissue point to glutamatergic synapse abnormalities as a potential cellular substrate for observed dysfunctional behaviors. In addition, accumulated evidence points to a potential role for neuromodulators including serotonin and dopamine in both OCD pathology and treatment. Here, we review current efforts to use animal models for the identification of molecules, cell types, and circuits relevant to OCD pathophysiology. We start by describing features of OCD that can be modeled in animals, including circuit abnormalities and genetic findings. We then review different strategies that have been used to study OCD using animal model systems, including transgenic models, circuit manipulations, and dissection of OCD-relevant neural constructs. Finally, we discuss how these findings may ultimately help to develop new treatment strategies for OCD and other related disorders.

Rapid Rule-Based Reward Reversal and the Lateral Orbitofrontal Cortex

Humans and other primates can reverse their choice of stimuli in one trial when the rewards delivered by the stimuli change or reverse. Rapidly changing our behavior when the rewards change is important for many types of behavior, including emotional and social behavior. It is shown in a one-trial rule-based Go-NoGo deterministic visual discrimination reversal task to obtain points, that the human right lateral orbitofrontal cortex and adjoining inferior frontal gyrus is activated on reversal trials, when an expected reward is not obtained, and the non-reward allows the human to switch choices based on a rule. This reward reversal goes beyond model-free reinforcement learning. This functionality of the right lateral orbitofrontal cortex shown here in very rapid, one-trial, rule-based changes in human behavior when a reward is not received is related to the emotional and social changes that follow orbitofrontal cortex damage, and to depression in which this non-reward system is oversensitive and over-connected.

The orbitofrontal cortex: reward, emotion and depression

The orbitofrontal cortex in primates including humans is the key brain area in emotion, and in the representation of reward value and in non-reward, that is not obtaining an expected reward. Cortical processing before the orbitofrontal cortex is about the identity of stimuli, i.e. 'what' is present, and not about reward value. There is evidence that this holds for taste, visual, somatosensory and olfactory stimuli. The human medial orbitofrontal cortex represents many different types of reward, and the lateral orbitofrontal cortex represents non-reward and punishment. Not obtaining an expected reward can lead to sadness, and feeling depressed. The concept is advanced that an important brain region in depression is the orbitofrontal cortex, with depression related to over-responsiveness and over-connectedness of the non-reward-related lateral orbitofrontal cortex, and to under-responsiveness and under-connectivity of the reward-related medial orbitofrontal cortex. Evidence from large-scale voxel-level studies and supported by an activation study is described that provides support for this hypothesis. Increased functional connectivity of the lateral orbitofrontal cortex with brain areas that include the precuneus, posterior cingulate cortex and angular gyrus is found in patients with depression and is reduced towards the levels in controls when treated with medication. Decreased functional connectivity of the medial orbitofrontal cortex with medial temporal lobe areas involved in memory is found in patients with depression. Some treatments for depression may act by reducing activity or connectivity of the lateral orbitofrontal cortex. New treatments that increase the activity or connectivity of the medial orbitofrontal cortex may be useful for depression. These concepts, and that of increased activity in non-reward attractor networks, have potential for advancing our understanding and treatment of depression. The focus is on the orbitofrontal cortex in primates including humans, because of differences of operation of the orbitofrontal cortex, and indeed of reward systems, in rodents. Finally, the hypothesis is developed that the orbitofrontal cortex has a special role in emotion and decision-making in part because as a cortical area it can implement attractor networks useful in maintaining reward and emotional states online, and in decision-making.

Differential effects of GABAA receptor activation in the prelimbic and orbitofrontal cortices on anxiety

RATIONALE

The development of effective anxiety treatments has been hindered by limited understanding of the neurobiological mechanisms involved in anxiety regulation. Whilst gamma-aminobutyric acid (GABA) neurotransmission in the prefrontal cortex (PFC) is one mechanism consistently implicated in anxiety regulation, PFC subregions may contribute uniquely.

OBJECTIVES

The present study examined the effects of inactivating the PFC subregions of the prelimbic cortex (PrL) or orbitofrontal cortex (OFC) through GABA_A receptor (GABA_AR) activation, on anxiety behaviours in male Wistar rats.

METHODS

Sixty-six male Wistar rats were surgically implanted with bilateral cannulae into the PrL (n = 33) or the OFC (n = 33). Rats then received a microinjection of either the GABA_A receptor agonist muscimol or vehicle prior to each experiment, conducted 1 week apart. Measures of anxiety were examined using the elevated plus maze (EPM) and the emergence test (ET). The effect on locomotor activity (baseline or methamphetamine-induced) was also tested.

RESULTS

Differential effects of brain region inactivation on anxiety-like behaviour were shown by measures in the EPM and ET; muscimol infused into the PrL-reduced anxiety-like behaviour, yet had no significant effect when infused into the OFC, compared with control treated rats. No effects on locomotor activity at baseline or following methamphetamine treatment were found.

CONCLUSIONS

This study highlights that activation of GABA_ARs specifically within the PrL, but not OFC, reduces anxiety behaviours in male rats. This suggests that activity of the PrL plays a more important role than the OFC in the neurobiological mechanisms of unconditioned anxiety and should be targeted for future therapies.

Serotonergic Innervations of the Orbitofrontal and Medial-prefrontal Cortices are Differentially Involved in Visual Discrimination and Reversal Learning in Rats

Cross-species studies have identified an evolutionarily conserved role for serotonin in flexible behavior including reversal learning. The aim of the current study was to investigate the contribution of serotonin within the orbitofrontal cortex (OFC) and medial prefrontal cortex (mPFC) to visual discrimination and reversal learning. Male Lister Hooded rats were trained to discriminate between a rewarded (A+) and a nonrewarded (B−) visual stimulus to receive sucrose rewards in touchscreen operant chambers. Serotonin was depleted using surgical infusions of 5,7-dihydroxytryptamine (5,7-DHT), either globally by intracebroventricular (i.c.v.) infusions or locally by microinfusions into the OFC or mPFC. Rats that received i.c.v. infusions of 5,7-DHT before initial training were significantly impaired during both visual discrimination and subsequent reversal learning during which the stimulus–reward contingencies were changed (A− vs. B+). Local serotonin depletion from the OFC impaired reversal learning without affecting initial discrimination. After mPFC depletion, rats were unimpaired during reversal learning but slower to respond at the stimuli during all the stages; the mPFC group was also slower to learn during discrimination than the OFC group. These findings extend our understanding of serotonin in cognitive flexibility by revealing differential effects within two subregions of the prefrontal cortex in visual discrimination and reversal learning.

Glutamatergic and Serotonergic Modulation of Rat Medial and Lateral Orbitofrontal Cortex in Visual Serial Reversal Learning

Adapting behavior to a dynamic environment requires both steadiness when the environment is stable and behavioral flexibility in response to changes. Much evidence suggests that cognitive flexibility, which can be operationalized in reversal learning tasks, is mediated by cortico-striatal circuitries, with the orbitofrontal cortex (OFC) playing a prominent role. The OFC is a functionally heterogeneous region, and we have previously reported differential roles of lateral (lOFC) and medial (mOFC) regions in a touchscreen serial visual reversal learning task for rats using pharmacological inactivation. Here, we investigated the effects of pharmacological overactivation of these regions using a glutamate transporter 1 (GLT-1) inhibitor, dihydrokainate (DHK), which increases extracellular glutamate by blocking its reuptake. We also tested the impact of antagonism of the serotonin 2A receptor (5-HT_2AR), which modulates glutamate action, in the mOFC and lOFC on the same task. Overactivation induced by DHK produced dissociable effects in the mOFC and lOFC, with more prominent effects in the mOFC, specifically improving performance in the early, perseveration phase. Intra-lOFC DHK increased the number of omitted responses without affecting errors. In contrast, blocking the 5-HT_2AR in the lOFC impaired reversal learning overall, while mOFC 5-HT_2AR blockade had no effect. These results further support dissociable roles of the rodent mOFC and lOFC in deterministic visual reversal learning and indicate that modulating glutamate transmission through blocking the GLT-1 and the 5-HT_2AR have different roles in these two structures.

This study further supports dissociable roles of specific orbitofrontal subregions, as well as glutamatergic and serotonergic transmission in these subregions, in cognitive flexibility. This knowledge will add to the understanding of specific neural mechanisms underlying inflexible behaviour across psychiatric disorders.

The basolateral amygdala-medial prefrontal cortex circuitry regulates behavioral flexibility during appetitive reversal learning

Environmental cues can become predictors of food availability through Pavlovian conditioning. Two forebrain regions important in this associative learning are the basolateral amygdala (BLA) and medial prefrontal cortex (mPFC). Recent work showed the BLA-mPFC pathway is activated when a cue reliably signals food, suggesting the BLA informs the mPFC of the cue's value. The current study tested this hypothesis by altering the value of 2 food cues using reversal learning and illness-induced devaluation paradigms. Rats that received unilateral excitotoxic lesions of the BLA and mPFC contralaterally placed, along with ipsilateral and sham controls, underwent discriminative conditioning, followed by reversal learning and then devaluation. All groups successfully discriminated between 2 auditory stimuli that were followed by food delivery (conditional stimulus [CS] +) or not rewarded (CS-), demonstrating this learning does not require BLA-mPFC communication. When the outcomes of the stimuli were reversed, the rats with disconnected BLA-mPFC (contralateral condition) showed increased responding to the CSs, especially to the rCS + (original CS-) during the first session, suggesting impaired cue memory recall and behavioral inhibition compared to the other groups. For devaluation, all groups successfully learned conditioned taste aversion; however, there was no evidence of cue devaluation or differences between groups. Interestingly, at the end of testing, the nondevalued contralateral group was still responding more to the original CS + (rCS-) compared to the devalued contralateral group. These results suggest a potential role for BLA-mPFC communication in guiding appropriate responding during periods of behavioral flexibility when the outcomes, and thus the values, of learned cues are altered. (PsycINFO Database Record (c) 2020 APA, all rights reserved).

Modulation of value-based decision making behavior by subregions of the rat prefrontal cortex

RATIONALE

During value-based decision-making, organisms make choices on the basis of reward expectations, which have been formed during prior action-outcome learning. Although it is known that neuronal manipulations of different subregions of the rat prefrontal cortex (PFC) have qualitatively different effects on behavioral tasks involving value-based decision-making, it is unclear how these regions contribute to the underlying component processes.

OBJECTIVES

Assessing how different regions of the rodent PFC contribute to component processes of value-based decision-making behavior, including reward (or positive feedback) learning, punishment (or negative feedback) learning, response persistence, and exploration versus exploitation.

METHODS

We performed behavioral modeling of data of rats in a probabilistic reversal learning task after pharmacological inactivation of five PFC subregions, to assess how inactivation of these different regions affected the structure of responding of animals in the task.

RESULTS

Our results show reductions in reward and punishment learning after PFC subregion inactivation. The prelimbic, infralimbic, lateral orbital, and medial orbital PFC particularly contributed to punishment learning, and the prelimbic and lateral orbital PFC to reward learning. In addition, response persistence depended on the infralimbic and medial orbital PFC. As a result, pharmacological inactivation of the infralimbic and lateral orbitofrontal cortex reduced the number of reversals achieved, whereas inactivation of the prelimbic and medial orbitofrontal cortex decreased the number of rewards obtained. Finally, using simulated data, we explain discrepancies with a previous study and demonstrate complex, interacting relationships between conventional measures of probabilistic reversal learning performance, such as win-stay/lose-switch behavior, and component processes of value-based decision-making.

CONCLUSIONS

Together, our data suggest that distinct components of value-based learning and decision-making are generated in medial and orbital PFC regions, displaying functional specialization and overlap, with a prominent role of large parts of the PFC in negative feedback processing.

Lateral orbitofrontal cortex promotes trial-by-trial learning of risky, but not spatial, biases

Individual choices are not made in isolation but are embedded in a series of past experiences, decisions, and outcomes. The effects of past experiences on choices, often called sequential biases, are ubiquitous in perceptual and value-based decision-making, but their neural substrates are unclear. We trained rats to choose between cued guaranteed and probabilistic rewards in a task in which outcomes on each trial were independent. Behavioral variability often reflected sequential effects, including increased willingness to take risks following risky wins, and spatial 'win-stay/lose-shift' biases. Recordings from lateral orbitofrontal cortex (lOFC) revealed encoding of reward history and receipt, and optogenetic inhibition of lOFC eliminated rats' increased preference for risk following risky wins, but spared other sequential effects. Our data show that different sequential biases are neurally dissociable, and the lOFC's role in adaptive behavior promotes learning of more abstract biases (here, biases for the risky option), but not spatial ones.