Lateral orbitofrontal neurons acquire responses to upshifted, downshifted, or blocked cues during unblocking

Neural correlates of model-based behavior in internet gaming disorder and alcohol use disorder

Background

An imbalance between model-based and model-free decision-making systems is a common feature in addictive disorders. However, little is known about whether similar decision-making deficits appear in internet gaming disorder (IGD). This study compared neurocognitive features associated with model-based and model-free systems in IGD and alcohol use disorder (AUD).

Method

Participants diagnosed with IGD (n = 22) and AUD (n = 22), and healthy controls (n = 30) performed the two-stage task inside the functional magnetic resonance imaging (fMRI) scanner. We used computational modeling and hierarchical Bayesian analysis to provide a mechanistic account of their choice behavior. Then, we performed a model-based fMRI analysis and functional connectivity analysis to identify neural correlates of the decision-making processes in each group.

Results

The computational modeling results showed similar levels of model-based behavior in the IGD and AUD groups. However, we observed distinct neural correlates of the model-based reward prediction error (RPE) between the two groups. The IGD group exhibited insula-specific activation associated with model-based RPE, while the AUD group showed prefrontal activation, particularly in the orbitofrontal cortex and superior frontal gyrus. Furthermore, individuals with IGD demonstrated hyper-connectivity between the insula and brain regions in the salience network in the context of model-based RPE.

Discussion and Conclusions

The findings suggest potential differences in the neurobiological mechanisms underlying model-based behavior in IGD and AUD, albeit shared cognitive features observed in computational modeling analysis. As the first neuroimaging study to compare IGD and AUD in terms of the model-based system, this study provides novel insights into distinct decision-making processes in IGD.

Disentangling the neurobiological bases of temporal impulsivity in Huntington's disease

BACKGROUND

Despite its impact on daily life, impulsivity in Huntington's disease (HD) is understudied as a neuropsychiatric symptom. Our aim is to characterize temporal impulsivity in HD and to disentangle the white matter correlate associated with impulsivity.

METHODS

Forty-seven HD individuals and 36 healthy controls were scanned and evaluated for temporal impulsivity using a delay-discounting (DD) task and complementary Sensitivity to Punishment and Sensitivity to Reward Questionnaire. Diffusion tensor imaging was employed to characterize the structural connectivity of three limbic tracts: the uncinate fasciculus (UF), the accumbofrontal tract (NAcc-OFC), and the dorsolateral prefrontal cortex connectig the caudate nucleus (DLPFC-cn). Multiple linear regression analyses were applied to analyze the relationship between impulsive behavior and white matter microstructural integrity.

RESULTS

Our results revealed altered structural connectivity in the DLPC-cn, the NAcc-OFC and the UF in HD individuals. At the same time, the variability in structural connectivity of these tracts was associated with the individual differences in temporal impulsivity. Specifically, increased structural connectivity in the right NAcc-OFC and reduced connectivity in the left UF were associated with higher temporal impulsivity scores.

CONCLUSIONS

The present findings highlight the importance of investigating the spectrum of temporal impulsivity in HD. As, while less prevalent than other psychiatric features, this symptom is still reported to significantly impact the quality of life of patients and caregivers. This study provides evidence that individual differences observed in temporal impulsivity may be explained by variability in limbic frontostriatal tracts, while shedding light on the role of sensitivity to reward in modulating impulsive behavior through the selection of immediate rewards.

Increased ventral anterior insular connectivity to sports betting availability indexes problem gambling

With the advent of digital technologies, online sports betting is spurring a fast-growing expansion. In this study, we examined how sports betting availability modulates the brain connectivity of frequent sports bettors with [problem bettors (PB)] or without [non-problem bettors (NPB)] problematic sports betting. We conducted functional connectivity analyses centred on the ventral anterior insular cortex (vAI), a brain region playing a key role in the dynamic interplay between reward-based processes. We re-analysed a dataset on sports betting availability undertaken in PB (n = 30) and NPB (n = 35). Across all participants, we observed that sports betting availability elicited positive vAI coupling with extended clusters of brain activation (encompassing the putamen, cerebellum, occipital, temporal, precentral and central operculum regions) and negative vAI coupling with the orbitofrontal cortex. Between-group analyses showed increased positive vAI coupling in the PB group, as compared with the NPB group, in the left lateral occipital cortex, extending to the left inferior frontal gyrus, the anterior cingulate gyrus and the right frontal pole. Taken together, these results are in line with the central assumptions of triadic models of addictions, which posit that the insular cortex plays a pivotal role in promoting the drive and motivation to get a reward by 'hijacking' goal-oriented processes toward addiction-related cues. Taken together, these findings showed that vAI functional connectivity is sensitive not only to gambling availability but also to the status of problematic sport betting.

Stimulation of the dorsolateral prefrontal cortex modulates brain cue reactivity to reward (un)availability

Brain imaging studies have shown that stimulation of the left dorsolateral prefrontal cortex (dlPFC), which plays a pivotal role in high-order cognitive control processes, modulates brain reactivity to reward-related cues. Nevertheless, the impact of contextual factors such as reward availability (the reward that is depicted in the cue exposure task) on such modulation effect remains unclear. Here we tested whether a single session of high-frequency repetitive transcranial magnetic stimulation (HF-rTMS) over the left dlPFC differently impacts brain reactivity to cues signalling either availability or unavailability of a sports betting opportunity. Employing a within-subject design (verum versus sham HF-rTMS) among thirty-two frequent sports bettors, we first observed that, as compared to the sham condition, verum HF-rTMS modulated brain reactivity to game cues prior to being made (un)available for betting, through simultaneous increases (posterior insula and caudate nucleus) and decreases (occipital pole) in brain activation. Second, verum HF-rTMS led to increased ventral striatal activity towards cues available for betting but did not modulate brain response to cues unavailable for betting. Taken together, these findings demonstrate that transient stimulation of the left dlPFC led to a general modulation in brain activity in responses to cues, and that this effect is only partly dependent on cues signalling for reward (un)availability.

Basolateral amygdala and orbitofrontal cortex, but not dorsal hippocampus, are necessary for the control of reward-seeking by occasion setters

Reward-seeking in the world is driven by cues that can have ambiguous predictive and motivational value. To produce adaptive, flexible reward-seeking, it is necessary to exploit occasion setters, other distinct features in the environment, to resolve the ambiguity of Pavlovian reward-paired cues. Despite this, very little research has investigated the neurobiological underpinnings of occasion setting, and as a result little is known about which brain regions are critical for occasion setting. To address this, we exploited a recently developed task that was amenable to neurobiological inquiry where a conditioned stimulus is only predictive of reward delivery if preceded in time by the non-overlapping presentation of a separate cue-an occasion setter. This task required male rats to maintain and link cue-triggered expectations across time to produce adaptive reward-seeking. We interrogated the contributions of the basolateral amygdala and orbitofrontal cortex to occasion setting as these regions are thought to be critical for the computation and exploitation of state value, respectively. Reversible inactivation of either structure prior to the occasion-setting task resulted in a profound inability of rats to use the occasion setter to guide reward-seeking. In contrast, inactivation of the dorsal hippocampus, a region fundamental for context-specific responding was without effect nor did inactivation of the basolateral amygdala or orbitofrontal cortex in a standard Pavlovian conditioning preparation affect conditioned responding. We conclude that neural activity within the orbitofrontal cortex and basolateral amygdala circuit is necessary to update and resolve ambiguity in the environment to promote cue-driven reward-seeking.

Amygdala-cortical collaboration in reward learning and decision making

Adaptive reward-related decision making requires accurate prospective consideration of the specific outcome of each option and its current desirability. These mental simulations are informed by stored memories of the associative relationships that exist within an environment. In this review, I discuss recent investigations of the function of circuitry between the basolateral amygdala (BLA) and lateral (lOFC) and medial (mOFC) orbitofrontal cortex in the learning and use of associative reward memories. I draw conclusions from data collected using sophisticated behavioral approaches to diagnose the content of appetitive memory in combination with modern circuit dissection tools. I propose that, via their direct bidirectional connections, the BLA and OFC collaborate to help us encode detailed, outcome-specific, state-dependent reward memories and to use those memories to enable the predictions and inferences that support adaptive decision making. Whereas lOFC→BLA projections mediate the encoding of outcome-specific reward memories, mOFC→BLA projections regulate the ability to use these memories to inform reward pursuit decisions. BLA projections to lOFC and mOFC both contribute to using reward memories to guide decision making. The BLA→lOFC pathway mediates the ability to represent the identity of a specific predicted reward and the BLA→mOFC pathway facilitates understanding of the value of predicted events. Thus, I outline a neuronal circuit architecture for reward learning and decision making and provide new testable hypotheses as well as implications for both adaptive and maladaptive decision making.

Medial and orbital frontal cortex in decision-making and flexible behavior

The medial frontal cortex and adjacent orbitofrontal cortex have been the focus of investigations of decision-making, behavioral flexibility, and social behavior. We review studies conducted in humans, macaques, and rodents and argue that several regions with different functional roles can be identified in the dorsal anterior cingulate cortex, perigenual anterior cingulate cortex, anterior medial frontal cortex, ventromedial prefrontal cortex, and medial and lateral parts of the orbitofrontal cortex. There is increasing evidence that the manner in which these areas represent the value of the environment and specific choices is different from subcortical brain regions and more complex than previously thought. Although activity in some regions reflects distributions of reward and opportunities across the environment, in other cases, activity reflects the structural relationships between features of the environment that animals can use to infer what decision to take even if they have not encountered identical opportunities in the past.

Increased brain reactivity to gambling unavailability as a marker of problem gambling

The unprecedented development and ubiquity of sports betting constitute an emerging public health concern. It is crucial to provide markers that could help to better identify people experiencing sports betting-related harms. The current study investigated whether problem gambling status, sports betting passion, and trait-self-control modulate brain reactivity to sports betting cues. Sixty-five frequent sports bettors (35 "nonproblem bettors" and 30 "problem bettors") were exposed to cues representing real upcoming sport events (with varying levels of winning confidence) that were made available or blocked for betting, during functional magnetic resonance imaging (fMRI) recording. Sports betting passion and trait-self-control were assessed using self-report scales. Sport events nonavailable for betting elicited higher insular and striatal activation in problem bettors, as compared with nonproblem bettors. Within a large cluster encompassing the ventral striatum, hippocampus, and amygdala, lower trait-self-control was associated with increased brain reactivity to sport events with high levels of winning confidence that were nonavailable for betting. No significant effect of sports betting passion was observed. These findings suggest that sports bettors' brain reactivity to gambling unavailability might be a relevant marker of sports betting-related harms, as well as of blunted trait-self-control.

A bidirectional corticoamygdala circuit for the encoding and retrieval of detailed reward memories

Adaptive reward-related decision making often requires accurate and detailed representation of potential available rewards. Environmental reward-predictive stimuli can facilitate these representations, allowing one to infer which specific rewards might be available and choose accordingly. This process relies on encoded relationships between the cues and the sensory-specific details of the rewards they predict. Here, we interrogated the function of the basolateral amygdala (BLA) and its interaction with the lateral orbitofrontal cortex (lOFC) in the ability to learn such stimulus-outcome associations and use these memories to guide decision making. Using optical recording and inhibition approaches, Pavlovian cue-reward conditioning, and the outcome-selective Pavlovian-to-instrumental transfer (PIT) test in male rats, we found that the BLA is robustly activated at the time of stimulus-outcome learning and that this activity is necessary for sensory-specific stimulus-outcome memories to be encoded, so they can subsequently influence reward choices. Direct input from the lOFC was found to support the BLA in this function. Based on prior work, activity in BLA projections back to the lOFC was known to support the use of stimulus-outcome memories to influence decision making. By multiplexing optogenetic and chemogenetic inhibition we performed a serial circuit disconnection and found that the lOFC→BLA and BLA→lOFC pathways form a functional circuit regulating the encoding (lOFC→BLA) and subsequent use (BLA→lOFC) of the stimulus-dependent, sensory-specific reward memories that are critical for adaptive, appetitive decision making.

The Role of the Rodent Lateral Orbitofrontal Cortex in Simple Pavlovian Cue-Outcome Learning Depends on Training Experience

The orbitofrontal cortex (OFC) is a critical structure in the flexible control of value-based behaviors. OFC dysfunction is typically only detected when task or environmental contingencies change, against a backdrop of apparently intact initial acquisition and behavior. While intact acquisition following OFC lesions in simple Pavlovian cue-outcome conditioning is often predicted by models of OFC function, this predicted null effect has not been thoroughly investigated. Here, we test the effects of lesions and temporary muscimol inactivation of the rodent lateral OFC on the acquisition of a simple single cue-outcome relationship. Surprisingly, pretraining lesions significantly enhanced acquisition after overtraining, whereas post-training lesions and inactivation significantly impaired acquisition. This impaired acquisition to the cue reflects a disruption of behavioral control and not learning since the cue could also act as an effective blocking stimulus in an associative blocking procedure. These findings suggest that even simple cue-outcome representations acquired in the absence of OFC function are impoverished. Therefore, while OFC function is often associated with flexible behavioral control in complex environments, it is also involved in very simple Pavlovian acquisition where complex cue-outcome relationships are irrelevant to task performance.

Multiple systems in macaques for tracking prediction errors and other types of surprise

Animals learn from the past to make predictions. These predictions are adjusted after prediction errors, i.e., after surprising events. Generally, most reward prediction errors models learn the average expected amount of reward. However, here we demonstrate the existence of distinct mechanisms for detecting other types of surprising events. Six macaques learned to respond to visual stimuli to receive varying amounts of juice rewards. Most trials ended with the delivery of either 1 or 3 juice drops so that animals learned to expect 2 juice drops on average even though instances of precisely 2 drops were rare. To encourage learning, we also included sessions during which the ratio between 1 and 3 drops changed. Additionally, in all sessions, the stimulus sometimes appeared in an unexpected location. Thus, 3 types of surprising events could occur: reward amount surprise (i.e., a scalar reward prediction error), rare reward surprise, and visuospatial surprise. Importantly, we can dissociate scalar reward prediction errors—rewards that deviated from the average reward amount expected—and rare reward events—rewards that accorded with the average reward expectation but that rarely occurred. We linked each type of surprise to a distinct pattern of neural activity using functional magnetic resonance imaging. Activity in the vicinity of the dopaminergic midbrain only reflected surprise about the amount of reward. Lateral prefrontal cortex had a more general role in detecting surprising events. Posterior lateral orbitofrontal cortex specifically detected rare reward events regardless of whether they followed average reward amount expectations, but only in learnable reward environments.

Animals learn from the past to make predictions, and predictions are adjusted whenever surprising outcomes violate those predictions. This study shows that macaques use multiple systems to detect different types of rare reward events; while activity in the vicinity of the dopaminergic midbrain reflected scalar reward prediction errors (i.e. reward amount), activity in the orbitofrontal cortex reflected a rare reward signal.

Vicarious reward unblocks associative learning about novel cues in male rats

Many species, including rats, are sensitive to social signals and their valuation is important in social learning. Here we introduce a task that investigates if mutual reward delivery in male rats can drive associative learning. We found that when actor rats have fully learned a stimulus-self-reward association, adding a cue that predicted additional reward to a partner unblocked associative learning about this cue. By contrast, additional cues that did not predict partner reward remained blocked from acquiring positive associative value. Importantly, this social unblocking effect was still present when controlling for secondary reinforcement but absent when social information exchange was impeded, when mutual reward outcomes were disadvantageously unequal to the actor or when the added cue predicted reward delivery to an empty chamber. Taken together, these results suggest that mutual rewards can drive associative learning in rats and is dependent on vicariously experienced social and food-related cues.

Chemogenetic Inactivation of Orbitofrontal Cortex Decreases Cue-induced Reinstatement of Ethanol and Sucrose Seeking in Male and Female Wistar Rats

BACKGROUND

The orbitofrontal cortex (OFC) encodes internal representations of outcomes and subjective value to facilitate flexible reward seeking. OFC activation is associated with drug seeking in both human subjects and animal models. OFC plays a role in alcohol use, but studies in animal models have produced conflicting results with some showing decreased seeking after OFC inactivation but others showing increased seeking or no changes. In part, this may be due to the different measures of alcohol seeking used (e.g., homecage drinking vs. operant seeking).

METHODS

We characterized the impact of transient inactivation of OFC (primarily lateral and, to a lesser extent, ventral subregions) using inhibitory hM4Di designer receptors exclusively activated by designer drugs (DREADDs). OFC neurons were transiently inhibited during 10% and 20% alcohol (ethanol, EtOH) and sucrose homecage consumption, fixed ratio (FR1) operant self-administration, and cue-induced reinstatement of either 10% EtOH or sucrose in male and female rats.

RESULTS

OFC inactivation did not affect sucrose or EtOH consumption in the homecage, nor did it influence seeking or consumption under FR1 operant conditions. In contrast, OFC inactivation suppressed cued-induced reinstatement for both EtOH and sucrose in both male and female rats.

CONCLUSIONS

Our results are aligned with previous work indicating a selective suppressive effect of OFC inactivation on reinstatement for alcohol and other drugs of abuse. They extend these findings to demonstrate no effect on homecage consumption or FR1 seeking as well as showing an impact of sucrose reinstatement. These data indicate that OFC plays a uniquely important role when reward seeking is driven by associations between external stimuli and internal representations of reward value, both for natural and drug rewards. They further implicate the OFC as a key structure driving relapse-associated seeking and potentially contributing to alcohol use disorder and other diseases of compulsive reward seeking.

Selective impact of lateral orbitofrontal cortex inactivation on reinstatement of alcohol seeking in male Long-Evans rats

The orbitofrontal cortex (OFC) plays a fundamental role in motivated behavior and decision-making. In humans, OFC structure and function is significantly disrupted in drug using and dependent individuals, including those exhibiting chronic alcohol use and alcoholism. In animal models, the OFC has been shown to significantly influence the seeking of non-alcohol drugs of abuse. However direct investigations of the OFC during alcohol seeking and use have been more limited. In the studies reported here, we inactivated lateral (lOFC) or medial OFC (mOFC) subregions in rats during multiple stages of alcohol seeking. After one month of intermittent access to homecage 20% ethanol (EtOH), rats were trained to self-administer EtOH under an FR3 schedule and implanted with cannulae directed to lOFC or mOFC. We inactivated OFC subregions with baclofen/muscimol during EtOH self-administration, extinction, cue-induced reinstatement, and progressive ratio testing to broadly characterize the influence of these subregions on alcohol seeking. There were no significant effects of mOFC or lOFC inactivation during FR3 self-administration, extinction, or progressive ratio self-administration. However, lOFC, and not mOFC, inactivation significantly decreased cue-induced reinstatement of EtOH seeking. These findings contribute new information to the specific impact of OFC manipulation on operant alcohol seeking, support previous studies investigating the role of OFC in seeking and consumption of alcohol and other drugs of abuse, and indicate a specific role for lOFC vs. mOFC in reinstatement.

The role of the orbitofrontal cortex in alcohol use, abuse, and dependence

One of the major functions of the orbitofrontal cortex (OFC) is to promote flexible motivated behavior. It is no surprise, therefore, that recent work has demonstrated a prominent impact of chronic drug use on the OFC and a potential role for OFC disruption in drug abuse and addiction. Among drugs of abuse, the use of alcohol is particularly salient with respect to OFC function. Although a number of studies in humans have implicated OFC dysregulation in alcohol use disorders, animal models investigating the association between OFC and alcohol use are only beginning to be developed, and there is still a great deal to be revealed. The goal of this review is to consider what is currently known regarding the role of the OFC in alcohol use and dependence. I will first provide a brief, general overview of current views of OFC function and its contributions to drug seeking and addiction. I will then discuss research to date related to the OFC and alcohol use, both in human clinical populations and in non-human models. Finally I will consider issues and strategies to guide future study that may identify this brain region as a key player in the transition from moderated to problematic alcohol use and dependence.

Computing Value from Quality and Quantity in Human Decision-Making

How organisms learn the value of single stimuli through experience is well described. In many decisions, however, value estimates are computed “on the fly” by combining multiple stimulus attributes. The neural basis of this computation is poorly understood. Here we explore a common scenario in which decision-makers must combine information about quality and quantity to determine the best option. Using fMRI, we examined the neural representation of quality, quantity, and their integration into an integrated subjective value signal in humans of both genders. We found that activity within inferior frontal gyrus (IFG) correlated with offer quality, while activity in the intraparietal sulcus (IPS) specifically correlated with offer quantity. Several brain regions, including the anterior cingulate cortex (ACC), were sensitive to an interaction of quality and quantity. However, the ACC was uniquely activated by quality, quantity, and their interaction, suggesting that this region provides a substrate for flexible computation of value from both quality and quantity. Furthermore, ACC signals across subjects correlated with the strength of quality and quantity signals in IFG and IPS, respectively. ACC tracking of subjective value also correlated with choice predictability. Finally, activity in the ACC was elevated for choice trials, suggesting that ACC provides a nexus for the computation of subjective value in multiattribute decision-making.

SIGNIFICANCE STATEMENT Would you prefer three apples or two oranges? Many choices we make each day require us to weigh up the quality and quantity of different outcomes. Using fMRI, we show that option quality is selectively represented in the inferior frontal gyrus, while option quantity correlates with areas of the intraparietal sulcus that have previously been associated with numerical processing. We show that information about the two is integrated into a value signal in the anterior cingulate cortex, and the fidelity of this integration predicts choice predictability. Our results demonstrate how on-the-fly value estimates are computed from multiple attributes in human value-based decision-making.

Age of gray matters: Neuroprediction of recidivism

Age is one of the best predictors of antisocial behavior. Risk models of recidivism often combine chronological age with demographic, social and psychological features to aid in judicial decision-making. Here we use independent component analyses (ICA) and machine learning techniques to demonstrate the utility of using brain-based measures of cerebral aging to predict recidivism. First, we developed a brain-age model that predicts chronological age based on structural MRI data from incarcerated males (n = 1332). We then test the model's ability to predict recidivism in a new sample of offenders with longitudinal outcome data (n = 93). Consistent with hypotheses, inclusion of brain-age measures of the inferior frontal cortex and anterior-medial temporal lobes (i.e., amygdala) improved prediction models when compared with models using chronological age; and models that combined psychological, behavioral, and neuroimaging measures provided the most robust prediction of recidivism. These results verify the utility of brain measures in predicting future behavior, and suggest that brain-based data may more precisely account for important variation when compared with traditional proxy measures such as chronological age. This work also identifies new brain systems that contribute to recidivism which has clinical implications for treatment development.

•

A brain-age model is developed on a large sample of MRI data collected from incarcerated males (n = 1332).

•

The model is tested in a new sample to predict recidivism using brain vs. chronological age.

•

Brain-age measures outperformed chronological age in prediction of recidivism.

Spike-Timing of Orbitofrontal Neurons Is Synchronized With Breathing

The orbitofrontal cortex (OFC) has been implicated in a multiplicity of complex brain functions, including representations of expected outcome properties, post-decision confidence, momentary food-reward values, complex flavors and odors. As breathing rhythm has an influence on odor processing at primary olfactory areas, we tested the hypothesis that it may also influence neuronal activity in the OFC, a prefrontal area involved also in higher order processing of odors. We recorded spike timing of orbitofrontal neurons as well as local field potentials (LFPs) in awake, head-fixed mice, together with the breathing rhythm. We observed that a large majority of orbitofrontal neurons showed robust phase-coupling to breathing during immobility and running. The phase coupling of action potentials to breathing was significantly stronger in orbitofrontal neurons compared to cells in the medial prefrontal cortex. The characteristic synchronization of orbitofrontal neurons with breathing might provide a temporal framework for multi-variable processing of olfactory, gustatory and reward-value relationships.

Ensembles in medial and lateral orbitofrontal cortex construct cognitive maps emphasizing different features of the behavioral landscape

The orbitofrontal cortex (OFC) has long been implicated in the ability to use the current value of expected outcomes to guide behavior. More recently, this specific role has been conceptualized as a special case of a more general function that OFC plays in constructing a "cognitive map" of the behavioral task space by labeling the current task state and learning relationships among task states. Here, we have used single unit recording data from 2 prior studies to examine whether and how information relating different states within and across trials is represented in medial versus lateral OFC in rats. Using a hierarchical clustering analysis, we examined how neurons from each area represented information about differently valued trial types, defined by the cue-outcome pairings, versus how those same neurons represented information about similar epochs between these different trial types, such as the stimulus sample, delay, and reward consumption epochs. This analysis revealed that ensembles in the lateral OFC (lOFC) group states according to trial epoch, whereas those in the medial OFC (mOFC) organize the same states by trial type. These results suggest that the lOFC and mOFC construct cognitive maps that emphasize different features of the behavioral landscape, with lOFC tracking events based on local similarities, irrespective of their values and mOFC tracking more distal or higher order relationships relevant to value. (PsycINFO Database Record

Inverted activity patterns in ventromedial prefrontal cortex during value-guided decision-making in a less-is-more task

Ventromedial prefrontal cortex has been linked to choice evaluation and decision-making in humans but understanding the role it plays is complicated by the fact that little is known about the corresponding area of the macaque brain. We recorded activity in macaques using functional magnetic resonance imaging during two very different value-guided decision-making tasks. In both cases ventromedial prefrontal cortex activity reflected subjective choice values during decision-making just as in humans but the relationship between the blood oxygen level-dependent signal and both decision-making and choice value was inverted and opposite to the relationship seen in humans. In order to test whether the ventromedial prefrontal cortex activity related to choice values is important for decision-making we conducted an additional lesion experiment; lesions that included the same ventromedial prefrontal cortex region disrupted normal subjective evaluation of choices during decision-making.

Ventromedial prefrontal cortex in humans shows functional magnetic resonance imaging signals related to the subjective values of choices that are taken during decision-making as well as task-negative signals. Here, the authors report that in macaque ventromedial prefrontal cortex both activity patterns are inverted and lesions of this area disrupt subjective choice evaluation.

Functional Heterogeneity within Rat Orbitofrontal Cortex in Reward Learning and Decision Making

Rat orbitofrontal cortex (OFC) is located in the dorsal bank of the rhinal sulcus, and is divided into the medial orbital area, ventral orbital area, ventrolateral orbital area, lateral orbital area, dorsolateral orbital area, and agranular insular areas. Over the past 20 years, there has been a marked increase in the number of publications focused on the functions of rat OFC. While collectively this extensive body of work has provided great insight into the functions of OFC, leading to theoretical and computational models of its functions, one issue that has emerged relates to what is defined as OFC because targeting of this region can be quite variable between studies of appetitive behavior, even within the same species. Also apparent is that there is an oversampling and undersampling of certain subregions of rat OFC for study, and this will be demonstrated here. The intent of the Viewpoint is to summarize studies in rat OFC, given the diversity of what groups refer to as "OFC," and to integrate these with the findings of recent anatomical studies. The primary aim is to help discern functions in reward learning and decision-making, clearing the course for future empirical work.

Basolateral Amygdala to Orbitofrontal Cortex Projections Enable Cue-Triggered Reward Expectations

To make an appropriate decision, one must anticipate potential future rewarding events, even when they are not readily observable. These expectations are generated by using observable information (e.g., stimuli or available actions) to retrieve often quite detailed memories of available rewards. The basolateral amygdala (BLA) and orbitofrontal cortex (OFC) are two reciprocally connected key nodes in the circuitry supporting such outcome-guided behaviors. But there is much unknown about the contribution of this circuit to decision making, and almost nothing known about the whether any contribution is via direct, monosynaptic projections, or the direction of information transfer. Therefore, here we used designer receptor-mediated inactivation of OFC→BLA or BLA→OFC projections to evaluate their respective contributions to outcome-guided behaviors in rats. Inactivation of BLA terminals in the OFC, but not OFC terminals in the BLA, disrupted the selective motivating influence of cue-triggered reward representations over reward-seeking decisions as assayed by Pavlovian-to-instrumental transfer. BLA→OFC projections were also required when a cued reward representation was used to modify Pavlovian conditional goal-approach responses according to the reward's current value. These projections were not necessary when actions were guided by reward expectations generated based on learned action-reward contingencies, or when rewards themselves, rather than stored memories, directed action. These data demonstrate that BLA→OFC projections enable the cue-triggered reward expectations that can motivate the execution of specific action plans and allow adaptive conditional responding.SIGNIFICANCE STATEMENT Deficits anticipating potential future rewarding events are associated with many psychiatric diseases. Presently, we know little about the neural circuits supporting such reward expectation. Here we show that basolateral amygdala to orbitofrontal cortex projections are required for expectations of specific available rewards to influence reward seeking and decision making. The necessity of these projections was limited to situations in which expectations were elicited by reward-predictive cues. These projections therefore facilitate adaptive behavior by enabling the orbitofrontal cortex to use environmental stimuli to generate expectations of potential future rewarding events.

Inhibitory modulation of medial prefrontal cortical activation on lateral orbitofrontal cortex-amygdala information flow

KEY POINTS

The basolateral complex of the amygdala (BLA) receives input from the lateral orbitofrontal cortex (lOFC) for cue-outcome contingencies and the medial prefrontal cortex (mPFC) for emotion control. Here we examined how the mPFC modulates lOFC-BLA information flow. We found that the majority of BLA neurons responsive to lOFC stimulation were also responsive to mPFC stimulation. Activation of the mPFC exerted an inhibitory modulation of the lOFC-BLA pathway, which was reversed with intra-amygdala blockade of GABAergic receptors. mPFC tetanus potentiated the lOFC-BLA pathway, but did not alter its inhibitory modulatory gating. These results show that the mPFC potently inhibits lOFC drive of the BLA in a GABA-dependent manner, which is informative in understanding the normal and potential pathophysiological state of emotion and contingency associations in regulating behaviour.

ABSTRACT

Several neocortical projections converge onto the basolateral complex of the amygdala (BLA), including the lateral orbitofrontal cortex (lOFC) and the medial prefrontal cortex (mPFC). Lateral orbitofrontal input to the BLA is important for cue-outcome contingencies, while medial prefrontal input is essential for emotion control. In this study, we examined how the mPFC, specifically the infralimbic division of the mPFC, modulates lOFC-BLA information flow, using combined in vivo extracellular single-unit recordings and pharmacological manipulations in anaesthetized rats. We found that the majority (over 95%) of BLA neurons that responded to lOFC stimulation also responded to mPFC stimulation. Compared to basal condition, pharmacological (N-methyl-d-aspartate) or electrical activation of the mPFC exerted an inhibitory modulation of the lOFC-BLA pathway, which was reversed with intra-amygdala blockade of GABAergic receptors with combined GABA_A and GABA_B antagonists (bicuculline and saclofen). Moreover, mPFC tetanus potentiated the lOFC-BLA pathway, but mPFC tetanus or low-frequency stimulation did not alter its inhibitory modulatory gating on the lOFC-BLA pathway. These results show that the mPFC potently inhibits lOFC drive of BLA neurons in a GABA-dependent manner. Our result is informative in understanding the normal and potential pathophysiological state of emotion and contingency associations regulating behaviour.

Medial Orbitofrontal Neurons Preferentially Signal Cues Predicting Changes in Reward during Unblocking

The orbitofrontal cortex (OFC) has been broadly implicated in the ability to use the current value of expected outcomes to guide behavior. Although value correlates have been prominently reported in lateral OFC, they are more often associated with more medial areas. Further, recent studies in primates have suggested a dissociation in which the lateral OFC is involved in credit assignment and representation of reward identity and more medial areas are critical to representing value. Previously, we used unblocking to test more specifically what information about outcomes is represented by OFC neurons in rats; consistent with the proposed dichotomy between the lateral and medial OFC, we found relatively little linear value coding in the lateral OFC (Lopatina et al., 2015). Here we have repeated this experiment, recording in the medial OFC, to test whether such value signals might be found there. Neurons were recorded in an unblocking task as rats learned about cues that signaled either more, less, or the same amount of reward. We found that medial OFC neurons acquired responses to these cues; however, these responses did not signal different reward values across cues. Surprisingly, we found that cells developed responses to cues predicting a change, particularly a decrease, in reward value. This is consistent with a special role for medial OFC in representing current value to support devaluation/revaluation sensitive changes in behavior.

SIGNIFICANCE STATEMENT

This study uniquely examines encoding in rodent mOFC at the single-unit level in response to cues that predict more, less, or no change in reward in rats during training in a Pavlovian unblocking task, finding more cells responding to change-predictive cues and stronger activity in response to cues predictive of less reward.

Lateral Orbitofrontal Cortical Modulation on the Medial Prefrontal Cortex-Amygdala Pathway: Differential Regulation of Intra-Amygdala GABAA and GABAB Receptors

BACKGROUND

The basolateral complex of the amygdala receives inputs from neocortical areas, including the medial prefrontal cortex and lateral orbitofrontal cortex. Earlier studies have shown that lateral orbitofrontal cortex activation exerts an inhibitory gating on medial prefrontal cortex-amygdala information flow. Here we examined the individual role of GABAA and GABAB receptors in this process.

METHODS

In vivo extracellular single-unit recordings were done in anesthetized rats. We searched amygdala neurons that fire in response to medial prefrontal cortex activation, tested lateral orbitofrontal cortex gating at different delays (lateral orbitofrontal cortex-medial prefrontal cortex delays: 25, 50, 100, 250, 500, and 1000 milliseconds), and examined differential contribution of GABAA and GABAB receptors with iontophoresis.

RESULTS

Relative to baseline, lateral orbitofrontal cortex stimulation exerted an inhibitory modulatory gating on the medial prefrontal cortex-amygdala pathway and was effective up to a long delay of 500 ms (long-delay latencies at 100, 250, and 500 milliseconds). Moreover, blockade of intra-amygdala GABAA receptors with bicuculline abolished the lateral orbitofrontal cortex inhibitory gating at both short- (25 milliseconds) and long-delay (100 milliseconds) intervals, while blockade of GABAB receptors with saclofen reversed the inhibitory gating at long delay (100 milliseconds) only. Among the majority of the neurons examined (8 of 9), inactivation of either GABAA or GABAB receptors during baseline did not change evoked probability per se, suggesting that local feed-forward inhibitory mechanism is pathway specific.

CONCLUSIONS

Our results suggest that the effect of lateral orbitofrontal cortex inhibitory modulatory gating was effective up to 500 milliseconds and that intra-amygdala GABAA and GABAB receptors differentially modulate the short- and long-delay lateral orbitofrontal cortex inhibitory gating on the medial prefrontal cortex-amygdala pathway.

A distributed, hierarchical and recurrent framework for reward-based choice

Many accounts of reward-based choice argue for distinct component processes that are serial and functionally localized. In this Opinion article, we argue for an alternative viewpoint, in which choices emerge from repeated computations that are distributed across many brain regions. We emphasize how several features of neuroanatomy may support the implementation of choice, including mutual inhibition in recurrent neural networks and the hierarchical organization of timescales for information processing across the cortex. This account also suggests that certain correlates of value are emergent rather than represented explicitly in the brain.

Autocorrelation structure at rest predicts value correlates of single neurons during reward-guided choice

Correlates of value are routinely observed in the prefrontal cortex (PFC) during reward-guided decision making. In previous work (Hunt et al., 2015), we argued that PFC correlates of chosen value are a consequence of varying rates of a dynamical evidence accumulation process. Yet within PFC, there is substantial variability in chosen value correlates across individual neurons. Here we show that this variability is explained by neurons having different temporal receptive fields of integration, indexed by examining neuronal spike rate autocorrelation structure whilst at rest. We find that neurons with protracted resting temporal receptive fields exhibit stronger chosen value correlates during choice. Within orbitofrontal cortex, these neurons also sustain coding of chosen value from choice through the delivery of reward, providing a potential neural mechanism for maintaining predictions and updating stored values during learning. These findings reveal that within PFC, variability in temporal specialisation across neurons predicts involvement in specific decision-making computations.

DOI:http://dx.doi.org/10.7554/eLife.18937.001

Back to basics: Making predictions in the orbitofrontal-amygdala circuit

Underlying many complex behaviors are simple learned associations that allow humans and animals to anticipate the consequences of their actions. The orbitofrontal cortex and basolateral amygdala are two regions which are crucial to this process. In this review, we go back to basics and discuss the literature implicating both these regions in simple paradigms requiring the development of associations between stimuli and the motivationally-significant outcomes they predict. Much of the functional research surrounding this ability has suggested that the orbitofrontal cortex and basolateral amygdala play very similar roles in making these predictions. However, electrophysiological data demonstrates critical differences in the way neurons in these regions respond to predictive cues, revealing a difference in their functional role. On the basis of these data and theories that have come before, we propose that the basolateral amygdala is integral to updating information about cue-outcome contingencies whereas the orbitofrontal cortex is critical to forming a wider network of past and present associations that are called upon by the basolateral amygdala to benefit future learning episodes. The tendency for orbitofrontal neurons to encode past and present contingencies in distinct neuronal populations may facilitate its role in the formation of complex, high-dimensional state-specific associations.