Is the core function of orbitofrontal cortex to signal values or make predictions?

Shared orbitofrontal dynamics to a drug-themed movie track craving and recovery in heroin addiction

Movies captivate groups of individuals (the audience), especially if they contain themes of common motivational interest to the group. In drug addiction, a key mechanism is maladaptive motivational salience attribution whereby drug cues outcompete other reinforcers within the same environment or context. We predicted that while watching a drug-themed movie, where cues for drugs and other stimuli share a continuous narrative context, functional MRI responses in individuals with heroin use disorder (iHUD) will preferentially synchronize during drug scenes. Thirty inpatient iHUD (24 male) and 25 healthy controls (16 male) watched a drug-themed movie at baseline and at follow-up after 15 weeks. Results revealed such drug-biased synchronization in the orbitofrontal cortex (OFC), ventromedial and ventrolateral prefrontal cortex, and insula. After 15 weeks during ongoing inpatient treatment, there was a significant reduction in this drug-biased shared response in the OFC, which correlated with a concomitant reduction in dynamically-measured craving, suggesting synchronized OFC responses to a drug-themed movie as a neural marker of craving and recovery in iHUD.

Schemas, reinforcement learning and the medial prefrontal cortex

Schemas are rich and complex knowledge structures about the typical unfolding of events in a context; for example, a schema of a dinner at a restaurant. In this Perspective, we suggest that reinforcement learning (RL), a computational theory of learning the structure of the world and relevant goal-oriented behaviour, underlies schema learning. We synthesize literature about schemas and RL to offer that three RL principles might govern the learning of schemas: learning via prediction errors, constructing hierarchical knowledge using hierarchical RL, and dimensionality reduction through learning a simplified and abstract representation of the world. We then suggest that the orbitomedial prefrontal cortex is involved in both schemas and RL due to its involvement in dimensionality reduction and in guiding memory reactivation through interactions with posterior brain regions. Last, we hypothesize that the amount of dimensionality reduction might underlie gradients of involvement along the ventral-dorsal and posterior-anterior axes of the orbitomedial prefrontal cortex. More specific and detailed representations might engage the ventral and posterior parts, whereas abstraction might shift representations towards the dorsal and anterior parts of the medial prefrontal cortex.

Applications of Behavioral Economics and Neuroeconomics in Mental Health

Objective: The integration of behavioral economics and neuroeconomics into mental health offers innovative perspectives on understanding and addressing psychological disorders. This overview aims to synthesize current knowledge and explore the implications of these interdisciplinary approaches in the context of mental health. Method : In this narrative review, we summarized the current evidence regarding the applications of behavioral economics and neuroeconomics approaches in the field of mental health. Results: Behavioral economics and neuroeconomics provide valuable insights into the cognitive and emotional processes underlying mental health disorders, such as irrational decision-making, impulsivity, and self-control issues. Concepts such as loss aversion, temporal discounting, and framing effects inform the development of innovative interventions and policy initiatives. Behavioral economic interventions, including nudges, incentives, and commitment devices, show promise in promoting treatment adherence, reducing risky behaviors, and enhancing mental well-being. Neuroeconomics contributes by identifying neural markers predictive of treatment response and relapse risk, paving the way for personalized treatment approaches. Conclusion: The integration of behavioral economics and neuroeconomics into mental health research and practice holds significant potential for improving the understanding of psychological disorders and developing more effective, personalized interventions. Further research is needed to elucidate the mechanisms of action, optimize intervention strategies, and address ethical considerations associated with these approaches in mental health settings.

Brain signatures of catastrophic events: Emotion, salience, and cognitive control

Anticipatory brain activity makes it possible to predict the occurrence of expected situations. However, events such as traffic accidents are statistically unpredictable and can generate catastrophic consequences. This study investigates the brain activity and effective connectivity associated with anticipating and processing such unexpected, unavoidable accidents. We asked 161 participants to ride a motorcycle simulator while recording their electroencephalographic activity. Of these, 90 participants experienced at least one accident while driving. We conducted both within-subjects and between-subjects comparisons. During the pre-accident period, the right inferior parietal lobe (IPL), left anterior cingulate cortex (ACC), and right insula showed higher activity in the accident condition. In the post-accident period, the bilateral orbitofrontal cortex, right IPL, bilateral ACC, and middle and superior frontal gyrus also showed increased activity in the accident condition. We observed greater effective connectivity within the nodes of the limbic network (LN) and between the nodes of the attentional networks in the pre-accident period. In the post-accident period, we also observed greater effective connectivity between networks, from the ventral attention network (VAN) to the somatomotor network and from nodes in the visual network, VAN, and default mode network to nodes in the frontoparietal network, LN, and attentional networks. This suggests that activating salience-related processes and emotional processing allows the anticipation of accidents. Once an accident has occurred, integration and valuation of the new information takes place, and control processes are initiated to adapt behavior to the new demands of the environment.

Cracking and Packing Information about the Features of Expected Rewards in the Orbitofrontal Cortex

The orbitofrontal cortex (OFC) is crucial for tracking various aspects of expected outcomes, thereby helping to guide choices and support learning. Our previous study showed that the effects of reward timing and size on the activity of single units in OFC were dissociable when these attributes were manipulated independently ( Roesch et al., 2006). However, in real-life decision-making scenarios, outcome features often change simultaneously, so here we investigated how OFC neurons in male rats integrate information about the timing and identity (flavor) of reward and respond to changes in these features, according to whether they were changed simultaneously or separately. We found that a substantial number of OFC neurons fired differentially to immediate versus delayed reward and to the different reward flavors. However, contrary to the previous study, selectivity for timing was strongly correlated with selectivity for identity. Taken together with the previous research, these results suggest that when reward features are correlated, OFC tends to "pack" them into unitary constructs, whereas when they are independent, OFC tends to "crack" them into separate constructs. Furthermore, we found that when both reward timing and flavor were changed, reward-responsive OFC neurons showed unique activity patterns preceding and during the omission of an expected reward. Interestingly, this OFC activity is similar and slightly preceded the ventral tegmental area dopamine (VTA DA) activity observed in a previous study ( Takahashi et al., 2023), consistent with the role of OFC in providing predictive information to VTA DA neurons.

Appetitive conditioning with pornographic stimuli elicits stronger activation in reward regions than monetary and gaming-related stimuli

Appetitive conditioning plays an important role in the development and maintenance of pornography-use and gaming disorders. It is assumed that primary and secondary reinforcers are involved in these processes. Despite the common use of pornography and gaming in the general population appetitive conditioning processes in this context are still not well studied. This study aims to compare appetitive conditioning processes using primary (pornographic) and secondary (monetary and gaming-related) rewards as unconditioned stimuli (UCS) in the general population. Additionally, it investigates the conditioning processes with gaming-related stimuli as this type of UCS was not used in previous studies. Thirty-one subjects participated in a differential conditioning procedure in which four geometric symbols were paired with either pornographic, monetary, or gaming-related rewards or with nothing to become conditioned stimuli (CS + porn, CS + game, CS + money, and CS-) in an functional magnetic resonance imaging study. We observed elevated arousal and valence ratings as well as skin conductance responses for each CS+ condition compared to the CS-. On the neural level, we found activations during the presentation of the CS + porn in the bilateral nucleus accumbens, right medial orbitofrontal cortex, and the right ventral anterior cingulate cortex compared to the CS-, but no significant activations during CS + money and CS + game compared to the CS-. These results indicate that different processes emerge depending on whether primary and secondary rewards are presented separately or together in the same experimental paradigm. Additionally, monetary and gaming-related stimuli seem to have a lower appetitive value than pornographic rewards.

Naturalistic drug cue reactivity in heroin use disorder: orbitofrontal synchronization as a marker of craving and recovery

Movies captivate groups of individuals (the audience), especially if they contain themes of common motivational interest to the group. In drug addiction, a key mechanism is maladaptive motivational salience attribution whereby drug cues outcompete other reinforcers within the same environment or context. We predicted that while watching a drug-themed movie, where cues for drugs and other stimuli share a continuous narrative context, fMRI responses in individuals with heroin use disorder (iHUD) will preferentially synchronize during drug scenes. Results revealed such drug-biased synchronization in the orbitofrontal cortex (OFC), ventromedial and ventrolateral prefrontal cortex, and insula. After 15 weeks of inpatient treatment, there was a significant reduction in this drug-biased shared response in the OFC, which correlated with a concomitant reduction in dynamically-measured craving, suggesting synchronized OFC responses to a drug-themed movie as a neural marker of craving and recovery in iHUD.

Noradrenergic regulation of cue-guided decision making and impulsivity is doubly dissociable across frontal brain regions

RATIONALE

Win-paired stimuli can promote risk taking in experimental gambling paradigms in both rats and humans. We previously demonstrated that atomoxetine, a noradrenaline reuptake inhibitor, and guanfacine, a selective α2A adrenergic receptor agonist, reduced risk taking on the cued rat gambling task (crGT), a rodent assay of risky choice in which wins are accompanied by salient cues. Both compounds also decreased impulsive premature responding.

OBJECTIVE

The key neural loci mediating these effects were unknown. The lateral orbitofrontal cortex (lOFC) and the medial prefrontal cortex (mPFC), which are highly implicated in risk assessment, action selection, and impulse control, receive dense noradrenergic innervation. We therefore infused atomoxetine and guanfacine directly into either the lOFC or prelimbic (PrL) mPFC prior to task performance.

RESULTS

When infused into the lOFC, atomoxetine improved decision making score and adaptive lose-shift behaviour in males, but not in females, without altering motor impulsivity. Conversely, intra-PrL atomoxetine improved impulse control in risk preferring animals of both sexes, but did not alter decision making. Guanfacine administered into the PrL, but not lOFC, also altered motor impulsivity in all subjects, though in the opposite direction to atomoxetine.

CONCLUSIONS

These data highlight a double dissociation between the behavioural effects of noradrenergic signaling across frontal regions with respect to risky choice and impulsive action. Given that the influence of noradrenergic manipulations on motor impulsivity could depend on baseline risk preference, these data also suggest that the noradrenaline system may function differently in subjects that are susceptible to the risk-promoting lure of win-associated cues.

The gradient model of brain organization in decisions involving “empathy for pain”

Influential models of cortical organization propose a close relationship between heteromodal association areas and highly connected hubs in the default mode network. The “gradient model” of cortical organization proposes a close relationship between these areas and highly connected hubs in the default mode network, a set of cortical areas deactivated by demanding tasks. Here, we used a decision-making task and representational similarity analysis with classic “empathy for pain” stimuli to probe the relationship between high-level representations of imminent pain in others and these areas. High-level representations were colocalized with task deactivations or the transitions from activations to deactivations. These loci belonged to 2 groups: those that loaded on the high end of the principal cortical gradient and were associated by meta-analytic decoding with the default mode network, and those that appeared to accompany functional repurposing of somatosensory cortex in the presence of visual stimuli. These findings suggest that task deactivations may set out cortical areas that host high-level representations. We anticipate that an increased understanding of the cortical correlates of high-level representations may improve neurobiological models of social interactions and psychopathology.

Laser stimulation of the skin for quantitative study of decision-making and motivation

Neuroeconomics studies how decision-making is guided by the value of rewards and punishments. But to date, little is known about how noxious experiences impact decisions. A challenge is the lack of an aversive stimulus that is dynamically adjustable in intensity and location, readily usable over many trials in a single experimental session, and compatible with multiple ways to measure neuronal activity. We show that skin laser stimulation used in human studies of aversion can be used for this purpose in several key animal models. We then use laser stimulation to study how neurons in the orbitofrontal cortex (OFC), an area whose many roles include guiding decisions among different rewards, encode the value of rewards and punishments. We show that some OFC neurons integrated the positive value of rewards with the negative value of aversive laser stimulation, suggesting that the OFC can play a role in more complex choices than previously appreciated.

Orbitofrontal cortex governs working memory for temporal order

How do we think about time? Converging lesion and neuroimaging evidence indicates that orbitofrontal cortex (OFC) supports the encoding and retrieval of temporal context in long-term memory¹, which may contribute to confabulation in individuals with OFC damage². Here, we reveal that OFC damage diminishes working memory for temporal order, that is, the ability to disentangle the relative recency of events as they unfold. OFC lesions reduced working memory for temporal order but not spatial position, and individual deficits were commensurate with lesion size. Comparable effects were absent in patients with lesions restricted to lateral prefrontal cortex (PFC). Based on these findings, we propose that OFC supports understanding of the order of events. Well-documented behavioral changes in individuals with OFC damage² may relate to impaired temporal-order understanding.

The orbitofrontal cortex represents advantageous choice in the Iowa gambling task

A good‐based model, the central neurobiological model of economic decision‐making, proposes that the orbitofrontal cortex (OFC) represents binary choice outcome, that is, the chosen good. A good is defined by a group of determinants characterizing the conditions in which the commodity is offered, including commodity type, cost, risk, time delay, and ambiguity. Previous studies have found that the OFC represents the binary choice outcome in decision‐making tasks involving commodity type, cost, risk, and delay. Real‐life decisions are often complex and involve uncertainty, rewards, and penalties; however, whether the OFC represents binary choice outcomes in a complex decision‐making situation, for example, Iowa gambling task (IGT), remains unclear. Here, we propose that the OFC represents binary choice outcome, that is, advantageous choice versus disadvantageous choice, in the IGT. We propose two hypotheses: first, the activity pattern in the human OFC represents an advantageous choice; and second, choice induces an OFC‐related functional network. Using functional magnetic resonance imaging and advanced machine‐learning tools, we found that the OFC represented an advantageous choice in the IGT. The OFC representation of advantageous choice was related to decision‐making performance. Choice modulated the functional connectivity between the OFC and the superior medial gyrus. In conclusion, the OFC represents an advantageous choice during the IGT. In the framework of a good‐based model, the results extend the role of the OFC to complex decision‐making situation when making a binary choice.

The whole prefrontal cortex is premotor cortex

We propose that the entirety of the prefrontal cortex (PFC) can be seen as fundamentally premotor in nature. By this, we mean that the PFC consists of an action abstraction hierarchy whose core function is the potentiation and depotentiation of possible action plans at different levels of granularity. We argue that the apex of the hierarchy should revolve around the process of goal-selection, which we posit is inherently a form of optimization over action abstraction. Anatomical and functional evidence supports the idea that this hierarchy originates on the orbital surface of the brain and extends dorsally to motor cortex. Accordingly, our viewpoint positions the orbitofrontal cortex in a key role in the optimization of goal-selection policies, and suggests that its other proposed roles are aspects of this more general function. Our proposed perspective will reframe outstanding questions, open up new areas of inquiry and align theories of prefrontal function with evolutionary principles. This article is part of the theme issue 'Systems neuroscience through the lens of evolutionary theory'.

Prefrontal cortex and depression

The prefrontal cortex (PFC) has emerged as one of the regions most consistently impaired in major depressive disorder (MDD). Although functional and structural PFC abnormalities have been reported in both individuals with current MDD as well as those at increased vulnerability to MDD, this information has not translated into better treatment and prevention strategies. Here, we argue that dissecting depressive phenotypes into biologically more tractable dimensions - negative processing biases, anhedonia, despair-like behavior (learned helplessness) - affords unique opportunities for integrating clinical findings with mechanistic evidence emerging from preclinical models relevant to depression, and thereby promises to improve our understanding of MDD. To this end, we review and integrate clinical and preclinical literature pertinent to these core phenotypes, while emphasizing a systems-level approach, treatment effects, and whether specific PFC abnormalities are causes or consequences of MDD. In addition, we discuss several key issues linked to cross-species translation, including functional brain homology across species, the importance of dissecting neural pathways underlying specific functional domains that can be fruitfully probed across species, and the experimental approaches that best ensure translatability. Future directions and clinical implications of this burgeoning literature are discussed.

The hippocampus and orbitofrontal cortex jointly represent task structure during memory-guided decision making

The hippocampus, well known for its role in episodic memory, might also be an important brain region for extracting structure from our experiences in order to guide future decisions. Recent evidence in rodents suggests that the hippocampus supports decision making by representing task structure in cooperation with the orbitofrontal cortex (OFC). Here, we examine how the human hippocampus and OFC represent task structure during an associative learning task that required learning of both context-determined and context-invariant probabilistic associations. We find that after learning, hippocampal and lateral OFC representations differentiated between context-determined and context-invariant task structures. The degree of this differentiation within the hippocampus and lateral OFC is highly correlated. These results advance our understanding of the hippocampus and suggest that the hippocampus and OFC support goal-directed behavior by representing information that guides the selection of appropriate decision strategies.

Mizrak et al. use fMRI to demonstrate that hippocampus and orbitofrontal cortex generalize across decisions that share the same task sub-structure compared with different task sub-structures. Results show that the hippocampus, in coordination with OFC, supports decision making by extracting structure from past experiences.

Toward a holistic view of value and social processing in the amygdala: Insights from primate behavioral neurophysiology

Located medially within the temporal lobes, the amygdala is a formation of heterogenous nuclei that has emerged as a target for investigations into the neural bases of both primitive and complex behaviors. Although modern neuroscience has eschewed the practice of assigning broad functions to distinct brain regions, the amygdala has classically been associated with regulating negative emotional processes (such as fear or aggression), primarily through research performed in rodent models. Contemporary studies, particularly those in non-human primate models, have provided evidence for a role of the amygdala in other aspects of cognition such as valuation of stimuli or shaping social behaviors. Consequently, many modern perspectives now also emphasize the amygdala's role in processing positive affect and social behaviors. Importantly, several recent experiments have examined the intersection of two seemingly autonomous domains; how both valence/value and social stimuli are simultaneously represented in the amygdala. Results from these studies suggest that there is an overlap between valence/value processing and the processing of social behaviors at the level of single neurons. These findings have prompted researchers investigating the neurophysiological mechanisms underlying social interactions to question what contributions reward-related processes in the amygdala make in shaping social behaviors. In this review, we will examine evidence, primarily from primate neurophysiology, suggesting that value-related processes in the amygdala interact with the processing of social stimuli, and explore holistic hypotheses about how these amygdalar interactions might be instantiated.