Glucocorticoid-sensitive ventral hippocampal-orbitofrontal cortical connections support goal-directed action - Curt Richter Award Paper 2019

A molecularly defined orbitofrontal cortical neuron population controls compulsive-like behavior, but not inflexible choice or habit

Habits are familiar behaviors triggered by cues, not outcome predictability, and are insensitive to changes in the environment. They are adaptive under many circumstances but can be considered antecedent to compulsions and intrusive thoughts that drive persistent, potentially maladaptive behavior. Whether compulsive-like and habit-like behaviors share neural substrates is still being determined. Here, we investigated mice bred to display inflexible reward-seeking behaviors that are insensitive to action consequences. We found that these mice demonstrate habitual response biases and compulsive-like grooming behavior that was reversible by fluoxetine and ketamine. They also suffer dendritic spine attrition on excitatory neurons in the orbitofrontal cortex (OFC). Nevertheless, synaptic melanocortin 4 receptor (MC4R), a factor implicated in compulsive behavior, is preserved, leading to the hypothesis that Mc4r+ OFC neurons may drive aberrant behaviors. Repeated chemogenetic stimulation of Mc4r+ OFC neurons triggered compulsive and not inflexible or habitual response biases in otherwise typical mice. Thus, Mc4r+ neurons within the OFC appear to drive compulsive-like behavior that is dissociable from habitual behavior. Understanding which neuron populations trigger distinct behaviors may advance efforts to mitigate harmful compulsions.

A hippocampo-cortical pathway detects changes in the validity of an action as a predictor of reward

Much research has been dedicated to understanding the psychological and neural bases of goal-directed action, yet the relationship between context and goal-directed action is not well understood. Here, we used excitotoxic lesions, chemogenetics, and circuit-specific manipulations to demonstrate the role of the ventral hippocampus (vHPC) in contextual learning that supports sensitivity to action-outcome contingencies, a hallmark of goal-directed action. We found that chemogenetic inhibition of the ventral, but not dorsal, hippocampus attenuated sensitivity to instrumental contingency degradation. We then tested the hypothesis that this deficit was due to an inability to discern the relative validity of the action compared with the context as a predictor of reward. Using latent inhibition and Pavlovian context conditioning, we confirm that degradation of action-outcome contingencies relies on intact context-outcome learning and show that this learning is dependent on vHPC. Finally, we show that chemogenetic inhibition of vHPC terminals in the medial prefrontal cortex also impairs both instrumental contingency degradation and context-outcome learning. These results implicate a hippocampo-cortical pathway in adapting to changes in instrumental contingencies and indicate that the psychological basis of this deficit is an inability to learn the predictive value of the context. Our findings contribute to a broader understanding of the neural bases of goal-directed action and its contextual regulation.

Sex and individual differences in the effect of chronic low-dose ethanol on behavioral strategy selection

BACKGROUND

The development of an alcohol use disorder (AUD) involves impaired behavioral control and flexibility. Behavioral inflexibility includes an inability to shift behavior in response to changes in behavioral outcomes. Low levels of ethanol drinking may promote the formation of inflexible, habitual reward seeking, but this may depend on the timing of ethanol exposure in relation to learning. The goal of this study was to determine whether a history of low-dose ethanol exposure promoted contingency-insensitive sucrose seeking and altered behavioral strategy selection.

METHODS

Male and female C57BL/6J mice were trained to perform a response (lever press) for sucrose on two different reinforcement schedules: one that is thought to promote inflexible responding (random interval) and one that maintains flexible responding (variable ratio [VR]). Following instrumental training each day, mice were exposed to saline or low-dose ethanol (0.5 g/kg; i.p.) either proximal (1 h after) or distal (4 h after) to learning. Mice were then tested for sensitivity to changes in contingency in a contingency degradation test.

RESULTS

A history of low-dose ethanol exposure shifted behavioral strategy selection, as measured by reward tracking behavior, but this depended on sex and reinforcement schedule history. Both male and female mice used different strategies depending on the reinforcement schedule, but only males exhibited ethanol-induced shifts in strategy selection. A history of low-dose ethanol exposure did not impact contingency sensitivity in males but promoted insensitivity in females specifically on the VR lever.

CONCLUSIONS

Female mice show distinct behavioral effects of repeated, low-dose ethanol exposure as compared to males, with sex differences in the use of reward tracking strategies to guide behavior. Future studies should investigate sex differences in the neural consequences of chronic low-dose ethanol exposure that may underlie behavioral changes.

Positive correlation between measures of habitual responding and motivated responding in mice

Habit and motivation are thought to be separate processes, with motivated behavior often considered to be goal directed, whereas habits are defined by the absence of goal-directed control over behavior. However, there has been increasing interrogation of the binary nature of habitual versus goal-directed behavior. Furthermore, although drug and alcohol exposure can promote the formation of habits, drug seeking itself can also be highly flexible, pointing toward the need for complex consideration of the parallel processes that drive behavior. The goal of the current study was to determine whether there was a relation between motivation-as measured by progressive ratio-and habit-as measured by contingency degradation-and whether this relation was affected by ethanol exposure history and sex. The results showed that these measures were positively correlated such that greater contingency insensitivity was associated with achieving higher break points on the progressive-ratio task. However, this relation depended on reinforcement schedule history, ethanol exposure history, and sex. These point to potential relations between measures of habit and motivation and stress the importance of carefully parsing behavioral findings and assays. These findings are also expected to inform future substance use research, as drug history may affect these relations.

Pathway specific interventions reveal the multiple roles of ventral hippocampus projections in cognitive functions

Since the 1950s study of Scoville and Milner on the case H.M., the hippocampus has attracted neuroscientists' attention. The hippocampus has been traditionally divided into dorsal and ventral parts, each of which projects to different brain structures and mediates various functions. Despite a predominant interest in its dorsal part in animal models, especially regarding episodic-like and spatial cognition, recent data highlight the role of the ventral hippocampus (vHPC), as the main hippocampal output, in cognitive processes. Here, we review recent studies conducted in rodents that have used advanced in vivo functional techniques to specifically monitor and manipulate vHPC efferent pathways and delineate the roles of these specific projections in learning and memory processes. Results highlight that vHPC projections to basal amygdala are implicated in emotional memory, to nucleus accumbens in social memory and instrumental actions and to prefrontal cortex in all the above as well as in object-based memory. Some of these hippocampal projections also modulate feeding and anxiety-like behaviours providing further evidence that the "one pathway-one function" view is outdated and future directions are proposed to better understand the role of hippocampal pathways and shed further light on its connectivity and function.

Contribution of dorsal versus ventral hippocampus to the hierarchical modulation of goal-directed actions in rats

Adaptive behaviour often necessitates that animals learn about events in a manner that is specific to a particular context or environment. These hierarchical organisations allow the animal to decide which action is the most appropriate when faced with ambiguous or conflicting possibilities. This study examined the role of hippocampus in enabling animals to use the context to guide action selection. We used a hierarchical instrumental outcome devaluation task in which male rats learn that the context provides information about the unique action-outcome relations that are in effect. We first confirmed that rats encode and use hierarchical context-(action-outcome) relations. We then show that chemogenetic inhibition of ventral hippocampus impairs both the encoding and retrieval of these associations, while inhibition of dorsal hippocampus impairs only the retrieval. Importantly, neither dorsal nor ventral hippocampus was required for goal-directed behaviour per se as these impairments only emerged when rats were forced to use the context to identify the current action-outcome relationships. These findings are discussed with respect to the role of the hippocampus and its broader circuitry in the contextual modulation of goal-directed behaviour and the importance of hierarchical associations in flexible behaviour.

GluN2B inhibition confers resilience against long-term cocaine-induced neurocognitive sequelae

Cocaine self-administration can disrupt the capacity of humans and rodents to flexibly modify familiar behavioral routines, even when they become maladaptive or unbeneficial. However, mechanistic factors, particularly those driving long-term behavioral changes, are still being determined. Here, we capitalized on individual differences in oral cocaine self-administration patterns in adolescent mice and revealed that the post-synaptic protein PSD-95 was reduced in the orbitofrontal cortex (OFC) of escalating, but not stable, responders, which corresponded with later deficits in flexible decision-making behavior. Meanwhile, NMDA receptor GluN2B subunit content was lower in the OFC of mice that were resilient to escalatory oral cocaine seeking. This discovery led us to next co-administer the GluN2B-selective antagonist ifenprodil with cocaine, blocking the later emergence of cocaine-induced decision-making abnormalities. GluN2B inhibition also prevented cocaine-induced dysregulation of neuronal structure and function in the OFC, preserving mature, mushroom-shaped dendritic spine densities on deep-layer pyramidal neurons, which were otherwise lower with cocaine, and safeguarding functional BLA→OFC connections necessary for action flexibility. We posit that cocaine potentiates GluN2B-dependent signaling, which triggers a series of durable adaptations that result in the dysregulation of post-synaptic neuronal structure in the OFC and disruption of BLA→OFC connections, ultimately weakening the capacity for flexible choice. And thus, inhibiting GluN2B-NMDARs promotes resilience to long-term cocaine-related sequelae.

Linking external stimuli with internal drives: A role for the ventral hippocampus

The ventral hippocampus (vHPC) has long been thought of as the "emotional" hippocampus. Over the past several years, the complexity of vHPC has come to light, highlighting the diversity of cell types, inputs, and outputs that coordinate a constellation of positively and negatively motivated behaviors. Here, we review recent work on how vCA1 contributes to a network that associates external stimuli with internal motivational drive states to promote the selection of adaptive behavioral responses. We propose a model of vHPC function that emphasizes its role in the integration and transformation of internal and external cues to guide behavioral selection when faced with multiple potential outcomes.

Medial orbitofrontal neurotrophin systems integrate hippocampal input into outcome-specific value representations

In everyday life, we mentally represent possible consequences of our behaviors and integrate specific outcome values into existing knowledge to inform decisions. The medial orbitofrontal cortex (MO) is necessary to adapt behaviors when outcomes are not immediately available-when they and their values need to be envisioned. Nevertheless, neurobiological mechanisms remain unclear. We find that the neuroplasticity-associated neurotrophin receptor tropomyosin receptor kinase B (TrkB) is necessary for mice to integrate outcome-specific value information into choice behavior. This function appears attributable to memory updating (and not retrieval) and the stabilization of dendritic spines on excitatory MO neurons, which led us to investigate inputs to the MO. Ventral hippocampal (vHC)-to-MO projections appear conditionally necessary for value updating, involved in long-term aversion-based value memory updating. Furthermore, vHC-MO-mediated control of choice is TrkB dependent. Altogether, we reveal a vHC-MO connection by which specific value memories are updated, and we position TrkB within this functional circuit.

Cell Adhesion Factors in the Orbitofrontal Cortex Control Cue-Induced Reinstatement of Cocaine Seeking and Amygdala-Dependent Goal Seeking

Repeated cocaine exposure causes dendritic spine loss in the orbitofrontal cortex, which might contribute to poor orbitofrontal cortical function following drug exposure. One challenge, however, has been verifying links between neuronal structural plasticity and behavior, if any. Here we report that cocaine self-administration triggers the loss of dendritic spines on excitatory neurons in the orbitofrontal cortex of male and female mice (as has been reported in rats). To understand functional consequences, we locally ablated neuronal β1-integrins, cell adhesion receptors that adhere cells to the extracellular matrix and thus support dendritic spine stability. Degradation of β1-integrin tone: (1) caused dendritic spine loss, (2) exaggerated cocaine-seeking responses in a cue-induced reinstatement test, and (3) impaired the ability of mice to integrate new learning into familiar routines, a key function of the orbitofrontal cortex. Stimulating Abl-related gene kinase, overexpressing Proline-rich tyrosine kinase, and inhibiting Rho-associated coiled-coil containing kinase corrected response strategies, uncovering a β1-integrin-mediated signaling axis that controls orbitofrontal cortical function. Finally, use of a combinatorial gene silencing/chemogenetic strategy revealed that β1-integrins support the ability of mice to integrate new information into established behaviors by sustaining orbitofrontal cortical connections with the basolateral amygdala.SIGNIFICANCE STATEMENT Cocaine degenerates dendritic spines in the orbitofrontal cortex, a region of the brain involved in interlacing new information into established behaviors. One challenge has been verifying links between cellular structural stability and behavior, if any. In this second of two related investigations, we study integrin family receptors, which adhere cells to the extracellular matrix and thereby stabilize dendritic spines (see also DePoy et al., 2019). We reveal that β1-integrins in the orbitofrontal cortex control food- and cocaine-seeking behaviors. For instance, β1-integrin loss amplifies cocaine-seeking behavior and impairs the ability of mice to integrate new learning into familiar routines. We identify likely intracellular signaling partners by which β1-integrins support orbitofrontal cortical function and connectivity with the basolateral amygdala.

The stressed orbitofrontal cortex

Stressor exposure causes dendritic remodeling on excitatory neurons in multiple regions of the brain, including the orbitofrontal cortex (OFC). Additionally, stressor and exogenous stress hormone exposure impair cognitive functions that are dependent on the OFC. For this Special Issue on the OFC, we summarize current literature regarding how stress-prenatal, postnatal, and even inter-generational-affects OFC neuron structure in rodents. We discuss dendrite structure, dendritic spines, and gene expression. We aim to provide a focused resource for those interested in how stressors impact this heterogeneous brain region. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

Arbitration of Approach-Avoidance Conflict by Ventral Hippocampus

When environmental cues or stimuli that represent both rewarding and aversive outcomes are presented, complex computations must be made in order to determine whether approach or avoidance is the better behavioral strategy. In many neuropsychiatric illnesses these computations can be skewed. In some instances, circumstances that may normally warrant avoidance instead promote approach, thus producing compulsive-like behavioral strategies that are inflexible in response to new or conflicting information. Alternatively, high sensitivity to aversion or low sensitivity to reward can result in the failure to achieve goals and loss of resilience that characterizes depressive disorders. Increases in compulsive-like behavior have been found to be associated with disrupted signaling in regions that regulate response to conflicting stimuli, including the hippocampus. Classic behavioral inhibition theories of hippocampus function in anxiety suggest that the hippocampus blocks aberrant behavior in response to anxiety related cues or stimuli. The hippocampus may act to block approach in the face of conflicting stimuli. Dysregulations of hippocampal function, as may be present in neuropsychiatric disorders, may therefore promote aberrant approach behavior. The ventral hippocampus (vHPC) subregion is key for coordinating this approach/avoidance conflict resolution, likely through its participation with cortico-striatal and mesolimbic circuits. We revisit Gray's behavioral inhibition theory of HPC function, first posited in the 1980s, and interpret in the context of new knowledge on vHPC function gained through modern technology. Taken together with the extant, classical literature on hippocampal function, we propose that these new findings suggest that vHPC circuits balance behavioral response to conflicting stimuli in a manner that is both state- and context-dependent and, further, that disruption of specific vHPC circuits tips the balance in favor of biased approach or avoidance behavioral strategies.

Morphological Responses of Excitatory Prelimbic and Orbitofrontal Cortical Neurons to Excess Corticosterone in Adolescence and Acute Stress in Adulthood

Considerable evidence indicates that chronic stress and excess glucocorticoids induce neuronal remodeling in prefrontal cortical (PFC) regions. Adolescence is also characterized by a structural reorganization of PFC neurons, yet interactions between stress- and age-related structural plasticity are still being determined. We quantified dendritic spine densities on apical dendrites of excitatory neurons in the medial prefrontal cortex, prelimbic subregion (PL). Densities decreased across adolescent development, as expected, and spine volume increased. Unexpectedly, exposure to excess corticosterone (CORT) throughout adolescence did not cause additional dendritic spine loss detectable in adulthood. As a positive control dendrite population expected to be sensitive to CORT, we imaged neurons in the orbitofrontal cortex (OFC), confirming CORT-induced dendritic spine attrition on basal arbors of layer V neurons. We next assessed the effects of acute, mild stress in adulthood: On PL neurons, an acute stressor increased the density of mature, mushroom-shaped spines. Meanwhile, on OFC neurons, dendritic spine volumes and lengths were lower in mice exposed to both CORT and an acute stressor (also referred to as a "double hit"). In sum, prolonged exposure to excess glucocorticoids during adolescence can have morphological and also metaplastic consequences, but they are not global. Anatomical considerations are discussed.

Prefrontal regulation of behavioural control: Evidence from learning theory and translational approaches in rodents

Everyday activities require adaptive decision-making and control over our actions to achieve our goals. Sub-regions within the cortex are widely reported to regulate these choices. Here we review rodent studies from two disparate fields of instrumental action control - goal-directed and habitual responding, and impulsive and compulsive behaviour. Our aim was to compare findings across the spectrum, from precision associative learning to translational studies of action control. The evidence suggests that each cortical sub-region performs different roles depending on task requirements and, within tasks, clear dissociations exist between regions. Rather than synthesizing a single role or function for a given region, we should consider regions to be capable of many different functions. Further investigation of cortico-cortical connections and the pattern of input and output circuitry within each region may be needed to identify unique process-specific pathways. Despite differences in the scope and purpose of these two fields, integrating evidence across tasks provides a broader context for testing hypotheses about the role of cortical regions in adaptive actions and decision-making.

Involvement of the rodent prelimbic and medial orbitofrontal cortices in goal-directed action: A brief review

Goal-directed action refers to selecting behaviors based on the expectation that they will be reinforced with desirable outcomes. It is typically conceptualized as opposing habit-based behaviors, which are instead supported by stimulus-response associations and insensitive to consequences. The prelimbic prefrontal cortex (PL) is positioned along the medial wall of the rodent prefrontal cortex. It is indispensable for action-outcome-driven (goal-directed) behavior, consolidating action-outcome relationships and linking contextual information with instrumental behavior. In this brief review, we will discuss the growing list of molecular factors involved in PL function. Ventral to the PL is the medial orbitofrontal cortex (mOFC). We will also summarize emerging evidence from rodents (complementing existing literature describing humans) that it too is involved in action-outcome conditioning. We describe experiments using procedures that quantify responding based on reward value, the likelihood of reinforcement, or effort requirements, touching also on experiments assessing food consumption more generally. We synthesize these findings with the argument that the mOFC is essential to goal-directed action when outcome value information is not immediately observable and must be recalled and inferred.

Interaction Between Circadian Rhythms, Energy Metabolism, and Cognitive Function

The interaction between meal timing and light regulates circadian rhythms in mammals and not only determines the sleep-wake pattern but also the activity of the endocrine system. Related with that, the necessity to fulfill energy needs is a driving force that requires the participation of cognitive skills whose performance has been shown to undergo circadian variations. These facts have led to the concept that cognition and feeding behaviour can be analysed from a chronobiological perspective. In this context, research carried out during the last two decades has evidenced the link between feeding behaviour/nutritional habits and cognitive processes, and has highlighted the impact of circadian disorders on cognitive decline. All that has allowed hypothesizing a tight relationship between nutritional factors, chronobiology, and cognition. In this connection, experimental diets containing elevated amounts of fat and sugar (high-fat diets; HFDs) have been shown to alter in rodents the circadian distribution of meals, and to have a negative impact on cognition and motivational aspects of behaviour that disappear when animals are forced to adhere to a standard temporal eating pattern. In this review, we will present relevant studies focussing on the effect of HFDs on cognitive aspects of behaviour, paying particular attention to the influence that chronobiological alterations caused by these diets may have on hippocampaldependent cognition.