Parsing the Role of the Hippocampus in Approach-Avoidance Conflict

Motivated with joy or anxiety: Does approach-avoidance goal framing elicit differential reward-network activation in the brain?

Psychological research on human motivation repeatedly observed that approach goals (i.e., goals to attain success) increase task enjoyment and intrinsic motivation more strongly than avoidance goals (i.e., goals to avoid failure). The present study sought to address how the reward network in the brain-including the striatum and ventromedial prefrontal cortex-is involved when individuals engage in the same task with a focus on approach or avoidance goals. Participants reported stronger positive emotions when they focused on approach goals, but stronger anxiety and disappointment when they focused on avoidance goals. The fMRI analyses revealed that the reward network in the brain showed similar levels of activity to cues predictive of approach and avoidance goals. In contrast, the two goal states were associated with different patterns of activity in the visual cortex, hippocampus, and cerebellum during success and failure outcomes. Representation similarity analysis further revealed shared and different representations within the striatum and vmPFC between the approach and avoidance goal states, suggesting both the similarity and uniqueness of the mechanisms behind the two goal states. In addition, the distinct patterns of activation in the striatum were associated with distinct subjective experiences participants reported between the approach and the avoidance conditions. These results suggest the importance of examining the pattern of striatal activity in understanding the mechanisms behind different motivational states in humans.

Elucidating medial temporal and frontal lobe contributions to approach-avoidance conflict decision-making using functional MRI and the hierarchical drift diffusion model

The prefrontal cortex (PFC) has long been associated with arbitrating between approach and avoidance in the face of conflicting and uncertain motivational information, but recent work has also highlighted medial temporal lobe (MTL) involvement. It remains unclear, however, how the contributions of these regions differ in their resolution of conflict information and uncertainty. We designed an fMRI paradigm in which participants approached or avoided object pairs that differed by motivational conflict and outcome uncertainty (complete certainty vs. complete uncertainty). Behavioral data and decision-making parameters estimated using the hierarchical drift diffusion model revealed that participants' responding was driven by conflict rather than uncertainty. Our neural data suggest that PFC areas contribute to cognitive control during approach-avoidance conflict by potentially adjusting response caution and the strength of evidence generated towards either choice, with differential involvement of anterior cingulate cortex and dorsolateral prefrontal cortex. The MTL, on the other hand, appears to contribute to evidence generation, with the hippocampus linked to evidence accumulation for stimuli. Although findings within perirhinal cortex were comparatively equivocal, some evidence suggests contributions to perceptual representations, particularly under conditions of threat. Our findings provide evidence that MTL and PFC regions may contribute uniquely to arbitrating approach-avoidance conflict.

Striatal reactivity during emotion and reward relates to approach-avoidance conflict behaviour and is altered in adults with anxiety or depression

BACKGROUND

We have previously reported activation in reward, salience and executive control regions during functional MRI (fMRI) using an approach-avoidance conflict (AAC) decision-making task with healthy adults. Further investigations into how anxiety and depressive disorders relate to differences in neural responses during AAC can inform their understanding and treatment. We tested the hypothesis that people with anxiety or depression have altered neural activation during AAC.

METHODS

We compared 118 treatment-seeking adults with anxiety or depression and 58 healthy adults using linear mixed-effects models to examine group-level differences in neural activation (fMRI) during AAC decision-making. Correlational analyses examined relationships between behavioural and neural measures.

RESULTS

Adults with anxiety or depression had greater striatal engagement when reacting to affective stimuli (p = 0.008, d = 0.31) regardless of valence, and weaker striatal engagement during reward feedback (p = 0.046, d = -0.27) regardless of the presence of monetary reward. They also had blunted amygdala activity during decision-making (p = 0.023, d = -0.32) regardless of the presence of conflict. Across groups, approach behaviour during conflict decision-making was inversely correlated with striatal activation during affective stimuli (p < 0.001, r = -0.28) and positively related to striatal activation during reward feedback (p < 0.001, r = 0.27).

LIMITATIONS

Our transdiagnostic approach did not allow for comparisons between specific anxiety disorders, and our cross-sectional approach did not allow for causal inference.

CONCLUSION

Anxiety and depression were associated with altered neural responses to AAC. Findings were consistent with the role of the striatum in action selection and reward responsivity, and they point toward striatal reactivity as a future treatment target. Blunting of amygdala activity in anxiety or depression may indicate a compensatory response to inhibit affective salience and maintain approach.

Humans perseverate on punishment avoidance goals in multigoal reinforcement learning

Managing multiple goals is essential to adaptation, yet we are only beginning to understand computations by which we navigate the resource demands entailed in so doing. Here, we sought to elucidate how humans balance reward seeking and punishment avoidance goals, and relate this to variation in its expression within anxious individuals. To do so, we developed a novel multigoal pursuit task that includes trial-specific instructed goals to either pursue reward (without risk of punishment) or avoid punishment (without the opportunity for reward). We constructed a computational model of multigoal pursuit to quantify the degree to which participants could disengage from the pursuit goals when instructed to, as well as devote less model-based resources toward goals that were less abundant. In general, participants (n = 192) were less flexible in avoiding punishment than in pursuing reward. Thus, when instructed to pursue reward, participants often persisted in avoiding features that had previously been associated with punishment, even though at decision time these features were unambiguously benign. In a similar vein, participants showed no significant downregulation of avoidance when punishment avoidance goals were less abundant in the task. Importantly, we show preliminary evidence that individuals with chronic worry may have difficulty disengaging from punishment avoidance when instructed to seek reward. Taken together, the findings demonstrate that people avoid punishment less flexibly than they pursue reward. Future studies should test in larger samples whether a difficulty to disengage from punishment avoidance contributes to chronic worry.

Cross-species anxiety tests in psychiatry: pitfalls and promises

Behavioural anxiety tests in non-human animals are used for anxiolytic drug discovery, and to investigate the neurobiology of threat avoidance. Over the past decade, several of them were translated to humans with three clinically relevant goals: to assess potential efficacy of candidate treatments in healthy humans; to develop diagnostic tests or biomarkers; and to elucidate the pathophysiology of anxiety disorders. In this review, we scrutinise these promises and compare seven anxiety tests that are validated across species: five approach-avoidance conflict tests, unpredictable shock anticipation, and the social intrusion test in children. Regarding the first goal, three tests appear suitable for anxiolytic drug screening in humans. However, they have not become part of the drug development pipeline and achieving this may require independent confirmation of predictive validity and cost-effectiveness. Secondly, two tests have shown potential to measure clinically relevant individual differences, but their psychometric properties, predictive value, and clinical applicability need to be clarified. Finally, cross-species research has not yet revealed new evidence that the physiology of healthy human behaviour in anxiety tests relates to the physiology of anxiety symptoms in patients. To summarise, cross-species anxiety tests could be rendered useful for drug screening and for development of diagnostic instruments. Using these tests for aetiology research in healthy humans or animals needs to be queried and may turn out to be unrealistic.

Decision-making ability, psychopathology, and brain connectivity

Decision-making is a cognitive process of central importance for the quality of our lives. Here, we ask whether a common factor underpins our diverse decision-making abilities. We obtained 32 decision-making measures from 830 young people and identified a common factor that we call "decision acuity," which was distinct from IQ and reflected a generic decision-making ability. Decision acuity was decreased in those with aberrant thinking and low general social functioning. Crucially, decision acuity and IQ had dissociable brain signatures, in terms of their associated neural networks of resting-state functional connectivity. Decision acuity was reliably measured, and its relationship with functional connectivity was also stable when measured in the same individuals 18 months later. Thus, our behavioral and brain data identify a new cognitive construct that underpins decision-making ability across multiple domains. This construct may be important for understanding mental health, particularly regarding poor social function and aberrant thought patterns.

Perirhinal Cortex is Involved in the Resolution of Learned Approach-Avoidance Conflict Associated with Discrete Objects

The rodent ventral and primate anterior hippocampus have been implicated in approach-avoidance (AA) conflict processing. It is unclear, however, whether this structure contributes to AA conflict detection and/or resolution, and if its involvement extends to conditions of AA conflict devoid of spatial/contextual information. To investigate this, neurologically healthy human participants first learned to approach or avoid single novel visual objects with the goal of maximizing earned points. Approaching led to point gain and loss for positive and negative objects, respectively, whereas avoidance had no impact on score. Pairs of these objects, each possessing nonconflicting (positive-positive/negative-negative) or conflicting (positive-negative) valences, were then presented during functional magnetic resonance imaging. Participants either made an AA decision to score points (Decision task), indicated whether the objects had identical or differing valences (Memory task), or followed a visual instruction to approach or avoid (Action task). Converging multivariate and univariate results revealed that within the medial temporal lobe, perirhinal cortex, rather than the anterior hippocampus, was predominantly associated with object-based AA conflict resolution. We suggest the anterior hippocampus may not contribute equally to all learned AA conflict scenarios and that stimulus information type may be a critical and overlooked determinant of the neural mechanisms underlying AA conflict behavior.

Conflict between Threat Sensitivity and Sensation Seeking in the Adolescent Brain: Role of the Hippocampus, and Neurobehavioural Plasticity Induced by Pleasurable Early Enriched Experience

Adolescence is characterized both by the exacerbation of the experience of anxiety, fear or threat, on one hand, and by increased reward seeking (reward sensitivity) and risk taking on the other hand. The rise of these apparently opposite processes, i.e., threat-related anxiety and reward-related sensation seeking, seems to stem from a relatively decreased top-down inhibition of amygdala and striatal circuits by regulatory systems (e.g., prefrontal cortex, hippocampus) that mature later. The present commentary article aims to discuss recent related literature and focusses on two main issues: (i) the septo-hippocampal system (in particular the ventral hippocampus) might be a crucial region for the regulation of approach–avoidance conflict and also for the selection of the most appropriate responses during adolescence, and (ii) developmental studies involving early-life pleasurable-enriched experience (as opposed to early-life adversity) might be a useful study paradigm in order to decipher whether neuroplasticity induced by such experiences (for example, in the hippocampus and associated circuitry) may lead to better top-down inhibition and more “balanced” adolescent responses to environmental demands.

Hippocampal Representation of Threat Features and Behavior in a Human Approach-Avoidance Conflict Anxiety Task

Decisions under threat are crucial to survival and require integration of distinct situational features, such as threat probability and magnitude. Recent evidence from human lesion and neuroimaging studies implicated anterior hippocampus (aHC) and amygdala in approach-avoidance decisions under threat, and linked their integrity to cautious behavior. Here we sought to elucidate how threat dimensions and behavior are represented in these structures. Twenty human participants (11 female) completed an approach-avoidance conflict task during high-resolution fMRI. Participants could gather tokens under threat of capture by a virtual predator, which would lead to token loss. Threat probability (predator wake-up rate) and magnitude (amount of token loss) varied on each trial. To disentangle effects of threat features, and ensuing behavior, we performed a multifold parametric analysis. We found that high threat probability and magnitude related to BOLD signal in left aHC/entorhinal cortex. However, BOLD signal in this region was better explained by avoidance behavior than by these threat features. A priori ROI analysis confirmed the relation of aHC BOLD response with avoidance. Exploratory subfield analysis revealed that this relation was specific to anterior CA2/3 but not CA1. Left lateral amygdala responded to low and high, but not intermediate, threat probability. Our results suggest that aHC BOLD signal is better explained by avoidance behavior than by threat features in approach-avoidance conflict. Rather than representing threat features in a monotonic manner, it appears that aHC may compute approach-avoidance decisions based on integration of situational threat features represented in other neural structures.SIGNIFICANCE STATEMENT An effective threat anticipation system is crucial to survival across species. Natural threats, however, are diverse and have distinct features. To be able to adapt to different modes of danger, the brain needs to recognize these features, integrate them, and use them to modify behavior. Our results disclose the human anterior hippocampus as a likely arbiter of approach-avoidance decisions harnessing compound environmental information while partially replicating previous findings and blending into recent efforts to illuminate the neural basis of approach-avoidance conflict in humans.

Individual Differences in Hippocampal Volume as a Function of BMI and Reward Sensitivity

Sensitivity to reward is a personality trait that predisposes a person to several addictive behaviors, including the presence of different risky behaviors that facilitates uncontrolled eating. However, the multifactorial nature of obesity blurs a direct relationship between the two factors. Here, we studied the brain anatomic correlates of the interaction between reward sensitivity and body mass index (BMI) to investigate whether the coexistence of high BMI and high reward sensitivity structurally alters brain areas specifically involved in the regulation of eating behavior. To achieve this aim, we acquired T1-weighted images and measured reward sensitivity using the Sensitivity to Punishment and Sensitivity to Reward Questionnaire (SPSRQ) and BMI in a sample of 206 adults. Results showed that reward sensitivity and BMI were not significantly correlated. However, neuroimaging results confirmed a relationship between BMI and reduced volume in the medial and lateral orbitofrontal cortex, and between reward sensitivity and lower striatum volume. Importantly, the interaction between the two factors was significantly related to the right anterior hippocampus volume, showing that stronger reward sensitivity plus a higher BMI were associated with reduced hippocampal volume. The hippocampus is a brain structure involved in the higher-order regulation of feeding behavior. Thus, a dysfunctional hippocampus may contribute to maintaining a vicious cycle that predisposes people to obesity.

The Neural Basis of Approach-Avoidance Conflict: A Model Based Analysis

Approach-avoidance conflict arises when the drives to pursue reward and avoid harm are incompatible. Previous neuroimaging studies of approach-avoidance conflict have shown large variability in reported neuroanatomical correlates. These prior studies have generally neglected to account for potential sources of variability, such as individual differences in choice preferences and modeling of hemodynamic response during conflict. In the present study, we controlled for these limitations using a hierarchical Bayesian model (HBM). This enabled us to measure participant-specific per-trial estimates of conflict during an approach-avoidance task. We also employed a variable epoch method to identify brain structures specifically sensitive to conflict. In a sample of 28 human participants, we found that only a limited set of brain structures [inferior frontal gyrus (IFG), right dorsolateral prefrontal cortex (dlPFC), and right pre-supplementary motor area (pre-SMA)] are specifically correlated with approach-avoidance conflict. These findings suggest that controlling for previous sources of variability increases the specificity of the neuroanatomical correlates of approach-avoidance conflict.

Dopaminergic Mechanisms Underlying Normal Variation in Trait Anxiety

Trait anxiety has been associated with altered activity within corticolimbic pathways connecting the amygdala and rostral anterior cingulate cortex (rACC), which receive rich dopaminergic input. Though the popular culture uses the term "chemical imbalance" to describe the pathophysiology of psychiatric conditions such as anxiety disorders, we know little about how individual differences in human dopamine neurochemistry are related to variation in anxiety and activity within corticolimbic circuits. We addressed this issue by examining interindividual variability in dopamine release at rest using [¹¹C]raclopride positron emission tomography (PET), functional connectivity between amygdala and rACC using resting-state functional magnetic resonance imaging (fMRI), and trait anxiety measures in healthy adult male and female humans. To measure endogenous dopamine release, we collected two [¹¹C]raclopride PET scans per participant. We contrasted baseline [¹¹C]raclopride D2/3 receptor binding and D2/3 receptor binding following oral methylphenidate administration. Methylphenidate blocks the dopamine transporter, which increases extracellular dopamine and leads to reduced [¹¹C]raclopride D2/3 receptor binding via competitive displacement. We found that individuals with higher dopamine release in the amygdala and rACC self-reported lower trait anxiety. Lower trait anxiety was also associated with reduced rACC-amygdala functional connectivity at baseline. Further, functional connectivity showed a modest negative relationship with dopamine release such that reduced rACC-amygdala functional connectivity was accompanied by higher levels of dopamine release in these regions. Together, these findings contribute to hypodopaminergic models of anxiety and support the utility of combining fMRI and PET measures of neurochemical function to advance our understanding of basic affective processes in humans.SIGNIFICANCE STATEMENT It is common wisdom that individuals vary in their baseline levels of anxiety. We all have a friend or colleague we know to be more "tightly wound" than others, or, perhaps, we are the ones marveling at others' ability to "just go with the flow." Although such observations about individual differences within nonclinical populations are commonplace, the neural mechanisms underlying normal variation in trait anxiety have not been established. Using multimodal brain imaging in humans, this study takes initial steps in linking intrinsic measures of neuromodulator release and functional connectivity within regions implicated in anxiety disorders. Our findings suggest that in healthy adults, higher levels of trait anxiety may arise, at least in part, from reduced dopamine neurotransmission.

Amygdala Lesions Reduce Anxiety-like Behavior in a Human Benzodiazepine-Sensitive Approach-Avoidance Conflict Test

BACKGROUND

Rodent approach-avoidance conflict tests are common preclinical models of human anxiety disorder. Their translational validity mainly rests on the observation that anxiolytic drugs reduce rodent anxiety-like behavior. Here, we capitalized on a recently developed approach-avoidance conflict computer game to investigate the impact of benzodiazepines and of amygdala lesions on putative human anxiety-like behavior. In successive epochs of this game, participants collect monetary tokens on a spatial grid while under threat of virtual predation.

METHODS

In a preregistered, randomized, double-blind, placebo-controlled trial, we tested the effect of a single dose (1 mg) of lorazepam (n = 59). We then compared 2 patients with bilateral amygdala lesions due to Urbach-Wiethe syndrome with age- and gender-matched control participants (n = 17). Based on a previous report, the primary outcome measure was the effect of intra-epoch time (i.e., an adaptation to increasing potential loss) on presence in the safe quadrant of the spatial grid. We hypothesized reduced loss adaptation in this measure under lorazepam and in patients with amygdala lesions.

RESULTS

Lorazepam and amygdala lesions reduced loss adaptation in the primary outcome measure. We found similar results in several secondary outcome measures. The relative reduction of anxiety-like behavior in patients with amygdala lesions was qualitatively and quantitatively indistinguishable from an impact of anterior hippocampus lesions found in a previous report.

CONCLUSIONS

Our results establish the translational validity of human approach-avoidance conflict tests in terms of anxiolytic drug action. We identified the amygdala, in addition to the hippocampus, as a critical structure in human anxiety-like behavior.

Dissecting the Function of Hippocampal Oscillations in a Human Anxiety Model

Neural oscillations in hippocampus and medial prefrontal cortex (mPFC) are a hallmark of rodent anxiety models that build on conflict between approach and avoidance. Yet, the function of these oscillations, and their expression in humans, remain elusive. Here, we used magnetoencephalography (MEG) to investigate neural oscillations in a task that simulated approach–avoidance conflict, wherein 23 male and female human participants collected monetary tokens under a threat of virtual predation. Probability of threat was signaled by color and learned beforehand by direct experience. Magnitude of threat corresponded to a possible monetary loss, signaled as a quantity. We focused our analyses on an a priori defined region-of-interest, the bilateral hippocampus. Oscillatory power under conflict was linearly predicted by threat probability in a location consistent with right mid-hippocampus. This pattern was specific to the hippocampus, most pronounced in the gamma band, and not explained by spatial movement or anxiety-like behavior. Gamma power was modulated by slower theta rhythms, and this theta modulation increased with threat probability. Furthermore, theta oscillations in the same location showed greater synchrony with mPFC theta with increased threat probability. Strikingly, these findings were not seen in relation to an increase in threat magnitude, which was explicitly signaled as a quantity and induced similar behavioral responses as learned threat probability. Thus, our findings suggest that the expression of hippocampal and mPFC oscillatory activity in the context of anxiety is specifically linked to threat memory. These findings resonate with neurocomputational accounts of the role played by hippocampal oscillations in memory.

SIGNIFICANCE STATEMENT We use a biologically relevant approach–avoidance conflict test in humans while recording neural oscillations with magnetoencephalography to investigate the expression and function of hippocampal oscillations in human anxiety. Extending nonhuman studies, we can assign a possible function to hippocampal oscillations in this task, namely threat memory communication. This blends into recent attempts to elucidate the role of brain synchronization in defensive responses to threat.