Activation of extracellular signal-regulated kinase (ERK) and ΔFosB in emotion-associated neural circuitry after asymptotic levels of active avoidance behavior are attained

Weaker situations: Uncertainty reveals individual differences in learning: Implications for PTSD

Few individuals who experience trauma develop posttraumatic stress disorder (PTSD). Therefore, the identification of individual differences that signal increased risk for PTSD is important. Lissek et al. (2006) proposed using a weak rather than a strong situation to identify individual differences. A weak situation involves less-salient cues as well as some degree of uncertainty, which reveal individual differences. A strong situation involves salient cues with little uncertainty, which produce consistently strong responses. Results from fear conditioning studies that support this hypothesis are discussed briefly. This review focuses on recent findings from three learning tasks: classical eyeblink conditioning, avoidance learning, and a computer-based task. These tasks are interpreted as weaker learning situations in that they involve some degree of uncertainty. Individual differences in learning based on behavioral inhibition, which is a risk factor for PTSD, are explored. Specifically, behaviorally inhibited individuals and rodents (i.e., Wistar Kyoto rats), as well as individuals expressing PTSD symptoms, exhibit enhanced eyeblink conditioning. Behaviorally inhibited rodents also demonstrate enhanced avoidance responding (i.e., lever pressing). Both enhanced eyeblink conditioning and avoidance are most evident with schedules of partial reinforcement. Behaviorally inhibited individuals also performed better on reward and punishment trials than noninhibited controls in a probabilistic category learning task. Overall, the use of weaker situations with uncertain relationships may be more ecologically valid than learning tasks in which the aversive event occurs on every trial and may provide more sensitivity for identifying individual differences in learning for those at risk for, or expressing, PTSD symptoms.

Inhibited Personality Temperaments Translated Through Enhanced Avoidance and Associative Learning Increase Vulnerability for PTSD

Although many individuals who experience a trauma go on to develop post-traumatic stress disorder (PTSD), the rate of PTSD following trauma is only about 15-24%. There must be some pre-existing conditions that impart increased vulnerability to some individuals and not others. Diathesis models of PTSD theorize that pre-existing vulnerabilities interact with traumatic experiences to produce psychopathology. Recent work has indicated that personality factors such as behavioral inhibition (BI), harm avoidance (HA), and distressed (Type D) personality are vulnerability factors for the development of PTSD and anxiety disorders. These personality temperaments produce enhanced acquisition or maintenance of associations, especially avoidance, which is a criterion symptom of PTSD. In this review, we highlight the evidence for a relationship between these personality types and enhanced avoidance and associative learning, which may increase risk for the development of PTSD. First, we provide the evidence confirming a relationship among BI, HA, distressed (Type D) personality, and PTSD. Second, we present recent findings that BI is associated with enhanced avoidance learning in both humans and animal models. Third, we will review evidence that BI is also associated with enhanced eyeblink conditioning in both humans and animal models. Overall, data from both humans and animals suggest that these personality traits promote enhanced avoidance and associative learning, as well as slowing of extinction in some training protocols, which all support the learning diathesis model. These findings of enhanced learning in vulnerable individuals can be used to develop objective behavioral measures to pre-identify individuals who are more at risk for development of PTSD following traumatic events, allowing for early (possibly preventative) intervention, as well as suggesting possible therapies for PTSD targeted on remediating avoidance or associative learning. Future work should explore the neural substrates of enhanced avoidance and associative learning for behaviorally inhibited individuals in both the animal model and human participants.

A New Paradigm for Evaluating Avoidance/Escape Motivation

BACKGROUND

Organisms have evolved to approach pleasurable opportunities and to avoid or escape from aversive experiences. These 2 distinct motivations are referred to as approach and avoidance/escape motivations and are both considered vital for survival. Despite several recent advances in understanding the neurobiology of motivation, most studies addressed approach but not avoidance/escape motivation. Here we develop a new experimental paradigm to quantify avoidance/escape motivation and examine the pharmacological validity.

METHODS

We set up an avoidance variable ratio 5 task in which mice were required to press a lever for variable times to avoid an upcoming aversive stimulus (foot shock) or to escape the ongoing aversive event if they failed to avoid it. We i.p. injected ketamine (0, 1, or 5 mg/kg) or buspirone (0, 5, or 10 mg/kg) 20 or 30 minutes before the behavioral task to see if ketamine enhanced avoidance/escape behavior and buspirone diminished it as previously reported.

RESULTS

We found that the performance on the avoidance variable ratio 5 task was sensitive to the intensity of the aversive stimulus. Treatment with ketamine increased while that with buspirone decreased the probability of avoidance from an aversive stimulus in the variable ratio 5 task, being consistent with previous reports.

CONCLUSION

Our new paradigm will prove useful for quantifying avoidance/escape motivation and will contribute to a more comprehensive understanding of motivation.

Progressive Seizure Aggravation in the Repeated 6-Hz Corneal Stimulation Model Is Accompanied by Marked Increase in Hippocampal p-ERK1/2 Immunoreactivity in Neurons

The 6-Hz corneal stimulation test is used to screen novel antiepileptic molecules to overcome the problem of drug refractoriness. Although recognized as a standard test, it has been evaluated only recently in the attempt to characterize the putative neuronal networks involved in seizures caused by corneal stimulation. In particular, by recording from the CA1 region we previously established that the hippocampus participates to propagation of seizure activity. However, these findings were not corroborated by using markers of neuronal activation such as FosB/ΔFosB antigens. In view of this discrepancy, we performed new experiments to characterize the changes in levels of phosphorylated extracellular signal-regulated kinases1/2 (p-ERK1/2), which are also used as markers of neuronal activation. To this aim, mice underwent corneal stimulation up to three different times, in three sessions separated by an interval of 3 days. To characterize a group in which seizures could be prevented by pharmacological treatment, we also considered pretreatment with the ghrelin receptor antagonist EP-80317 (330 μg/kg). Control mice were sham-treated. Video electrocorticographic (ECoG) recordings were obtained from mice belonging to each group of treatment. Animals were finally used to characterize the immunoreactivity for FosB/ΔFosB and p-ERK1/2 in the hippocampus. As previously shown, FosB/ΔFosB levels were highly increased throughout the hippocampus by the first induced seizure but, in spite of the progressively increased seizure severity, they were restored to control levels after the third stimulation. At variance, corneal stimulation caused a progressive increase in p-ERK1/2 immunoreactivity all over the hippocampus, especially in CA1, peaking in the third session. Predictably, EP-80317 administration reduced both duration and severity of seizures, prevented the increase in FosB/ΔFosB levels in the first session, and partially counteracted the increase in p-ERK1/2 levels in the third session. The vast majority of p-ERK1/2 immunopositive cells were co-labeled with FosB/ΔFosB antibodies, suggesting the existence of a relationship between the investigated markers in a subpopulation of neurons activated by seizures. These findings suggest that p-ERK1/2 are useful markers to define the aggravation of seizures and the response to anticonvulsant treatments. In particular, p-ERK1/2 expression clearly identified the involvement of hippocampal regions during seizure aggravation in the 6-Hz model.

A Window on the Study of Aversive Instrumental Learning: Strains, Performance, Neuroendocrine, and Immunologic Systems

The avoidance response is present in pathological anxiety and interferes with normal daily functions. The aim of this article is to shed light on performance markers of active avoidance (AA) using two different rat strains, Sprague-Dawley (SD) and Wistar. Specifically, good and poor performers were evaluated regarding anxiety traits exhibited in the elevated plus maze (EPM) and corticosterone levels and motor activity in the open field test. In addition, the plasma levels of Interleukin-6 (IL-6), Interleukin-1Beta (IL-1beta), Nerve Growth Factor Beta (NGF-beta), Tumor Necrosis Factor-Alpha (TNF-alpha) and cytokine-induced neutrophil chemoattractant 1 (CINC-1) were compared in the good and poor performers to better understand the role of the immunologic system in aversive learning. Behavioral criteria were employed to identify subpopulations of SD and Wistar rats based on their behavioral scores during a two-way AA test. The animals were tested for anxiety-like behavior in the EPM and motor activity in the open-field test. Plasma corticosterone levels were measured at the end of the avoidance test. Cytokine levels of IL-6, IL-1beta, NGF-beta, TNF-alpha, and CINC-1 were measured in the plasma of the Wistar rats. Sixty-six percent of the Wistar rats and 35% of the SD rats exhibited a poor performance. This feature was associated with a decrease in anxiety-like behavior in the EPM. The poor and good performers exhibited lower levels of corticosterone compared with the control animals, which suggests that training alters corticosterone levels, thereby leading to hypocortisolism, independent of the performance. The CINC-1 levels were increased in the poor performers, which reinforces the role of immunologic system activation in learning deficits. Our study provides a better understanding of the complex interactions that underlie neuroimmune consequences and their implications for performance.

Paired-housing selectively facilitates within-session extinction of avoidance behavior, and increases c-Fos expression in the medial prefrontal cortex, in anxiety vulnerable Wistar-Kyoto rats

OBJECTIVE

The perseveration of avoidance behavior, even in the absence of once threatening stimuli, is a key feature of anxiety and related psychiatric conditions. This phenomenon can be observed in the Wistar-Kyoto (WKY) rat which, in comparison to outbred controls, demonstrates impaired extinction of avoidance behavior. Also characteristic of the WKY rat is abnormalities of the neurocircuitry and neuroplasticity of the medial prefrontal cortex (mPFC). One means of reducing physiological responses to anxiety, and conditioned fear, in social species is the presence of a conspecific animal. The current study investigates whether or not pair-housed WKY rats would show facilitated extinction of avoidance in comparison to individual-housed WKY rats, and whether or not pair-housing influences mPFC activation during lever-press avoidance.

METHODS

Male WKY rats were assigned to individual-housed and pair-housed conditions. Rats were trained in lever-press avoidance. Each session of lever-press avoidance consisted of 20 trials, where pressing a lever in response to a warning tone prevented foot-shocks. Rats received 12 acquisition sessions over 4weeks; followed by 6 extinction sessions over 2weeks, where foot-shocks ceased to be delivered. Brains were harvested 90min after trials 1 and 10 of extinction sessions 1 and 6, and mPFC sections underwent c-Fos staining as a measure of activation.

RESULTS

Pair-housed rats showed facilitated lever-press avoidance extinction rates, but the main cause for this overall difference was a selective facilitation of within-session extinction. Similar to individual-housed rats, pair-housed rats continued to avoid during trial 1 of extinction even when the avoidance responding had been significantly reduced by the end of the previous session. Pair-housed rats sacrificed on trial 1 showed greater c-Fos expression in the anterior cingulate cortex and prelimbic cortex subregions of the mPFC compared individual-housed rats sacrificed on trial 1.

CONCLUSION

This data shows pair-housing to facilitate the extinction of avoidance, and to influence activity of the mPFC, in WKY rats. Despite this environmental manipulation, the pair-housed WKY rats continued to show avoidance responding on trial 1 of extinction sessions. This demonstrates that within-session extinction can be dissociated from between-session extinction-resistance in WKY rats. Furthermore, it suggests the individual-housing of WKY rats selectively slows within-session extinction, possibly by reducing neuronal activity of the mPFC during the testing situation.

Altered activity of the medial prefrontal cortex and amygdala during acquisition and extinction of an active avoidance task

Altered medial prefrontal cortex (mPFC) and amygdala function is associated with anxiety-related disorders. While the mPFC-amygdala pathway has a clear role in fear conditioning, these structures are also involved in active avoidance. Given that avoidance perseveration represents a core symptom of anxiety disorders, the neural substrate of avoidance, especially its extinction, requires better understanding. The present study was designed to investigate the activity, particularly, inhibitory neuronal activity in mPFC and amygdala during acquisition and extinction of lever-press avoidance in rats. Neural activity was examined in the mPFC, intercalated cell clusters (ITCs) lateral (LA), basal (BA) and central (CeA) amygdala, at various time points during acquisition and extinction, using induction of the immediate early gene product, c-Fos. Neural activity was greater in the mPFC, LA, BA, and ITC during the extinction phase as compared to the acquisition phase. In contrast, the CeA was the only region that was more activated during acquisition than during extinction. Our results indicate inhibitory neurons are more activated during late phase of acquisition and extinction in the mPFC and LA, suggesting the dynamic involvement of inhibitory circuits in the development and extinction of avoidance response. Together, these data start to identify the key brain regions important in active avoidance behavior, areas that could be associated with avoidance perseveration in anxiety disorders.

Improved Stress Control in Serotonin Transporter Knockout Rats: Involvement of the Prefrontal Cortex and Dorsal Raphe Nucleus

Variations in serotonin transporter (5-HTT) expression have been associated with altered sensitivity to stress. Since controllability is known to alter the impact of a stressor through differential activation of the medial prefrontal cortex (mPFC) and dorsal raphe nucleus (DRN), and that these regions are functionally affected by genetic 5-HTT down-regulation, we hypothesized that 5-HTT expression modulates the effect of controllability on stressor impact and coping. Here, we investigated the effects of a signaled stress controllability task or a yoked uncontrollable stressor on behavioral responding and mPFC and DRN activation. 5-HTT(-/-) rats proved better capable of acquiring the active avoidance task than 5-HTT(+/+) animals. Controllability determined DRN activation in 5-HTT(+/+), but not 5-HTT(-/-), rats, whereas controllability-related activation of the mPFC was independent of genotype. These findings suggest that serotonergic activation in the DRN is involved in stress coping in a 5-HTT expression dependent manner, whereas mPFC activation seems to be implicated in control over stress independently of 5-HTT expression. We speculate that alterations in serotonergic feedback in the DRN might be a potential mechanism driving this differential stress coping.

The nature of individual differences in inhibited temperament and risk for psychiatric disease: A review and meta-analysis

What makes us different from one another? Why does one person jump out of airplanes for fun while another prefers to stay home and read? Why are some babies born with a predisposition to become anxious? Questions about individual differences in temperament have engaged the minds of scientists, psychologists, and philosophers for centuries. Recent technological advances in neuroimaging and genetics provide an unprecedented opportunity to answer these questions. Here we review the literature on the neurobiology of one of the most basic individual differences-the tendency to approach or avoid novelty. This trait, called inhibited temperament, is innate, heritable, and observed across species. Importantly, inhibited temperament also confers risk for psychiatric disease. Here, we provide a comprehensive review of inhibited temperament, including neuroimaging and genetic studies in human and non-human primates. We conducted a meta-analysis of neuroimaging findings in inhibited humans that points to alterations in a fronto-limbic-basal ganglia circuit; these findings provide the basis of a model of inhibited temperament neurocircuitry. Lesion and neuroimaging studies in non-human primate models of inhibited temperament highlight roles for the amygdala, hippocampus, orbitofrontal cortex, and dorsal prefrontal cortex. Genetic studies highlight a role for genes that regulate neurotransmitter function, such as the serotonin transporter polymorphisms (5-HTTLPR), as well as genes that regulate stress response, such as corticotropin-releasing hormone (CRH). Together these studies provide a foundation of knowledge about the genetic and neural substrates of this most basic of temperament traits. Future studies using novel imaging methods and genetic approaches promise to expand upon these biological bases of inhibited temperament and inform our understanding of risk for psychiatric disease.

ITI-Signals and Prelimbic Cortex Facilitate Avoidance Acquisition and Reduce Avoidance Latencies, Respectively, in Male WKY Rats

As a model of anxiety disorder vulnerability, male Wistar-Kyoto (WKY) rats acquire lever-press avoidance behavior more readily than outbred Sprague-Dawley rats, and their acquisition is enhanced by the presence of a discrete signal presented during the inter-trial intervals (ITIs), suggesting that it is perceived as a safety signal. A series of experiments were conducted to determine if this is the case. Additional experiments investigated if the avoidance facilitation relies upon processing through medial prefrontal cortex (mPFC). The results suggest that the ITI-signal facilitates acquisition during the early stages of the avoidance acquisition process, when the rats are initially acquiring escape behavior and then transitioning to avoidance behavior. Post-avoidance introduction of the visual ITI-signal into other associative learning tasks failed to confirm that the visual stimulus had acquired the properties of a conditioned inhibitor. Shortening the signal from the entirety of the 3 min ITI to only the first 5 s of the 3 min ITI slowed acquisition during the first four sessions, suggesting the flashing light (FL) is not functioning as a feedback signal. The prelimbic (PL) cortex showed greater activation during the period of training when the transition from escape responding to avoidance responding occurs. Only combined PL + infralimbic cortex lesions modestly slowed avoidance acquisition, but PL-cortex lesions slowed avoidance response latencies. Thus, the FL ITI-signal is not likely perceived as a safety signal nor is it serving as a feedback signal. The functional role of the PL-cortex appears to be to increase the drive toward responding to the threat of the warning signal. Hence, avoidance susceptibility displayed by male WKY rats may be driven, in part, both by external stimuli (ITI signal) as well as by enhanced threat recognition to the warning signal via the PL cortex.

Avoidance as expectancy in rats: sex and strain differences in acquisition

Avoidance is a core feature of anxiety disorders and factors which increase avoidance expression or its resistance represent a source of vulnerability for anxiety disorders. Outbred female Sprague Dawley (SD) rats and inbred male and female Wistar-Kyoto (WKY) rats expressing behaviorally inhibited (BI) temperament learn avoidance faster than male SD rats. The training protocol used in these studies had a longstanding interpretive flaw: a lever-press had two outcomes, termination of the warning signal (WS) and prevention of foot shock. To disambiguate between these two explanations, we conducted an experiment in which: (a) a lever-press terminated the WS and prevented shock, and (b) a lever-press only prevented shock, but did not influence the duration of the WS. Thus, a 2 × 2 × 2 (Strain × Sex × Training) design was employed to assess the degree to which the response contingency of the WS termination influenced acquisition. Male and female SD and WKY rats were matched on acoustic startle reactivity within strain and sex and randomly assigned to the training procedures. In addition, we assessed whether the degree of avoidance acquisition affected estrus cycling in female rats. Consistent with earlier work, avoidance performance of female rats was generally superior to males and WKY rats were superior to SD rats. Moreover, female SD and male WKY rats were roughly equivalent. Female sex and BI temperament were confirmed as vulnerability factors in faster acquisition of avoidance behavior. Avoidance acquisition disrupted estrus cycling with female WKY rats recovering faster than female SD rats. Although termination of the WS appears to be reinforcing, male and female WKY rats still achieved a high degree (greater than 80% asymptotic performance) of avoidance in the absence of the WS termination contingency. Such disambiguation will facilitate determination of the neurobiological basis for avoidance learning and its extinction.

Learned stressor resistance requires extracellular signal-regulated kinase in the prefrontal cortex

Behaviorally controllable stressors confer protection from the neurochemical and behavioral consequences of future uncontrollable stressors, a phenomenon termed “behavioral immunization”. Recent data implicate protein synthesis within the ventromedial prefrontal cortex (mPFC) as critical to behavioral immunization. Adult, male Sprague-Dawley rats were exposed to a series of controllable tailshocks and 1 week later to uncontrollable tailshocks, followed 24 h later by social exploration and shuttlebox escape tests. To test the involvement of N-methyl-D-aspartate receptors (NMDARs) and the extracellular signal-regulated kinase (ERK) cascade in behavioral immunization, either D-AP5 or the MEK inhibitor U0126 was injected to the prelimbic (PL) or infralimbic (IL) mPFC prior to controllable stress exposure. Phosphorylated ERK and P70S6K, regulators of transcription and translation, were quantified by Western blot or immunohistochemistry after controllable or uncontrollable tailshocks. Prior controllable stress prevented the social exploration and shuttlebox performance deficits caused by the later uncontrollable stressor, and this effect was blocked by injections of D-AP5 into mPFC. A significant increase in phosphorylated ERK1 and ERK2, but not P70S6K, occurred within the PL and IL in rats exposed to controllable stress, but not to uncontrollable stress. However, U0126 only prevented behavioral immunization when injected to the PL. We provide evidence that NMDAR and ERK dependent signaling within the PL region is required for behavioral immunization, a learned form of stressor resistance.

Effects of psychotropic agents on extinction of lever-press avoidance in a rat model of anxiety vulnerability

Avoidance and its perseveration represent key features of anxiety disorders. Both pharmacological and behavioral approaches (i.e., anxiolytics and extinction therapy) have been utilized to modulate avoidance behavior in patients. However, the outcome has not always been desirable. Part of the reason is attributed to the diverse neuropathology of anxiety disorders. Here, we investigated the effect of psychotropic drugs that target various monoamine systems on extinction of avoidance behavior using lever-press avoidance task. Here, we used the Wistar-Kyoto (WKY) rat, a unique rat model that exhibits facilitated avoidance and extinction resistance along with malfunction of the dopamine (DA) system. Sprague Dawley (SD) and WKY rats were trained to acquire lever-press avoidance. WKY rats acquired avoidance faster and to a higher level compared to SD rats. During pharmacological treatment, bupropion and desipramine (DES) significantly reduced avoidance response selectively in WKY rats. However, after the discontinuation of drug treatment, only those WKY rats that were previously treated with DES exhibited lower avoidance response compared to the control group. In contrast, none of the psychotropic drugs facilitated avoidance extinction in SD rats. Instead, DES impaired avoidance extinction and increased non-reinforced response in SD rats. Interestingly, paroxetine, a widely used antidepressant and anxiolytic, exhibited the weakest effect in WKY rats and no effects at all in SD rats. Thus, our data suggest that malfunctions in brain catecholamine system could be one of the underlying etiologies of anxiety-like behavior, particularly avoidance perseveration. Furthermore, pharmacological manipulation targeting DA and norepinephrine may be more effective to facilitate extinction learning in this strain. The data from the present study may shed light on new pharmacological approaches to treat patients with anxiety disorders who are not responding to serotonin re-uptake inhibitors.

Absence of "Warm-Up" during Active Avoidance Learning in a Rat Model of Anxiety Vulnerability: Insights from Computational Modeling

Avoidance behaviors, in which a learned response causes omission of an upcoming punisher, are a core feature of many psychiatric disorders. While reinforcement learning (RL) models have been widely used to study the development of appetitive behaviors, less attention has been paid to avoidance. Here, we present a RL model of lever-press avoidance learning in Sprague-Dawley (SD) rats and in the inbred Wistar Kyoto (WKY) rat, which has been proposed as a model of anxiety vulnerability. We focus on “warm-up,” transiently decreased avoidance responding at the start of a testing session, which is shown by SD but not WKY rats. We first show that a RL model can correctly simulate key aspects of acquisition, extinction, and warm-up in SD rats; we then show that WKY behavior can be simulated by altering three model parameters, which respectively govern the tendency to explore new behaviors vs. exploit previously reinforced ones, the tendency to repeat previous behaviors regardless of reinforcement, and the learning rate for predicting future outcomes. This suggests that several, dissociable mechanisms may contribute independently to strain differences in behavior. The model predicts that, if the “standard” inter-session interval is shortened from 48 to 24 h, SD rats (but not WKY) will continue to show warm-up; we confirm this prediction in an empirical study with SD and WKY rats. The model further predicts that SD rats will continue to show warm-up with inter-session intervals as short as a few minutes, while WKY rats will not show warm-up, even with inter-session intervals as long as a month. Together, the modeling and empirical data indicate that strain differences in warm-up are qualitative rather than just the result of differential sensitivity to task variables. Understanding the mechanisms that govern expression of warm-up behavior in avoidance may lead to better understanding of pathological avoidance, and potential pathways to modify these processes.

Anxiety vulnerability in women: a two-hit hypothesis

Females are twice as likely to develop an anxiety disorder compared to males, and thus, are believed to possess an innate vulnerability that increases their susceptibility to develop an anxiety disorder. However, studies using aversive learning paradigms to model anxiety disorders in humans and animals have revealed contradictory results. While females exhibit the ability to rapidly acquire stimulus-response associations, which may result from a greater attentional bias towards threat, females are also capable to readily extinguish these associations. Thus, there is little evidence to suggest that the female sex represents a vulnerability factor of anxiety, per se. However, if females are to possess a second vulnerability factor that increases the inflexibility of stimulus-response associations, then an anxiety disorder may be more likely to develop. Behavioral inhibition (BI) is a vulnerability factor associated with the formation of inflexible stimulus-response associations. In this "two hit" model of anxiety vulnerability, females possessing a BI temperament will rapidly acquire stimulus-response associations that are resistant to extinction, resulting in the development of an anxiety disorder. In this review we explore evidence for a "two-hit" hypothesis underlying anxiety vulnerability in females. We explore the literature for evidence of a sex difference in attentional bias towards threat that may lead to the facilitated acquisition of stimulus-response associations in females. We also provide evidence that BI is associated with inflexible stimulus-response association formation. We conclude with data generated from our laboratory that highlights the additive effect of the female sex and behavioral inhibition vulnerabilities using a model behavior for anxiety disorder-susceptibility, active avoidance.