Contributions of the hippocampus, amygdala, and dorsal striatum to the response elicited by reward reduction

Post-training intra-basolateral complex of the amygdala infusions of clenbuterol enhance memory for conditioned place preference and increase ARC protein expression in dorsal hippocampal synaptic fractions

The basolateral complex of the amygdala (BLA) is critically involved in modulation of memory by stress hormones. Noradrenergic activation of the BLA enhances memory consolidation and plays a necessary role in the enhancing or impairing effects of stress hormones on memory. The BLA is not only involved in the consolidation of aversive memories but can regulate appetitive memory formation as well. Extensive evidence suggests that the BLA is a modulatory structure that influences consolidation of arousing memories through modulation of plasticity and expression of plasticity-related genes, such as the activity regulated cytoskeletal-associated (Arc/Arg 3.1) protein, in efferent brain regions. ARC is an immediate early gene whose mRNA is localized to the dendrites and is necessary for hippocampus-dependent long-term potentiation and long-term memory formation. Post-training intra-BLA infusions of the β-adrenoceptor agonist, clenbuterol, enhances memory for an aversive task and increases dorsal hippocampus ARC protein expression following training on that task. To examine whether this function of BLA noradrenergic signaling extends to the consolidation of appetitive memories, the present studies test the effect of post-training intra-BLA infusions of clenbuterol on memory for the appetitive conditioned place preference (CPP) task and for effects on ARC protein expression in hippocampal synapses. Additionally, the necessity of increased hippocampal ARC protein expression was also examined for long-term memory formation of the CPP task. Immediate post-training intra-BLA infusions of clenbuterol (4 ng/0.2 µL) significantly enhanced memory for the CPP task. This same memory enhancing treatment significantly increased ARC protein expression in dorsal, but not ventral, hippocampal synaptic fractions. Furthermore, immediate post-training intra-dorsal hippocampal infusions of Arc antisense oligodeoxynucleotides (ODNs), which reduce ARC protein expression, prevented long-term memory formation for the CPP task. These results suggest that noradrenergic activity in the BLA influences long-term memory for aversive and appetitive events in a similar manner and the role of the BLA is conserved across classes of memory. It also suggests that the influence of the BLA on hippocampal ARC protein expression and the role of hippocampal ARC protein expression are conserved across classes of emotionally arousing memories.

Altered thalamo–cortical and occipital–parietal– temporal–frontal white matter connections in patients with anorexia and bulimia nervosa: a systematic review of diffusion tensor imaging studies

BACKGROUND

Anorexia nervosa and bulimia nervosa are complex mental disorders, and their etiology is still not fully understood. This paper reviews the literature on diffusion tensor imaging studies in patients with anorexia nervosa and bulimia nervosa to explore the usefulness of white matter microstructural analysis in understanding the pathophysiology of eating disorders.

METHODS

We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines to identify diffusion tensor imaging studies that compared patients with an eating disorder to control groups. We searched relevant databases for studies published from database inception to August 2018, using combinations of select keywords. We categorized white matter tracts according to their 3 main classes: projection (i.e., thalamo–cortical), association (i.e., occipital–parietal–temporal–frontal) and commissural (e.g., corpus callosum).

RESULTS

We included 19 papers that investigated a total of 427 participants with current or previous eating disorders and 444 controls. Overall, the studies used different diffusion tensor imaging approaches and showed widespread white matter abnormalities in patients with eating disorders. Despite differences among the studies, patients with anorexia nervosa showed mainly white matter microstructural abnormalities of thalamo–cortical tracts (i.e., corona radiata, thalamic radiations) and occipital–parietal–temporal–frontal tracts (i.e., left superior longitudinal and inferior fronto-occipital fasciculi). It was less clear whether white matter alterations persist after recovery from anorexia nervosa. Available data on bulimia nervosa were partially similar to those for anorexia nervosa.

LIMITATIONS

Study sample composition and diffusion tensor imaging analysis techniques were heterogeneous. The number of studies on bulimia nervosa was too limited to be conclusive.

CONCLUSION

White matter microstructure appears to be affected in anorexia nervosa, and these alterations may play a role in the pathophysiology of this eating disorder. Although we found white matter alterations in bulimia nervosa that were similar to those in anorexia nervosa, white matter changes in bulimia nervosa remain poorly investigated, and these findings were less conclusive. Further studies with longitudinal designs and multi-approach analyses are needed to better understand the role of white matter changes in eating disorders.

An analysis of dentate gyrus function (an update)

In this review there will be a description of the dentate gyrus (DG) neural circuitry that mediates the operation of a variety of mnemonic processes associated with dorsal and ventral DG function in rats. Dysfunction of the dorsal DG can be shown to mediate mnemonic processing of spatially based information including a) the operation of conjunctive encoding of multiple sensory inputs to determine spatial representations, b) pattern separation based on reducing interference between similar spatial locations and spatial contexts for horizontal distance between objects, vertical distance for height of objects, slope or angle of motor movements, c) importance of spatial context in object recognition and processing of shades of grey associated with the walls of the box d) temporal integration in the creation of remote memory based in part on DG neurogenesis and function of the CA3 subregion of the hippocampus. Dysfunction of the ventral DG can be shown to mediate mnemonic processing of odor and reward value based information including a) pattern separation for odors and reward value, and b) social recognition.

Advances from neuroimaging studies in eating disorders

Over the past decade, brain imaging has helped to better define eating disorder-related brain circuitry. Brain research on gray matter (GM) and white matter (WM) volumes had been inconsistent, possibly due to the effects of acute starvation, exercise, medication, and comorbidity, but newer studies have controlled for such effects. Those studies suggest larger left medial orbitofrontal gyrus rectus volume in ill adult and adolescent anorexia nervosa after recovery from anorexia nervosa, and in adult bulimia nervosa. The orbitofrontal cortex is important in terminating food intake, and altered function could contribute to self-starvation. The right insula, which processes taste but also interoception, was enlarged in ill adult and adolescent anorexia nervosa, as well as adults recovered from the illness. The fixed perception of being fat in anorexia nervosa could be related to altered insula function. A few studies investigated WM integrity, with the most consistent finding of reduced fornix integrity in anorexia and bulimia nervosa-a limbic pathway that is important in emotion but also food intake regulation. Functional brain imaging using basic sweet taste stimuli in eating disorders during the ill state or after recovery implicated repeatedly reward pathways, including insula and striatum. Brain imaging that targeted dopamine-related brain activity using taste-reward conditioning tasks suggested that this circuitry is hypersensitive in anorexia nervosa, but hyporesponsive in bulimia nervosa and obesity. Those results are in line with basic research and suggest adaptive reward system changes in the human brain in response to extremes of food intake-changes that could interfere with normalization of eating behavior.

White matter integrity and its association with affective and interpersonal symptoms in borderline personality disorder

BACKGROUND

Borderline personality disorder (BPD) is a severe psychiatric disorder involving a range of symptoms including marked affective instability and disturbances in interpersonal interactions. Neuroimaging studies are beginning to provide evidence of altered processing in fronto-limbic network deficits in the disorder, however, few studies directly examine structural connections within this circuitry together with their relation to proposed causative processes and clinical features.

METHODS

In the current study, we investigated whether individuals with BPD (n = 20) have deficits in white matter integrity compared to a matched group of healthy controls (n = 18) using diffusion tensor MRI (DTI). We hypothesized that the BPD group would have decreased fractional anisotropy (FA), a measure of white matter integrity, compared to the controls in white matter tracts connecting frontal and limbic regions, primarily the cingulum, fornix and uncinate fasciculus. We also investigated the extent to which any such deficits related to childhood adversity, as measured by the childhood trauma questionnaire, and symptom severity as measured by the Zanarini rating scale for BPD.

RESULTS

We report decreased white matter integrity in BPD versus controls in the cingulum and fornix. There were no significant relationships between FA and measures of childhood trauma. There were, however, significant associations between FA in the cingulum and clinical symptoms of anger, and in the fornix with affective instability, and measures of avoidance of abandonment from the Zanarini rating scale.

CONCLUSIONS

We report deficits within fronto-limbic connections in individuals with BPD. Abnormalities within the fornix and cingulum were related to severity of symptoms and highlight the importance of these tracts in the pathogenesis of the disorder.

Robust changes in reward circuitry during reward loss in current and former cocaine users during performance of a monetary incentive delay task

BACKGROUND

Abnormal function in reward circuitry in cocaine addiction could predate drug use as a risk factor, follow drug use as a consequence of substance-induced alterations, or both.

METHODS

We used a functional magnetic resonance imaging monetary incentive delay task (MIDT) to investigate reward-loss neural response differences among 42 current cocaine users, 35 former cocaine users, and 47 healthy subjects who also completed psychological measures and tasks related to impulsivity and reward.

RESULTS

We found various reward processing-related group differences in several MIDT phases. Across task phases we found a control > current user > former user activation pattern, except for loss outcome, where former compared with current cocaine users activated ventral tegmental area more robustly. We also found regional prefrontal activation differences during loss anticipation between cocaine-using groups. Both groups of cocaine users scored higher than control subjects on impulsivity, compulsivity and reward-punishment sensitivity factors. In addition, impulsivity-related factors correlated positively with activation in amygdala and negatively with anterior cingulate activation during loss anticipation.

CONCLUSIONS

Compared with healthy subjects, both former and current users displayed abnormal brain activation patterns during MIDT performance. Both cocaine groups differed similarly from healthy subjects, but differences between former and current users were localized to the ventral tegmental area during loss outcome and to prefrontal regions during loss anticipation, suggesting that long-term cocaine abstinence does not normalize most reward circuit abnormalities. Elevated impulsivity-related factors that relate to loss processing in current and former users suggest that these tendencies and relationships may pre-exist cocaine addiction.

Localized brain volume and white matter integrity alterations in adolescent anorexia nervosa

OBJECTIVE

The neurobiological underpinnings of anorexia nervosa (AN) are poorly understood. In this study, we tested whether brain gray matter (GM) and white matter (WM) in adolescents with AN would show alterations comparable to those in adults.

METHOD

We used magnetic resonance imaging to study GM and WM volume, and diffusion tensor imaging to assess fractional anisotropy for WM integrity in 19 adolescents with AN and 22 controls.

RESULTS

Individuals with AN showed greater left orbitofrontal, right insular, and bilateral temporal cortex GM, as well as temporal lobe WM volumes compared to controls. WM integrity in adolescents with AN was lower (lower fractional anisotropy) in fornix, posterior frontal, and parietal areas, but higher in anterior frontal, orbitofrontal, and temporal lobes. In individuals with AN, orbitofrontal GM volume correlated negatively with sweet taste pleasantness. An additional comparison of this study cohort with adult individuals with AN and healthy controls supported greater orbitofrontal cortex and insula volumes in AN across age groups.

CONCLUSIONS

This study indicates larger orbitofrontal and insular GM volumes, as well as lower fornix WM integrity in adolescents with AN, similar to adults. The pattern of larger anteroventral GM and WM volume as well as WM integrity, but lower WM integrity in posterior frontal and parietal regions may indicate that developmental factors such as GM pruning and WM growth could contribute to brain alterations in AN. The negative correlation between taste pleasantness and orbitofrontal cortex volume in individuals with AN could contribute to food avoidance in this disorder.

Development of behavioral preferences for the optimal choice following unexpected reward omission is mediated by a reduction of D2-like receptor tone in the nucleus accumbens

To survive in a dynamic environment, animals must identify changes in resource availability and rapidly apply adaptive strategies to obtain resources that promote survival. We have utilised a behavioral paradigm to assess differences in foraging strategy when resource (reward) availability unexpectedly changes. When reward magnitude was reduced by 50% (receive one reward pellet instead of two), male and female rats developed a preference for the optimal choice by the second session. However, when an expected reward was omitted (receive no reward pellets instead of one), subjects displayed a robust preference for the optimal choice during the very first session. Previous research shows that, when an expected reward is omitted, dopamine neurons phasically decrease their firing rate, which is hypothesised to decrease dopamine release preferentially affecting D2-like receptors. As robust changes in behavioral preference were specific to reward omission, we tested this hypothesis and the functional role of D1- and D2-like receptors in the nucleus accumbens in mediating the rapid development of a behavioral preference for the rewarded option during reward omission in male rats. Blockade of both receptor types had no effect on this behavior; however, holding D2-like, but not D1-like, receptor tone via infusion of dopamine receptor agonists prevented the development of the preference for the rewarded option during reward omission. These results demonstrate that avoiding an outcome that has been tagged with aversive motivational properties is facilitated through decreased dopamine transmission and subsequent functional disruption of D2-like, but not D1-like, receptor tone in the nucleus accumbens.

White matter integrity is reduced in bulimia nervosa

OBJECTIVE

To investigate brain white matter (WM) functionality in bulimia nervosa (BN) in relation to anxiety.

METHOD

Twenty-one control women (CW, mean age 27 ± 7 years) and 20 BN women (mean age 25 ± 5 years) underwent brain diffusion tensor imaging to measure fractional anisotropy (FA; an indication of WM axon integrity) and the apparent diffusion coefficient (ADC; reflecting WM cell damage).

RESULTS

FA was decreased in BN in the bilateral corona radiata extending into the posterior limb of the internal capsule, the corpus callosum, the right sub-insular WM, and right fornix. In CW but not BN, trait anxiety correlated negatively with fornix, corpus callosum, and left corona radiata FA. ADC was increased in BN compared with CW in the bilateral corona radiata, corpus callosum, inferior fronto-occipital, and uncinate fasciculus. Alterations in BN WM functionality were not due to structural brain alterations.

DISCUSSION

WM integrity is disturbed in BN, especially in the corona radiata, which has been associated with taste and brain reward processing. Whether this is a premorbid condition or an effect from the illness is yet uncertain. The relationships between WM FA and trait anxiety in CW but not BN may suggest that altered WM functionality contributes to high anxious traits in BN.

Altered fimbria-fornix white matter integrity in anorexia nervosa predicts harm avoidance

The eating disorder anorexia nervosa (AN) is associated with high anxiety. The brain mechanisms that drive those behaviors are unknown. In this study we wanted to test whether brain white matter (WM) integrity is altered in AN, and related to heightened anxiety. Sixteen adult women with AN (mean age 24 ± 7 years) and 17 healthy control women (CW, mean age 25 ± 4 years) underwent diffusion tensor imaging (DTI) of the brain. The DTI brain images were used to calculate the fractional anisotropy (FA) of WM tracts, which is a measure for WM integrity. AN individuals compared to CW showed clusters of significantly reduced FA (p<0.05, corrected) in the bilateral fimbria-fornix and the fronto-occipital fasciculus, as well as the posterior cingulum WM. In the AN group, Harm Avoidance was predicted by FA in the left and right fimbria-fornix. Those findings were not due to WM volume deficits in AN. This study indicates that WM integrity is abnormal in AN in limbic and association pathways, which could contribute to disturbed feeding, emotion processing and body perception in AN. The prediction of Harm Avoidance in AN by fimbria-fornix WM integrity suggests that this pathway may be mechanistically involved in high anxiety in AN.

The cholinergic system and neostriatal memory functions

The striatum is one of the major forebrain regions that strongly expresses muscarinic and nicotinic cholinergic receptors. This article reviews the current knowledge and our new findings about the striatal cholinoceptive organization and its role in a variety of cognitive functions. Pharmacological and genetic manipulations have indicated that the cholinergic and dopaminergic system in the striatum modulate each other's function. In addition to modulating the dopaminergic system, nicotinic cholinergic receptors facilitate GABA release, whereas muscarinic receptors attenuate GABA release. The striatal cholinergic system has also been implicated in various cognitive functions including procedural learning and intradimensional set shifting. Together, these data indicate that the cholinergic system in the striatum is involved in a diverse set of cognitive functions through interactions with other neurotransmitter systems including the dopaminergic and GABAergic systems.

Septal co-infusions of glucose with the benzodiazepine agonist chlordiazepoxide impair memory, but co-infusions of glucose with the opiate morphine do not

We have found repeatedly that medial septal (MS) infusions of glucose impair memory when co-infused with the gamma-amino butyric acid (GABA) agonist muscimol. The present experiments sought to determine whether the memory-impairing effects of this concentration of glucose would generalize to another GABA(A) receptor agonist and to an agonist from another neurotransmitter system that is known to impair memory. Specifically, we determined whether the dose of glucose that produces memory deficits when combined with muscimol in the MS would also impair memory when co-infused with the GABA(A) receptor modulator chlordiazepoxide (CDP) or the opiate morphine. Male Sprague-Dawley rats were given MS co-infusions and then 15 min later tested for spontaneous alternation or given shock avoidance training (retention tested 48 h later). The results showed that MS infusions of the higher dose of glucose with morphine did not produce memory deficits, whereas, the performance of rats given MS co-infusions of CDP with glucose was impaired. These findings suggest that the memory-impairing effects of brain glucose administration may involve an interaction with the GABA(A) receptor.

The neural basis of unconditional love

Functional neuroimaging studies have shown that romantic love and maternal love are mediated by regions specific to each, as well as overlapping regions in the brain's reward system. Nothing is known yet regarding the neural underpinnings of unconditional love. The main goal of this functional magnetic resonance imaging study was to identify the brain regions supporting this form of love. Participants were scanned during a control condition and an experimental condition. In the control condition, participants were instructed to simply look at a series of pictures depicting individuals with intellectual disabilities. In the experimental condition, participants were instructed to feel unconditional love towards the individuals depicted in a series of similar pictures. Significant loci of activation were found, in the experimental condition compared with the control condition, in the middle insula, superior parietal lobule, right periaqueductal gray, right globus pallidus (medial), right caudate nucleus (dorsal head), left ventral tegmental area and left rostro-dorsal anterior cingulate cortex. These results suggest that unconditional love is mediated by a distinct neural network relative to that mediating other emotions. This network contains cerebral structures known to be involved in romantic love or maternal love. Some of these structures represent key components of the brain's reward system.

Role of the orbitofrontal cortex and dorsal striatum in regulating the dose-related effects of self-administered cocaine

Little is known regarding which neural systems regulate dose-related changes in responses maintained by self-administered cocaine. This empirical question is important because elucidating neural systems engaged in this process could provide clues for effectively treating cocaine addiction. It has been suggested that different cocaine doses represent reinforcers of differing magnitudes, implicating the dorsal striatum or orbitofrontal cortex as important. Rats were trained to self-administer 1.0 mg/kg cocaine under a fixed-interval based second-order schedule. Next, cocaine unit doses (0.1-3.0 mg/kg) were each non-systematically available for a 5-day block of sessions. Tests (1h) were conducted on day 3 (vehicle) and day 5 (100 microg lidocaine) of each block. Lidocaine inactivation of the lateral dorsal striatum had no effect on dose-related responding or cocaine intake. In contrast, when doses along the ascending limb were available for self-administration, lidocaine inactivation of the lateral orbitofrontal cortex caused reductions in responding and cocaine intake, resulting in overall flattening of dose-response curves. This included reductions during the entire 1-h test sessions and during the interval immediately following the first cocaine infusion of test sessions. Lidocaine inactivation of the lateral orbitofrontal cortex did not alter responding during the first cocaine-free interval of test sessions, but increased the latency to the first infusion. Collectively, the findings suggest that when the amount of experience with different cocaine unit doses is limited to a few sessions, the lateral orbitofrontal cortex regulates the dose-related effects of self-administered cocaine, likely by processing information pertaining to the reinforcing value of each unit dose.

Post-training reversible inactivation of the rat's basolateral amygdala interferes with hippocampus-dependent place avoidance memory in a time-dependent manner

In this study, tetrodotoxin (TTX) inactivation was employed to evaluate the involvement of the rat's basolateral amygdala (BLA) in hippocampus-dependent spatial memory using a place avoidance learning task. Rats were trained in single 30 min session to avoid a 60 degrees segment of the stable circular (80-cm diameter) arena, entering which was punished by a mild shock. Bilateral injections of TTX or saline were made either immediately, 1 or 2h after training. Retention was tested 24h later in a 30 min extinction session. Retention was impaired when both BLA inactivated immediately or 1h after training, but not 2h after training. These data indicate that activity in the BLA, at least 60 min after training, is necessary for the post-training processing of a hippocampus-dependent place avoidance memory.

Complementary roles for the amygdala and hippocampus during different phases of appetitive information processing

Evidence collected from rodent models of memory storage suggests that rapid forms of learning engage the involvement of multiple brain regions each of which may participate in a different component of information processing. The present study used temporary inactivation of the amygdala and hippocampus during different phases of information processing on a one-trial appetitive-conditioning task to examine how these two regions might participate in the storage of appetitive memories. Male Long Evans rats were chronically implanted into the amygdala or dorsal hippocampus and food deprived. Rats were trained on a radial maze conditioned cue preference task where training occurred in one 40-min session and testing took place 24 h later. The amygdala or hippocampus was inactivated separately with muscimol (50 ng/microl) injected immediately before or after training, or immediately before testing. Saline-injected rats displayed a conditioned preference by spending more time in the arm that previously contained food than in the arm that did not contain food. Muscimol injected into the amygdala before training or testing blocked the conditioned preference. Muscimol injected into the hippocampus immediately after training blocked the conditioned preference. These results suggest that the processing of memories may require multiple contributions from separate brain systems for at least short-term (24 h) storage. The resulting output from each system may converge on a similar downstream target to influence behavior.

Reward, motivation, and emotion systems associated with early-stage intense romantic love

Early-stage romantic love can induce euphoria, is a cross-cultural phenomenon, and is possibly a developed form of a mammalian drive to pursue preferred mates. It has an important influence on social behaviors that have reproductive and genetic consequences. To determine which reward and motivation systems may be involved, we used functional magnetic resonance imaging and studied 10 women and 7 men who were intensely "in love" from 1 to 17 mo. Participants alternately viewed a photograph of their beloved and a photograph of a familiar individual, interspersed with a distraction-attention task. Group activation specific to the beloved under the two control conditions occurred in dopamine-rich areas associated with mammalian reward and motivation, namely the right ventral tegmental area and the right postero-dorsal body and medial caudate nucleus. Activation in the left ventral tegmental area was correlated with facial attractiveness scores. Activation in the right anteromedial caudate was correlated with questionnaire scores that quantified intensity of romantic passion. In the left insula-putamen-globus pallidus, activation correlated with trait affect intensity. The results suggest that romantic love uses subcortical reward and motivation systems to focus on a specific individual, that limbic cortical regions process individual emotion factors, and that there is localization heterogeneity for reward functions in the human brain.

Relative reward processing in primate striatum

Rewards are often not only valued according to their physical characteristics but also relative to other available rewards. The striatum (caudate nucleus, putamen, ventral striatum including nucleus accumbens) is involved in the organization of movement and the processing of reward information. We studied the activity of single striatal neurons in macaques that were presented with different combinations of two rewards. We found in nearly half of the investigated neurons that the processing for one reward shifted, relative to the other rewards that were available in a given trial block. The relative reward processing concerned all forms of striatal activity related to reward-predicting visual stimuli, arm movements and reception of rewards. The observed changes may provide a neural basis for the known shifts in valuation of rewarding outcomes relative to known references.

Learning-induced activation of transcription factors among multiple memory systems

Experimental evidence for multiple memory systems grew initially from reports that integrity of the medial temporal lobes is necessary for some, but not all, types of memory formation. A primary inference from many studies of multiple memory systems is that they operate independently during encoding, storage, and retrieval of information. An accumulation of recent evidence, however, suggests that multiple memory systems may interact under some conditions. At the cellular level of analysis, it is accepted widely that protein synthesis is necessary for the formation of long-term memory and recent efforts have focused on the mechanisms by which learning-induced gene transcription and translation are regulated. The present review examines learning-induced activation of transcription factors among multiple memory systems. The results indicate that studies of transcriptional regulation, in conjunction with other experimental approaches, can provide complementary lines of evidence to further understanding of the extent to which multiple memory systems are independent or interactive.

Kleptomania After Head Trauma

The purpose of this paper is to add to the growing number of reports about kleptomania occurring in relation to brain injury as well as to present the authors' findings regarding treatment strategies. The authors present two case reports of patients who developed the new onset of kleptomania after closed head trauma. Both patients had comorbid psychiatric symptoms associated with the kleptomania. Antidepressant monotherapy was not beneficial in reducing kleptomania in either patient. Kleptomanic behavior was successfully treated in both patients, however, through combination treatment using an antidepressant agent together with adjunctive cognitive behavioral therapy or adjunctive naltrexone. In one patient, single photon emission tomography showed a perfusion deficit in the left temporal lobe. Various hypotheses regarding this finding and the etiopathology of kleptomania are discussed. Review of current work in the field suggests that kleptomania is a heterogeneous disorder that shares features of both impulse and addiction disorders as well as affective spectrum disorders.

The Neural Basis of Altruistic Punishment

Many people voluntarily incur costs to punish violations of social norms. Evolutionary models and empirical evidence indicate that such altruistic punishment has been a decisive force in the evolution of human cooperation. We used H2 15O positron emission tomography to examine the neural basis for altruistic punishment of defectors in an economic exchange. Subjects could punish defection either symbolically or effectively. Symbolic punishment did not reduce the defector's economic payoff, whereas effective punishment did reduce the payoff. We scanned the subjects' brains while they learned about the defector's abuse of trust and determined the punishment. Effective punishment, as compared with symbolic punishment, activated the dorsal striatum, which has been implicated in the processing of rewards that accrue as a result of goal-directed actions. Moreover, subjects with stronger activations in the dorsal striatum were willing to incur greater costs in order to punish. Our findings support the hypothesis that people derive satisfaction from punishing norm violations and that the activation in the dorsal striatum reflects the anticipated satisfaction from punishing defectors.

Differential expression of atypical PKCs in the adult mouse brain

The protein kinase C (PKC) family of serine/threonine kinases plays a role in a variety of physiological and pathophysiological processes in the brain including development, synaptic plasticity, epilepsy, ischemia, and neuronal cell death. The subgroup of atypical PKCs (aPKCs) comprises of three members, PKCiota/lambda, PKCzeta, and PKMzeta, with high amino acid homology. We used specific RNA probes and in situ hybridization to determine the expression patterns of all the three isoforms in the adult mouse brain. PKCiota and PKMzeta were found to be broadly expressed in most of the cortex, the limbic system, and the thalamus. In contrast, PKCzeta transcription was restricted to distinct forebrain areas and the cerebellum. Here we present a first comprehensive overview of isotype-specific aPKC distribution in the central nervous system, thereby providing a solid ground for further studies on the functional implications of the different aPKCs in the neuronal system.

Encoding predicted outcome and acquired value in orbitofrontal cortex during cue sampling depends upon input from basolateral amygdala

Certain goal-directed behaviors depend critically upon interactions between orbitofrontal cortex (OFC) and basolateral amygdala (ABL). Here we describe direct neurophysiological evidence of this cooperative function. We recorded from OFC in intact and ABL-lesioned rats learning odor discrimination problems. As rats learned these problems, we found that lesioned rats exhibited marked changes in the information represented in OFC during odor cue sampling. Lesioned rats had fewer cue-selective neurons in OFC after learning; the cue-selective population in lesioned rats did not include neurons that were also responsive in anticipation of the predicted outcome; and the cue-activated representations that remained in lesioned rats were less associative and more often bound to cue identity. The results provide a neural substrate for representing acquired value and features of the predicted outcome during cue sampling, disruption of which could account for deficits in goal-directed behavior after damage to this system.

Gustatory thalamus lesions eliminate successive negative contrast in rats: evidence against a memory deficit

Successive negative contrast is the exaggerated reduction of licking that occurs when rats expecting a high-value reward are given a low-value reward. This effect is typically investigated with a 24-hr retention interval between access periods. The present experiment tested the hypothesis that the absence of successive negative contrast in rats with bilateral lesions of the gustatory thalamus (GT) is due to a memory deficit. The results argue against this hypothesis by showing that, irrespective of retention-interval duration (7.5 min, 15 min, 45 min, 180 min, or 24 hr), lesioned rats failed to show successive negative contrast. As such, the data are consistent with the alternative view that GT lesions specifically disrupt the reward comparison mechanism that underlies successive negative contrast.

Perirhinal cortex lesions impair context aversion learning

Rats with perirhinal cortex lesions were compared with sham controls on a conditional discrimination in which saccharin was paired with LiCl in context 1, but paired with saline in context 2. Perirhinal-lesioned rats were slightly slower to acquire the discrimination but reached control levels by the end of acquisition. Both groups showed transfer to familiar tap water, consuming less in context 1 than in context 2. Unlike sham rats, perirhinal rats failed to show an aversion to context 1 on a place choice test. These data provide neuroanatomical support for the postulated difference between Pavlovian conditioning and conditional learning.

Differential effects of diazepam infused into the amygdala and hippocampus on negative contrast

Behavioral suppression is observed when animals shift from a high to a lower magnitude of reward in comparison to animals that continuously receive the lower magnitude reward. As previously reported, systemic administration of benzodiazepines promotes recovery from this negative contrast. This study aimed to assess where the neural substrate(s) located in the limbic areas for diazepam to induce such recovery effects on negative contrast. With food-deprived rats, the negative contrast procedure was conducted by comparing a group consuming a 32% sucrose solution which was shifted to 4% with a group consuming only 4% sucrose throughout the experiment. Represented mainly by a decreased number of licks, the negative contrast effects were clearly shown in the control groups receiving the vehicle. Systemic injection of diazepam dose-dependently reduced this contrast. Further, this negative contrast effect was significantly attenuated by local infusion of diazepam (30 microg) into the amygdala, but no such effect was confirmed when diazepam was infused into the hippocampus. Together, the present study shows that a reliable anti-contrast effect can be induced by diazepam administration peripherally or locally infused into the amygdala. These data indicate that the amygdala is involved in the recovery effects of benzodiazepines on consummatory negative contrast.

Dorsal striatum responses to reward and punishment: effects of valence and magnitude manipulations

The goal of this research was to further our understanding of how the striatum responds to the delivery of affective feedback. Previously, we had found that the striatum showed a pattern of sustained activation after presentation of a monetary reward, in contrast to a decrease in the hemodynamic response after a punishment. In this study, we tested whether the activity of the striatum could be modulated by parametric variations in the amount of financial reward or punishment. We used an event-related fMRI design in which participants received large or small monetary rewards or punishments after performance in a gambling task. A parametric ordering of conditions was observed in the dorsal striatum according to both magnitude and valence. In addition, an early response to the presentation of feedback was observed and replicated in a second experiment with increased temporal resolution. This study further implicates the dorsal striatum as an integral component of a reward circuitry responsible for the control of motivated behavior, serving to code for such feedback properties as valence and magnitude.

Learning and memory functions of the Basal Ganglia

Although the mammalian basal ganglia have long been implicated in motor behavior, it is generally recognized that the behavioral functions of this subcortical group of structures are not exclusively motoric in nature. Extensive evidence now indicates a role for the basal ganglia, in particular the dorsal striatum, in learning and memory. One prominent hypothesis is that this brain region mediates a form of learning in which stimulus-response (S-R) associations or habits are incrementally acquired. Support for this hypothesis is provided by numerous neurobehavioral studies in different mammalian species, including rats, monkeys, and humans. In rats and monkeys, localized brain lesion and pharmacological approaches have been used to examine the role of the basal ganglia in S-R learning. In humans, study of patients with neurodegenerative diseases that compromise the basal ganglia, as well as research using brain neuroimaging techniques, also provide evidence of a role for the basal ganglia in habit learning. Several of these studies have dissociated the role of the basal ganglia in S-R learning from those of a cognitive or declarative medial temporal lobe memory system that includes the hippocampus as a primary component. Evidence suggests that during learning, basal ganglia and medial temporal lobe memory systems are activated simultaneously and that in some learning situations competitive interference exists between these two systems.

Are memories for stimulus-stimulus associations or stimulus-response associations responsible for serial-pattern learning in rats?

Previous research has provided convincing evidence that rats can learn to anticipate the individual elements of a stimulus series consisting of differing amounts of food reinforcement. Rats prepared with lesions of the dorsal striatum or hippocampus were initially trained to acquire a three-element series consisting of 21 sucrose pellets, followed by 0- and 7-pellets (Noyes standard), respectively. During the initial 30 days of training, the animals were run in two adjacent runways; the runways included either of a white, rough runway or a black, smooth runway as additional series cues. Thus, training included both floor (S-R) cues and the series (inter-item memory) cues. Anticipation was defined as faster running on the 21- than on the 7-pellet element and 7- than on the 0-pellet element. While anticipation developed more slowly in the lesion groups than in the control group, all animals eventually demonstrated the ability to track the elements of the series. Reversal of the floor cues disrupted tracking in the hippocampus-lesioned and control animals; dorsal striatum-lesioned rats were also affected but did continue tracking. As a final test, shifting the order of the series produced a marked disruption in performance in the dorsal striatum-lesioned rats but not in the hippocampus-lesioned or control rats. The results are consistent with the proposal that integrated neural mediation is required for anticipation, with a system that includes the dorsal striatum necessary for the promotion of a reinforced approach response and a system that includes the hippocampus necessary for associating and temporarily maintaining an internal record of the different elements of the stimulus series.

Tracking the hemodynamic responses to reward and punishment in the striatum

Research suggests that the basal ganglia complex is a major component of the neural circuitry that mediates reward-related processing. However, human studies have not yet characterized the response of the basal ganglia to an isolated reward, as has been done in animals. We developed an event-related functional magnetic resonance imaging paradigm to identify brain areas that are activated after presentation of a reward. Subjects guessed whether the value of a card was higher or lower than the number 5, with monetary rewards as an incentive for correct guesses. They received reward, punishment, or neutral feedback on different trials. Regions in the dorsal and ventral striatum were activated by the paradigm, showing differential responses to reward and punishment. Activation was sustained following a reward feedback, but decreased below baseline following a punishment feedback.

Differential amygdala responses to winning and losing: a functional magnetic resonance imaging study in humans

The amygdala has been shown to respond to many distinct types of affective stimuli, including reward and punishment feedback in animals. In humans, winning and losing situations can be considered as reward and punishment experiences, respectively. In this study, we used functional magnetic resonance imaging (fMRI) to measure regional brain activity when human subjects were given feedback on their performance during a simple response time task in a fictitious competitive tournament. Lexical stimuli were used to convey positive 'win' or negative 'lose' feedback. The frequency of positive and negative trials was parametrically varied by the experimenters independently from the subjects' actual performance and unbeknownst to them. The results showed that the parametric increase of winning was associated with left amygdala activation whereas the parametric increase of losing was associated with right amygdala activation. These findings provide functional evidence that the human amygdala differentially responds to changes in magnitude of positive or negative reinforcement conveyed by lexical stimuli.