The effects of intrahippocampal ibotenate on resistance to extinction after continuous or partial reinforcement

The metabotropic glutamate receptor, mGlu5, is required for extinction learning that occurs in the absence of a context change

The metabotropic glutamate (mGlu) receptors and, in particular, mGlu5 are crucially involved in multiple forms of synaptic plasticity that are believed to underlie explicit memory. MGlu5 is also required for information transfer through neuronal oscillations and for spatial memory. Furthermore, mGlu5 is involved in extinction of implicit forms of learning. This places this receptor in a unique position with regard to information encoding. Here, we explored the role of this receptor in context-dependent extinction learning under constant, or changed, contextual conditions. Animals were trained over 3 days to take a left turn under 25% reward probability in a T-maze with a distinct floor pattern (Context A). On Day 4, they experienced either a floor pattern change (Context B) or the same floor pattern (Context A) in the absence of reward. After acquisition of the task, the animals were returned to the maze once more on Day 5 (Context A, no reward). Treatment with the mGlu5 antagonist, 2-methyl-6-(phenylethynyl) pyridine, before maze exposure on Day 4 completely inhibited extinction learning in the AAA paradigm but had no effect in the ABA paradigm. A subsequent return to the original context (A, on Day 5) revealed successful extinction in the AAA paradigm, but impairment of extinction in the ABA paradigm. These data support that although extinction learning in a new context is unaffected by mGlu5 antagonism, extinction of the consolidated context is impaired. This suggests that mGlu5 is intrinsically involved in enabling learning that once-relevant information is no longer valid.

The effect of early-life stress on memory systems supporting instrumental behavior

People experiencing early-life stress (ELS) exhibit increased incidence of behaviors that lead to addiction and obesity as adults. Many of these behaviors may be viewed as resulting from an overreliance on habits as opposed to goal-directed instrumental behavior. This increased habitization may result from alterations in the interactions between dorsolateral striatum-dependent and hippocampus-dependent learning systems. As an initial examination of this idea, we investigated the effect of ELS on instrumental learning and extinction. In Experiment 1, we examined the effect of ELS in two groups of people, one trained on a continuous reinforcement schedule and one trained on a partial reinforcement schedule. We found that people who experienced ELS had a diminished effect of the partial reinforcement schedule on extinction. In Experiment 2, we again manipulated reinforcement schedule and also challenged declarative memory by requiring subjects to perform a concurrent task. We found that the declarative challenge did not affect extinction responding in the non-ELS group. In a moderate-ELS group, we observed a diminished sensitivity to the reinforcement schedule during extinction only under divided attention. In the high-ELS group, we observed a reduced sensitivity to reinforcement schedule even in the absence of the declarative memory challenge, consistent with Experiment 1. Our results suggest that ELS reduces the tendency to use declarative, hippocampus-dependent memory in instrumental tasks in favor of habits. ELS may affect hippocampal development, thus altering the interaction between memory systems and potentially contributing to poor health outcomes.

Hippocampal activation during extinction learning predicts occurrence of the renewal effect in extinction recall

The renewal effect describes the reoccurrence of a previously extinguished response in situations where the context of extinction differs from that of acquisition, thus illustrating the context-dependency of extinction learning. A number of studies on contextual fear extinction have implicated hippocampus and vmPFC in processing and retrieval of context both during extinction learning and recall of extinction. In this functional magnetic resonance imaging (fMRI) study we explored the neural correlates of the renewal effect in associative learning, using a predictive learning task that required participants to learn relations between cues and outcomes presented in particular contexts. During extinction in a novel context, compared to extinction in a context identical to the acquisition context, participants who exhibited the renewal effect (REN) showed increased activation in brain regions including bilateral posterior hippocampus and left parahippocampal gyrus. This activation pattern was absent in participants that did not show the renewal effect (NOREN). In direct comparisons between the groups, the REN group exhibited higher activation in bilateral hippocampus, while the NOREN group showed higher activation in left dlPFC (BA 46) and right anterior cingulate (BA 32). During extinction recall, stimuli that had been extinguished in a different context were again presented in the context of acquisition. Here both groups exhibited predominantly prefrontal activation, with the REN group's focus upon bilateral OFC (BA 47) and bilateral vmPFC (BA 10), while the NOREN group showed generally more widespread activation, predominantly in large clusters of dlPFC (BA 8,9,45). In a direct comparison, the REN group showed higher activation than the NOREN group in left vmPFC (BA 10), while NOREN participants exhibited more activation in dlPFC (BA 9, 46). Activation in left vmPFC during extinction recall correlated with the number of renewal effect responses, while the dlPFC activation showed a negative correlation with renewal effect responses. These results highlight the differential activation patterns of processes that will eventually produce or not produce a renewal effect, indicating that during extinction learning hippocampus encodes the relation between context and cue-outcome, while in extinction recall vmPFC is active to retrieve this association.

The neuropsychology of schizophrenia

A model is proposed for integrating the neural and cognitive aspects of the positive symptoms of acute schizophrenia, using evidence from postmortem neuropathology and neurochemistry, clinical and preclinical studies of dopaminergic neurotransmission, anatomical connections between the limbic system and basal ganglia, attentional and other cognitive abnormalities underlying the positive symptoms of schizophrenia, specific animal models of some of these abnormalities, and previous attempts to model the cognitive functions of the septohippocampal system and the motor functions of the basal ganglia. Anatomically, the model emphasises the projections from the septohippocampal system, via the subiculum, and the amygdala to nucleus accumbens, and their interaction with the ascending dopaminergic projection to the accumbens. Psychologically, the model emphasises a failure in acute schizophrenia to integrate stored memories of past regularities of perceptual input with ongoing motor programs in the control of current perception. A number of recent experiments that offer support for the model are briefly described, including anatomical studies of limbic-striatal connections, studies in the rat of the effects of damage to these connections, and of the effects of amphetamine and neuroleptics, on the partial reinforcement extinction effect, latent inhibition and the Kamin blocking effect; and studies of the latter two phenomena in acute and chronic schizophrenics.

Characterization of cognition alteration across the course of the disease in APP751SL mice with parallel estimation of cerebral Abeta deposition

Current transgenic mouse models of Alzheimer disease constitute a relevant tool to examine the relationships between neuropathological lesions, neurodegeneration and clinical syndromes. Nevertheless, addressing the relation between Abeta deposition and cognition deterioration requires careful adjustment for age to decipher underlying mechanisms of impairments and identify potential therapeutic targets. In the present work we have carried out a detailed behavioral analysis of the APP(751SL) transgenic mouse model testing 6 age-points (from 2 to 19-20 months) and estimating in parallel the cerebral Abeta deposition. The immunohistochemistry study indicated a fast progression of Abeta(17-24) staining in several brain structures that reached for most of them, a maximal level at 7-8 months of age. Behavioral experiments showed that APP(751SL) mice displayed alterations in some general functions (muscular strength, motor activity) whereas other functions are preserved (anxiety, exploration). Acquisition and extinction of an appetitive operant conditioning were used to assess early learning deficits. Hippocampal but not dorso-lateral striatal lesion was shown to delay extinction. Although some learning deficits were detected at 5-6 months in the acquisition of the operant conditioning task, more robust impairments in extinction were observed in 7-8-month-old mice. Indeed, spatial memory deficit was associated to a selective hippocampal CA1 impairment of learning-induced Zif268 activation. Because this mouse model displayed gradual memory deficits it gives the opportunity to investigate the temporal progression of molecular and cellular mechanisms that induce cognitive decline.

Hippocampal α5 subunit-containing GABAA receptors are involved in the development of the latent inhibition effect

Hippocampal GABA(A) receptors containing the alpha 5 subunit have been implicated in the modulation of hippocampal-dependent learning, presumably via their tonic inhibitory influence on hippocampal glutamatergic activity. Here, we examined the expression of latent inhibition (LI)--a form of selective learning that is sensitive to a number of manipulations targeted at the hippocampal formation, in alpha 5(H105R) mutant mice with reduced levels of hippocampal alpha 5-containing GABA(A) receptors. A single pre-exposure to the taste conditioned stimulus (CS) prior to the pairing of the same CS with LiCl-induced nausea was effective in reducing the conditioned aversion against the taste CS in wild-type mice--thus constituting the LI effect. LI was however distinctly absent in male alpha 5(H105R) mutant mice. Hence, a partial loss of hippocampal alpha 5 GABA(A) receptors is sufficient to alter one major form of selective learning, albeit this was not seen in the female. This observed phenotype suggests that specific activation of these extrasynaptic GABA(A) receptors may confer therapeutic potential against the failure to show selectivity in learning by human psychotic patients.

Use of excitotoxins to lesion the hippocampus: update

Although many of the problems associated with the use of conventional lesion techniques (aspiration, electrolytic, radiofrequency) can be avoided by employing focal injections of excitotoxins, experience gained over the past 12 years has shown that considerable care must be exercised with this newer method, to limit the cell loss to the intended area or structure. Of the toxins that have been used most often to selectively destroy the cells that comprise the hippocampus, ibotenic acid (IBO) and N-methyl-D-aspartate (NMDA) have proved to be nonspecific in their effects on different cell types and these toxins do not cause seizures. In contrast, focal injections of kainate (KA) and quisqualate result in damage that centers primarily in the CA3 pyramidal cell field and hilar cells in the dentate gyrus. In addition, there are obvious seizures and secondary distant damage involving a number of structures and areas associated with mediating seizure activity. Intrahippocampal injections of the toxin colchicine result in a preferential destruction of dentate granule cells but usually also lead to additional cell loss in adjacent areas. Attempts to limit cell loss to specific hippocampal subfields, using different toxins, have met with mixed success. Both the dosage of the agent and the volume injected are important in determining the extent of cell loss, but the volume of the toxin injected has been shown to be especially important in limiting the damage to the intended area. With the development of newer procedures (e.g., immunotoxins, gene knockouts, antisense) that permit more selective cell loss, it should be possible in the future to achieve a level of lesion control that has been lacking in the past. As with the use of excitotoxins, these newer approaches will require special care to limit the damage to the intended area and interpret the results obtained properly.

The partial reinforcement extinction effect in humans: effects of schizophrenia, schizotypy and low doses of amphetamine

The partial reinforcement extinction effect (PREE) was studied in human subjects. It has been suggested that the PREE depends on neural mechanisms critical to the cognitive dysfunction which underlines acute schizophrenia. We therefore predicted that the PREE should be reduced, through decreased resistance to extinction in the partial reinforcement (PR) condition, in various types of individual: (a) healthy volunteers given low doses of oral amphetamine; (b) those in the acute (but not chronic) phase of a schizophrenic illness and; (c) healthy volunteers with high scores on personality measures of schizotypy. Despite obtaining robust demonstrations of PREE in all experiments, none of these predictions were confirmed. A single, low dose, of amphetamine had no effect on either continuous reinforcement (CR) or partial reinforcement (PR). Acute and chronic schizophrenic patients showed a reduced PREE compared to controls. However this was due to increased resistance to extinction in the CR groups. Finally, high schizotypy scores were associated with greater PREE, attributable to both decreased extinction in the CR condition and increased extinction in the PR condition. The results of these experiments on human PREE provide no support that PREE is a valid paradigm with which to explore the cognitive dysfunction underlying schizophrenia.

Metabolic mapping of brain regions associated with behavioral extinction in preweanling rats

Fluorodeoxyglucose autoradiography, quantitative image analysis, and a multivariate tool (partial least squares) were used to assess distributed patterns of brain activation in postnatal day 17 and day 12 rat pups engaged in extinction of instrumental behavior. Pups were trained in a straight alley runway on an alternating reward schedule, or on a pseudorandom reward schedule, injected with fluorodeoxyglucose, and then shifted to continuous nonreward (extinction). Another group at each age served as handled controls. Day 17 pups trained on the alternating schedule demonstrated faster extinction rates compared to those trained on the pseudorandom schedule, a phenomenon known as the partial reinforcement extinction effect. No differences were found between day 12 groups. Partial least-squares analysis revealed age-related increases in fluorodeoxyglucose uptake across all three training conditions in the cingulate and frontal cortices, amygdala, midline thalamic nuclei, cerebellum, and in several brainstem regions. Training-related increases common to both age groups were found in the orbital frontal cortex, limbic thalamus, gigantocellular reticular nucleus, the somatosensory system, and cerebellum. Age-dependent training effects were found in the interpositus and medial cerebellar nuclei wherein fluorodeoxyglucose uptake increased in the day 12 alternation and pseudorandom groups relative to controls. Day 12 pups trained on the alternating schedule demonstrated increased uptake in the anterior dorsal thalamus relative to pseudorandom and control pups. Hence, a large-scale neural system comprised by somatosensory, cerebellar, and brainstem regions govern extinction behavior in preweanling rats. Recruitment of limbic structures may allow the older pups to modify extinction behavior based on prior learning.

Dissociable neural responses in human reward systems

Reward is one of the most important influences shaping behavior. Single-unit recording and lesion studies in experimental animals have implicated a number of regions in response to reinforcing stimuli, in particular regions of the extended limbic system and the ventral striatum. In this experiment, functional neuroimaging was used to assess neural response within human reward systems under different psychological contexts. Nine healthy volunteers were scanned using functional magnetic resonance imaging during the performance of a gambling task with financial rewards and penalties. We demonstrated neural sensitivity of midbrain and ventral striatal regions to financial rewards and hippocampal sensitivity to financial penalties. Furthermore, we show that neural responses in globus pallidus, thalamus, and subgenual cingulate were specific to high reward levels occurring in the context of increasing reward. Responses to both reward level in the context of increasing reward and penalty level in the context of increasing penalty were seen in caudate, insula, and ventral prefrontal cortex. These results demonstrate dissociable neural responses to rewards and penalties that are dependent on the psychological context in which they are experienced.

Cytotoxic lesion of the medial prefrontal cortex abolishes the partial reinforcement extinction effect, attenuates prepulse inhibition of the acoustic startle reflex and induces transient hyperlocomotion, while sparing spontaneous object recognition memory in the rat

The partial reinforcement extinction effect refers to the increase in resistance to extinction of an operant response acquired under partial reinforcement relative to that acquired under continuous reinforcement. Prepulse inhibition of the acoustic startle response refers to the reduction in startle reactivity towards an intense acoustic pulse stimulus when it is shortly preceded by a weak prepulse stimulus. These two behavioural phenomena appear to be related to different forms of attentional processes. While the prepulse inhibition effect reflects an inherent early attentional gating mechanism, the partial reinforcement extinction effect is believed to involve the development of acquired inattention, i.e. the latter requires the animals to learn about what to and what not to attend. Impairments in prepulse inhibition and the partial reinforcement extinction effect have been independently linked to the neuropsychology of attentional dysfunctions seen in schizophrenia. The proposed neural substrates underlying these behaviourial phenomena also appear to overlap considerably: both focus on the nucleus accumbens and emphasize the functional importance of its limbic afferents, including that originating from the medial prefrontal cortex, on accumbal output/activity. The present study demonstrated that cytotoxic medial prefrontal cortex lesions which typically damaged the prelimbic, the infralimbic and the dorsal anterior cingulate areas could lead to the abolition of the partial reinforcement extinction effect and the attenuation of prepulse inhibition. The lesions also resulted in a transient elevation of spontaneous locomotor activity. In contrast, the same lesions spared performance in a spontaneous object recognition memory test, in which the lesioned animals displayed normal preference for a novel object when the novel object was presented in conjunction with a familiar object seen 10 min earlier within an open field arena. The present results lend support to the hypothesis that medial prefrontal cortex dysfunction might be related to some forms of attentional abnormality central to the symptomatology of schizophrenia. Relevance of the present findings in relation to the neural substrates underlying the partial reinforcement extinction effect and prepulse inhibition is further discussed.

Extinction of behavior in infant rats: development of functional coupling between septal, hippocampal, and ventral tegmental regions

Learning of a behavior at a particular age during the postnatal period presumably occurs when the functional brain circuit mediating the behavior matures. The inability to express a learned behavior, such as inhibition, may be accounted for by the functional dissociation of brain regions comprising the circuit. In this study we tested this hypothesis by measuring brain metabolic activity, as revealed by fluorodeoxyglucose (FDG) autoradiography, during behavioral extinction in 12- and 17-d-old rat pups. Subjects were first trained on a straight alley runway task known as patterned single alternation (PSA), wherein reward and nonreward trials alternate successively. They were then injected with FDG and given 50 trials of continuous nonreward (i.e., extinction). Pups at postnatal day 12 (P12) demonstrated significantly slower extinction rates compared to their P17 counterparts, despite the fact that both reliably demonstrated the PSA effect, i.e., both age groups distinguished between reward and nonreward trials during acquisition. Covariance analysis revealed that the dentate gyrus, hippocampal fields CA1-3, subiculum, and lateral septal area were significantly correlated in P17 but not P12 pups. Significant correlations were also found between the lateral septal area, ventral tegmental area, and the medial septal nucleus in P17 pups. Similar correlative patterns were not found in P12 and P17 handled control animals. Taken together, these results suggest that septal, hippocampal, and mesencephalic regions may be functionally dissociated at P12, and the subsequent maturation of functional connectivity between these regions allows for the more rapid expression of behavioral inhibition during extinction at P17.

Effects of ibotenate hippocampal and extrahippocampal destruction on delayed-match and -nonmatch-to-sample behavior in rats

The effects of ibotenate lesions of the hippocampus (HIPP) or hippocampus plus collateral damage to extrahippocampal structures (HCX) were investigated in rats trained to criterion on spatial versions of either a delayed-match (DMS) or delayed-nonmatch-to-sample (DNMS) task. After recovery from surgery, animals were retrained at "0" sec delays, then assessed at 0-30 sec delays for 15 d, retrained again at 0 sec delays, and retested for another 25 d on 0-30 sec delays. Pretrained HIPP-lesioned animals showed marked delay-dependent deficits in both tasks that never recovered. Detailed examination of within- and between-trial performance factors, including changes in response preferences, length of previous trial delay, and sequential dependencies, revealed important factors operating in lesioned animals that were either absent or insignificant before the lesion. Pretrained HCX-lesioned animals showed deficits similar to those of HIPP animals, with the noticeable exception of a strong "recency" influence of the previous trial. Another group of HIPP- and HCX-lesioned animals trained on the tasks after the lesion showed reduced impairments of the type described above, suggesting that extrahippocampal structures trained after the lesion can assume the role of the hippocampus to some degree. The findings indicate that both the type of lesion and the previous history of the animal determine the postlesion DMS and DNMS performance of animals suffering damage to the hippocampus and/or related structures.

Unilateral lesion of dorsal hippocampus enhances reinforcing lateral hypothalamic stimulation in the contralateral hemisphere

Whereas convincing evidence exists for an important role of the hippocampus in mechanisms underlying memory and encoding of location in space, the contribution of the hippocampus to the system underlying central processes of reinforcement is less well established. Scattered data suggesting that hippocampal ablation increases the effectiveness of positive reinforcers have alternatively been interpretated in terms of general and unspecific behavioral disinhibition, which results in higher levels of activity and rates of responding. In the present experiment, 22 Wistar rats were either given a neurotoxic or a sham lesion in the CA1 region of the hippocampus, and the effect on lateral hypothalamic self-stimulation behavior was assessed. To control for nonspecific performance effects rates of lever pressing were assessed ipsi- and contralateral to the lesioned hemisphere as well as under condition of extinction (current set to zero). Following the neurotoxic lesion the animals displayed significant higher rates of self-stimulation at the electrode sites in the hypothalamus situated contralateral but not ipsilateral to the hemisphere with the lesion compared with controls. The increase in self-stimulation commenced on the third day postlesion and was maintained over the 8 days of testing. The lesion did not change the animals' behavior under extinction. Thus, the hippocampal lesion led to an amplification of rewarding lateral hypothalamic self-stimulation behavior, indicative of a lesion induced disinhibition of the brain's reinforcement system.

Loss of hippocampal CA1 neurons and learning impairment in subicular lesioned rats

30-Day-old male Wistar rats were tested for acquisition and retention of operant conditioned behavior after bilateral subicular lesions made either electrolytically or chemically (ibotenic acid). The acquisition of operant learning was carried out in lesioned rats by assessing the number of sessions required to learn the operant task, whereas the retention test was performed after lesions by assessing performance on a previously learnt operant task. The acquisition of pedal press operant learning was significantly delayed in both types of lesioned rats, without any impairment in the retention of the previously learned task after lesioning. In these animals the cell densities were quantified in cresyl violet-stained sections in different subfields of hippocampus. Following the lesion of subiculum, selective degeneration of CA1 cells without the involvement of other hippocampal subfields was observed. This might be due to the loss of target area (subiculum) through which hippocampus is connected with neocortical and subcortical structures. This, in turn, might have resulted in behavioral deficits. The data suggest that the subiculum might be involved in the acquisition of new information rather than in retention.

On the role of the hippocampus in learning and memory in the rat

An overview of lesion experiments concerned with the involvement of the hippocampus in learning and memory in the rat is presented. Multiple injections of small amounts of ibotenic acid were used to selectively remove the hippocampus (dentate gyrus, hilar cells, CA1-CA3 pyramidal cells). Similar selective, axon-sparing ibotenate lesions of hippocampus were used in a series of learning and memory experiments employing tasks that are thought to be important in hippocampal function. The performance of rats with the hippocampus removed was compared with that of control animals in the acquisition and retention of spatial versus nonspatial information, forgetting of spatial and nonspatial information, contextual learning, recognition memory and concurrent discrimination learning, and complex representational learning (conditional discrimination and negative patterning learning). The general finding that rats without a hippocampus were impaired on those tasks that required the utilization of spatial and contextual information stands in contrast with the spared performance that was found in learning about and handling (even complex) nonspatial information. Rather than support for views that emphasize a role for the hippocampus in specific memory processes (working memory, declarative memory, temporary memory buffer, configural learning), the present results are more compatible with the idea that the hippocampus plays an especially important role in processing and remembering spatial and contextual information. The limited data that are available using more selective lesions of related hippocampal formation structures (entorhinal cortex, subiculum) suggest that these structures also make important contributions to learning and memory, and that some of these contributions may be different from those made by the hippocampus.