Latent inhibition of conditioned dopamine release in rat nucleus accumbens

Consciousness does not seem to be linked to a single neural mechanism

On the basis of neuropsychological evidence, it is clear that attention should be given a role in any model (or conjecture) of consciousness. What is known about the many instances of dissociation between explicit and implicit knowledge after brain damage suggests that conscious experience might not be linked to a restricted area of the brain. Even if it were true that there is a single brain area devoted to consciousness, the subicular area would seem to be an unlikely possibility.

Segmentalized consciousness in schizophrenia

Segmentalized consciousness in schizophrenia reflects a loss of the normal Gestalt organization and contextualization of perception. Grays model explains such segmentalization in terms of septohippocampal dysfunction, which is consistent with known neuropsychological impairment in schizophrenia. However, other considerations suggest that everyday perception and its failure in schizophrenia also involve prefrontal executive mechanisms, which are only minimally elaborated by Gray.

Unitary consciousness requires distributed comparators and global mappings

Gray, like other recent authors, seeks a scientific approach to consciousness, but fails to provide a biologically convincing description, partly because he implicitly bases his model on a computationalist foundation that embeds the contents of thought in irreducible symbolic representations. When patterns of neural activity instantiating conscious thought are shorn of homuncular observers, it appears most likely that these patterns and the circuitry that compares them with memories and plans should be found distributed over large regions of neocortex.

On seeking the mythical fountain of consciousness

Because consciousness has an organizational, or functional, center, Gray supposes that there must be a corresponding physical center in the brain. He proposes further that since this center generates consciousness, ablating it would eliminate consciousness, while leaving behavior intact. But the center of consciousness is simply the product of the functional linkages among sensory input, memory, inner speech, and so on, and behavior.

Prospects for a cognitive neuroscience of consciousness

In this commentary, I point out some weaknesses in Gray's target article and, in the light of that discussion, I attempt to delineate the kinds of problem a cognitive neuroscience of consciousness faces on its way to a scientific understanding of subjective experience.

Septohippocampal comparator: Consciousness generator or attention feedback loop?

As Gray insists, his comparator model proposes a brute correlation only – of consciousness with septohippocampal output. I suggest that the comparator straddles a feedback loop that boosts the activation ofnovelrepresentations, thus helping them feature in present or recollected experience. Such a role in organizing conscious contents would transcend correlation and help explain how consciousness emerges from brain function.

Perspective, reflection, transparent explanation, and other minds

Perspective and reflection (whether involving conceptual or nonconceptual content) have each been considered in some way basic to phenomenal consciousness. Each has possible evolutionary value, though neither seems sufficient for consciousness. Consider an account of consciousness in terms of the combination of perspective and reflection, its relationship to the problem of other minds, and its capacity to inherit evolutionary explanation from its components.

Psychopathology and the discontinuity of conscious experience

It is accepted that “primary awareness” may emerge from the integration of two classes of information. It is unclear, however, why this cannot take place within the comparator rather than in conjunction with feedback to the perceptual systems. The model has plausibility in relation to the continuity of conscious experience in the normal waking state and may be extended to encompass certain aspects of the “sense of self” which are frequently disrupted in psychotic patients.

Consciousness, memory, and the hippocampal system: What kind of connections can we make?

Gray's account is remarkable in its depth and scope but too little attention is paid to poor correspondences with the literature on hippocampal/subicular damage, the theta rhythm, and novelty detection. An alternative account, focusing on hippocampal involvement in organizing memories in a way that makes them accessible to conscious recollection but not in access to consciousness per se, avoids each of these limitations.

Communication and consciousness: A neural network conjecture

The communicative aspects of the contents of consciousness are analyzed in the framework of a neural network model of animal communication. We discuss some issues raised by Gray, such as the control of the contents of consciousness, the adaptive value of consciousness, conscious and unconscious behaviors, and the nature of a model's consciousness.

Overworking the hippocampus

The postulated hippocampal comparator, like any other subsystem, must rely on “syntactic” patterns in its “input,” and hence could not have the extraordinary powers Gray supposes. It may play a more modest role, but it is not the place “where it all comes together” for consciousness.

Consciousness and its (dis)contents

The first claim in the target article was that there is as yet no transparent, causal account of the relations between consciousness and brain-and-behaviour. That claim remains firm. The second claim was that the contents of consciousness consist, psychologically, of the outputs of a comparator system; the third consisted of a description of the brain mechanisms proposed to instantiate the comparator. In order to defend these claims against criticism, it has been necessary to clarify the distinction between consciousness-as-such and the contents of consciousness, to widen the description of the neural machinery instantiating the comparator system, and to clarify the relationship between the contents of consciousness in the here-and-now and episodic memory.

The contents of consciousness: A neuropsychological conjecture

Drawing on previous models of anxiety, intermediate memory, the positive symptoms of schizophrenia, and goal-directed behaviour, a neuropsychological hypothesis is proposed for the generation of the contents of consciousness. It is suggested that these correspond to the outputs of a comparator that, on a moment-by-moment basis, compares the current state of the organism's perceptual world with a predicted state. An outline is given of the information-processing functions of the comparator system and of the neural systems which mediate them. The hypothesis appears to be able to account for a number of key features of the contents of consciousness. However, it is argued that neitherthis nor any existing comparable hypothesis is yet able to explain why the brain should generate conscious experience of any kind at all.

The elusive quale

If sensations were behaviorally conceived, as they should be, as complex functional patterns of interaction between overt behavior and the environment, there would be no point in searching for them as instantaneous psychic elements (qualia) within the brain or as internal products of the brain.

Information synthesis in cortical areas as an important link in brain mechanisms of mind

To explore the mechanism of sensation correlations between EP (evoked potential) component amplitude and signal detection indices (d' and criterion) were studied. The time of sensation coincided with the peak latency of those EP components that showed a correlation with both indices. The components presumably reflected information synthesis in projection cortical neurons. A mechanism providing the synthesis process is proposed.

The limits of neurophysiological models of consciousness

This commentary elaborates on Gray's conclusion that his neurophysiological model of consciousness might explain how consciousness arises from the brain, but does not address how consciousness evolved, affects behaviour or confers survival value. The commentary argues that such limitations apply to all neurophysiological or other thirdperson perspective models. To approach such questions the first-person nature of consciousness needs to be taken seriously in combination with third-person models of the brain.

Reticular-thalamic activation of the cortex generates conscious contents

Gray hypothesizes that the contents of consciousness correspond to the outputs of a subicular (hippocampal/temporal lobe) comparator that compares the current state of the organism's perceptual world with a predicted state. I argue that Gray has identified a key contributing system to conscious awareness, but that his model is inadequate for explaining how conscious contents are generated in the brain. An alternative model is offered.

Hunting for consciousness in the brain: What is (the name of) the game?

Robust theories concerning the connection between consciousness and brain function should derive not only from empirical evidence but also from a well grounded inind-body ontology. In the case of the comparator hypothesis, Gray develops his ideas relying extensively on empirical evidence, but he bounces irresolutely among logically incompatible metaphysical theses which, in turn, leads him to excessively skeptical conclusions concerning the naturalization of consciousness.

Mind – your head!

Gray takes an information-processing paradigm as his departure point, invoking a comparator as part of the system. He concludes that consciousness is to be found “in” the comparator but is unable to point to how the comparison takes place. Thus, the comparator turns out not to be an entity arising out of brain research per se, but out of the logic of the paradigm. In this way, Gray both reinvents dualism and remains trapped in the language game of his own model – ending up dealing with the unknowable.

The homunculus at home

In Gray's conjecture, mismatches in the subicular comparator (needing problem resolution) and matches (during appetitive approach) have equal prominence in consciousness. In rival cognitive views novelty and difficulty (i.e., information-processing mismatches) especially elicit more conscious modes of cognition and higher levels of self-regulation. The mismatch between Gray's conjecture and these views is discussed.

Contingency learning in human fear conditioning involves the ventral striatum

The ability to detect and learn contingencies between fearful stimuli and their predictive cues is an important capacity to cope with the environment. Contingency awareness refers to the ability to verbalize the relationships between conditioned and unconditioned stimuli. Although there is a heated debate about the influence of contingency awareness on conditioned fear responses, neural correlates behind the formation process of contingency awareness have gained only little attention in human fear conditioning. Recent animal studies indicate that the ventral striatum (VS) could be involved in this process, but in human studies the VS is mostly associated with positive emotions. To examine this question, we reanalyzed four recently published classical fear conditioning studies (n = 117) with respect to the VS at three distinct levels of contingency awareness: subjects, who did not learn the contingencies (unaware), subjects, who learned the contingencies during the experiment (learned aware) and subjects, who were informed about the contingencies in advance (instructed aware). The results showed significantly increased activations in the left and right VS in learned aware compared to unaware subjects. Interestingly, this activation pattern was only found in learned but not in instructed aware subjects. We assume that the VS is not involved when contingency awareness does not develop during conditioning or when contingency awareness is unambiguously induced already prior to conditioning. VS involvement seems to be important for the transition from a contingency unaware to a contingency aware state. Implications for fear conditioning models as well as for the contingency awareness debate are discussed.

The uncertainty processing theory of motivation

Most theories describe motivation using basic terminology (drive, 'wanting', goal, pleasure, etc.) that fails to inform well about the psychological mechanisms controlling its expression. This leads to a conception of motivation as a mere psychological state 'emerging' from neurophysiological substrates. However, the involvement of motivation in a large number of behavioural parameters (triggering, intensity, duration, and directedness) and cognitive abilities (learning, memory, decision, etc.) suggest that it should be viewed as an information processing system. The uncertainty processing theory (UPT) presented here suggests that motivation is the set of cognitive processes allowing organisms to extract information from the environment by reducing uncertainty about the occurrence of psychologically significant events. This processing of information is shown to naturally result in the highlighting of specific stimuli. The UPT attempts to solve three major problems: (i) how motivations can affect behaviour and cognition so widely, (ii) how motivational specificity for objects and events can result from nonspecific neuropharmacological causal factors (such as mesolimbic dopamine), and (iii) how motivational interactions can be conceived in psychological terms, irrespective of their biological correlates. The UPT is in keeping with the conceptual tradition of the incentive salience hypothesis while trying to overcome the shortcomings inherent to this view.

Disruption of latent inhibition induced by ovariectomy can be reversed by estradiol and clozapine as well as by co-administration of haloperidol with estradiol but not by haloperidol alone

INTRODUCTION

Epidemiological and clinical life cycle studies have indicated that the more favorable illness course and the better response to antipsychotic drugs (APDs) in women with schizophrenia correlate with high levels of estrogen, whereas increased vulnerability to exacerbation and relapse and reduced sensitivity to treatment are associated with low estrogen levels. Accordingly, the estrogen hypothesis of schizophrenia proposes that estrogen has a neuroprotective effect in women vulnerable to schizophrenia.

MATERIALS AND METHODS

Latent inhibition (LI), the capacity to ignore stimuli that received nonreinforced preexposure prior to conditioning, is disrupted in acute schizophrenia patients and in rats and humans treated with the psychosis inducing drug amphetamine. Disruption of LI is reversible by typical and atypical APDs. The present study tested whether low levels of estrogen induced by ovariectomy (OVX) would lead to disruption of LI in female rats and whether such disruption would be normalized by estrogen replacement treatment and/or APDs.

RESULTS

Results showed that OVX led to LI disruption, which was reversed by 17beta-estradiol (150 microg/kg) and the atypical APD clozapine (5 mg/kg), but not by the typical APD haloperidol (0.1, 0.2, 0.3 mg/kg). Haloperidol regained efficacy when administered with 17beta-estradiol (50 microg/kg).

DISCUSSION

These results provide the first demonstration in rats that low levels of hormones can induce a pro-psychotic state that is resistant to at least typical antipsychotic treatment. This constellation may mimic states seen in schizophrenic women during periods associated with low levels of hormones such as the menopause.

The D2 dopamine receptor gene variant C957T affects human fear conditioning and aversive priming

Polymorphisms of DRD2 and ANKK1 have been associated with psychiatric syndromes where there is believed to be an underlying learning process deficit such as addiction, post-traumatic stress disorder and psychopathy. We investigated the effects of the DRD2 C957T and ANKK1 TaqIA single nucleotide polymorphism (SNP), which have been associated with psychopathic traits in alcoholic patients, on fear conditioning and aversive priming in healthy volunteers. We found that the DRD2 C957T SNP, but not the ANKK1 TaqIA SNP, was associated with both differential conditioning of the skin conductance response and the aversive priming effect. There were no differences between the genotype groups with respect to the extinction of the skin-conductance conditioned response. These results suggest that the C957T SNP could be related to learning differences associated with the risk of developing psychiatric disorders in individuals that are carriers of the C homozygous genotype. Our genetic data raise the possibility that the dopaminergic system functional variations determined by this SNP could affect fear learning.

Pro-cognitive and antipsychotic efficacy of the alpha7 nicotinic partial agonist SSR180711 in pharmacological and neurodevelopmental latent inhibition models of schizophrenia

Schizophrenia symptoms can be segregated into positive, negative and cognitive, which exhibit differential sensitivity to drug treatments. Accumulating evidence points to efficacy of alpha7 nicotinic receptor (nAChR) agonists for cognitive deficits in schizophrenia but their activity against positive symptoms is thought to be minimal. The present study examined potential pro-cognitive and antipsychotic activity of the novel selective alpha7 nAChR partial agonist SSR180711 using the latent inhibition (LI) model. LI is the reduced efficacy of a previously non-reinforced stimulus to gain behavioral control when paired with reinforcement, compared with a novel stimulus. Here, no-drug controls displayed LI if non-reinforced pre-exposure to a tone was followed by weak but not strong conditioning (2 vs 5 tone-shock pairings). MK801 (0.05 mg/kg, i.p.) -treated rats as well as rats neonatally treated with nitric oxide synthase inhibitor L-NoArg (10 mg/kg, s.c.) on postnatal days 4-5, persisted in displaying LI with strong conditioning, whereas amphetamine (1 mg/kg) -treated rats failed to show LI with weak conditioning. SSR180711 (0.3, 1, 3 mg/kg, i.p.) was able to alleviate abnormally persistent LI produced by acute MK801 and neonatal L-NoArg; these models are believed to model cognitive aspects of schizophrenia and activity here was consistent with previous findings with alpha7-nAChR agonists. In addition, unexpectedly, SSR180711 (1, 3 mg/kg, i.p.) potentiated LI with strong conditioning in no-drug controls and reversed amphetamine-induced LI disruption, two effects considered predictive of activity against positive symptoms of schizophrenia. These findings suggest that SSR180711 may be beneficial not only for the treatment of cognitive symptoms in schizophrenia, as reported multiple times previously, but also positive symptoms.

Affect as a Psychological Primitive

In this article, we discuss the hypothesis that affect is a fundamental, psychologically irreducible property of the human mind. We begin by presenting historical perspectives on the nature of affect. Next, we proceed with a more contemporary discussion of core affect as a basic property of the mind that is realized within a broadly distributed neuronal workspace. We then present the affective circumplex, a mathematical formalization for representing core affective states, and show that this model can be used to represent individual differences in core affective feelings that are linked to meaningful variation in emotional experience. Finally, we conclude by suggesting that core affect has psychological consequences that reach beyond the boundaries of emotion, to influence learning and consciousness.

The role of the striatum in aversive learning and aversive prediction errors

Neuroeconomic studies of decision making have emphasized reward learning as critical in the representation of value-driven choice behaviour. However, it is readily apparent that punishment and aversive learning are also significant factors in motivating decisions and actions. In this paper, we review the role of the striatum and amygdala in affective learning and the coding of aversive prediction errors (PEs). We present neuroimaging results showing aversive PE-related signals in the striatum in fear conditioning paradigms with both primary (shock) and secondary (monetary loss) reinforcers. These results and others point to the general role for the striatum in coding PEs across a broad range of learning paradigms and reinforcer types.

Dual role of medial A10 dopamine neurons in affective encoding

Increasing evidence suggests that the activation of medial A10 neurons mediates positive affective encoding. However, little is known about the functions of the inhibition of midbrain dopamine neurons. Here we show evidence suggesting that the inhibition of medial A10 neurons mediates a negative affective state, leading to negative affective encoding, whereas blunting the activation of medial A10 neurons disrupts positive affective encoding involving food reward. We used a microinjection procedure, in which the D(2) dopamine receptor agonist quinpirole was administered into the cell body region of the dopamine neurons, a procedure that reduces dopamine cell firing. Microinjections of quinpirole into the posteromedial ventral tegmental area, but not its more lateral counterparts, led to conditioned place aversion. Quinpirole administration to this site also decreased food intake and basal dopamine concentration in the ventromedial striatum, a major projection area of medial A10 neurons. In addition, moderate quinpirole doses that did not lead to conditioned place aversion or disrupt food intake abolished food-conditioned place preference, suggesting that blunting dopamine impulse activity in response to food reward disrupts positive affective encoding in associated external stimuli. Our data support the hypothesis that activation of medial A10 dopamine neurons mediates a positive affective state, leading to positive affective encoding, while their inhibition mediates a negative affective state, leading to negative affective encoding. Together with previous findings, we propose that medial A10 neurons are an important component of the mechanism via which animals learn to avoid negative incentive stimuli.

Differential influence of the ventral subiculum on dopaminergic responses observed in core and dorsomedial shell subregions of the nucleus accumbens in latent inhibition

It has previously been reported that dopamine (DA) responses observed in the core and dorsomedial shell parts of the nucleus accumbens (Nacc) in latent inhibition (LI) are dependent on the left entorhinal cortex (ENT). The present study was designed to investigate the influence of the left ventral subiculum (SUB) closely linked to the ENT on the DA responses obtained in the Nacc during LI, using an aversive conditioned olfactory paradigm and in vivo voltammetry in freely moving rats. In the first (pre-exposure) session, functional blockade of the left SUB was achieved by local microinjection of tetrodotoxin (TTX). In the second session, rats were aversively conditioned to banana odor, the conditional stimulus (CS). In the retention (test) session the results were as follows: (1) pre-exposed (PE) conditioned animals microinjected with TTX, displayed aversion toward the CS; (2) in the core part of the Nacc, for PE-TTX-conditioned rats as for non-pre-exposed (NPE) conditioned animals, DA levels remained close to the baseline whereas DA variations in both groups were significantly different from the DA increases observed in PE-conditioned rats microinjected with the solvent (phosphate-buffered saline (PBS)); (3) in the shell part of the Nacc, for PE-TTX-conditioned rats, DA variations were close to or above the baseline. They were situated between the rapid DA increases observed in NPE-conditioned animals and the transient DA decreases obtained in PE-PBS-conditioned animals. These findings suggest that, in parallel to the left ENT, the left SUB controls DA LI-related responses in the Nacc. The present data may also offer new insight into the pathophysiology of schizophrenia.

Real-time dopamine efflux in the nucleus accumbens core during Pavlovian conditioning

To assess the role of dopamine input to the nucleus accumbens core in anticipatory learning, fast-scan cyclic voltammetry was combined with appetitive Pavlovian conditioning. One group of rats (Paired) received 16 tone-food pairings for at least four daily sessions while the control group (Unpaired) received the same number of unpaired tone and food presentations. Both groups showed transient dopamine responses during food presentation throughout training, confirming dopamine involvement in reward processing. Only the Paired Group, however, showed consistently timed dopamine transients during the 10-s tone presentation. Transients first appeared near the end of the tone period as each animal acquired the tone-food association and then occurred progressively sooner on subsequent sessions. Later sessions also revealed a consistently timed dopamine response soon after food delivery in Paired animals. Collectively, these results implicate phasic dopamine release in the acquisition of Pavlovian learning and also suggest an early dopamine response to the unconditioned stimulus as training continues.

Neonatal functional blockade of the entorhinal cortex results in disruption of accumbal dopaminergic responses observed in latent inhibition paradigm in adult rats

Latent inhibition (LI) has been found to be disrupted in non-treated patients with schizophrenia. Dopaminergic (DAergic) dysfunctioning is generally acknowledged to occur in schizophrenia. Various abnormalities in the entorhinal cortex (ENT) have been described in patients with schizophrenia. Numerous data also suggest that schizophrenia has a neurodevelopmental origin. The present study was designed to test the hypothesis that reversible inactivation of the ENT during neonatal development results in disrupted DA responses characteristic of LI in adult rats. Tetrodotoxin (TTX) was microinjected locally in the left ENT at postnatal day 8 (PND8). DA variations were recorded in the dorsomedial shell and core parts of the nucleus accumbens (Nacc) using in vivo voltammetry in freely-moving grown-up rats in a LI paradigm. In the first session the animals were pre-exposed (PE) to the conditional stimulus (banana odour) alone. In the second they were aversively conditioned to banana odour. In the third (test) session the following results were obtained in PE animals subjected to temporary inactivation of the ENT at PND8: (1) aversive behaviour was observed in TTX-PE conditioned animals; (2) DA variations in the dorsomedial shell and core parts of the Nacc were similar in TTX-PE and non-pre-exposed conditioned rats. These findings strongly suggest that neonatal disconnection of the ENT disrupts LI in adult animals. They may further our understanding of the pathophysiology of schizophrenia.

Multiple Dopamine Functions at Different Time Courses

Many lesion studies report an amazing variety of deficits in behavioral functions that cannot possibly be encoded in great detail by the relatively small number of midbrain dopamine neurons. Although hoping to unravel a single dopamine function underlying these phenomena, electrophysiological and neurochemical studies still give a confusing, mutually exclusive, and partly contradictory account of dopamine's role in behavior. However, the speed of observed phasic dopamine changes varies several thousand fold, which offers a means to differentiate the behavioral relationships according to their time courses. Thus dopamine is involved in mediating the reactivity of the organism to the environment at different time scales, from fast impulse responses related to reward via slower changes with uncertainty, punishment, and possibly movement to the tonic enabling of postsynaptic motor, cognitive, and motivational systems deficient in Parkinson's disease.

Lesions of the nucleus accumbens shell can reduce activity in the elevated plus-maze

Across different behavioural tasks, nucleus accumbens (n.acc) lesions have generated conflicting effects on locomotor activity and in particular, the relative roles of the n.acc shell and core subfields in this have been controversial. To date there is only one study examining effects of lesions to the medial n.acc on elevated plus-maze (EPM) behaviour; these lesions were shown to increase both locomotor and exploratory activity. Given the well-documented distinction between shell and core, the present study sought to extend previous research by testing lesions selective to each n.acc subfield in the EPM. Results showed no statistical differences between core lesioned and sham-operated animals on any measure. In contrast, shell lesions consistently reduced locomotion and exploratory activity. This direction of effects is opposite to that previously observed after medial n.acc. lesions. In conclusion, locomotion and exploratory activity were clearly reduced by shell but not core lesions, consistent with other evidence for the functional heterogeneity of n.acc shell and core.

A "good parent" function of dopamine: transient modulation of learning and performance during early stages of training

While extracellular dopamine (DA) concentrations are increased by a wide category of salient stimuli, there is evidence to suggest that DA responses to primary and conditioned rewards may be distinct from those elicited by other types of salient events. A reward-specific mode of neuronal responding would be necessary if DA acts to strengthen behavioral response tendencies under particular environmental conditions or to set current environmental inputs as goals that direct approach responses. As described in this review, DA critically mediates both the acquisition and expression of learned behaviors during early stages of training, however, during later stages, at least some forms of learned behavior become independent of (or less dependent upon) DA transmission for their expression.

Dopamine activity in the nucleus accumbens modulates blocking in fear conditioning

Associative learning depends on the discrepancy between actual and predicted outcomes. The neurochemical mechanisms involved in regulating this discrepancy in Pavlovian fear conditioning in rats are unknown. We employed the blocking paradigm to show that this learning discrepancy is decreased by heightened activation of dopamine following an accumbal infusion of d-amphetamine, and increased by dopaminegic blockade following an accumbal infusion of cis-(z)-flupenthixol or by combined infusions of the D1 (SCH23390) and D2 (sulpiride) antagonists but not by infusion of either alone.

Insights into the Role of Dopamine Receptor Systems in Learning and Memory

It is well established that learning and memory are complex processes involving and recruiting different brain modulatory neurotransmitter systems. Considerable evidence points to the involvement of dopamine in various aspects of cognition, and interest has been focused on investigating the clinical relevance of dopamine systems to age-related cognitive decline and manifestations of cognitive impairment in schizophrenia, Alzheimer's disease, Parkinson's disease and other neurodegenerative diseases. In the past decade or so, in spite of the molecular cloning of the five dopamine receptor subtypes, their specific roles in brain function remained inconclusive due to the lack of completely selective ligands that could distinguish between the members of the D1-like and D2-like dopamine receptor families. One of the most important advances in the field of dopamine research has been the generation of mutant mouse models permitting evaluation of the dopaminergic system using gene targeting technologies. These mouse models represent an important approach to explore the functional roles of closely related receptor subtypes. In this review, we present and discuss evidence on the role of dopamine receptors in different aspects of learning and memory at the cellular, molecular and behavioral levels. We compare evidence using conventional pharmacological, lesion or electrophysiological studies with results from mice with targeted deletions of different subtypes of dopamine receptor genes. We particularly focus on dopamine D1 and D2 receptors in an effort to delineate their specific roles in various aspects of cognitive function. We provide strong evidence, from our own recent work as well as others, that dopamine is part of the network that plays a very important role in cognitive function, and that although multiple dopamine receptor subtypes contribute to different aspects of learning and memory, the D1 receptor seems to play a more prominent role in mediating plasticity and specific aspects of cognitive function, including spatial learning and memory processes, reversal learning, extinction learning, and incentive learning.

Taste Memory Formation: Role of Nucleus Accumbens

When a novel taste has been associated with postingestive malaise, animals recognize this taste as aversive. This associative learning is known as conditioned taste aversion. However, when an animal consumes a novel taste and no aversive consequences follow, it becomes recognized as a safe signal, leading to an increase in its consumption in subsequent presentations. In this review, we will discuss the results related to the taste memory formation focusing particularly on the nucleus accumbens (NAcc). The NAcc keeps projections with amygdala, insular cortex, parabrachial nucleus, and nucleus of the solitary tract areas important for taste memory formation. We will review the evidence relating to how the NAcc could be involved in taste memory formation, due to its role in the taste memory trace formation and its role in the association of the conditioned stimulus-unconditioned stimulus, and finally the retrieval of taste memory. In this context, we will review the participation of the cholinergic, dopaminergic, and glutamatergic systems in the NAcc during taste memory formation.

Opioid receptors in the nucleus accumbens regulate attentional learning in the blocking paradigm

Fear learning depends on prediction error, or the discrepancy between the actual and expected outcome of a conditioning trial. These experiments used blocking and unblocking designs to study the role of opioid receptors in the nucleus accumbens (Acb) in predictive fear learning. Previous fear conditioning to a context blocked later fear conditioning to a conditioned stimulus (CS) in that context. Fear learning proceeded normally (i.e., unblocking occurred) if the CS signaled a more intense footshock than was used during previous context conditioning. Blocking and unblocking were mediated by Acb opioid receptors. Acb microinjections of a nonselective opioid receptor agonist prevented blocking, whereas a nonselective antagonist prevented unblocking. Examination of the associative mechanism for blocking and unblocking revealed that Acb opioid receptors mediate indirect predictive learning by controlling learned variations in attention. Mu-opioid and kappa-opioid receptors contribute to this learned regulation of attention because Acb microinjections of a mu-opioid receptor agonist impaired, whereas a kappa-opioid receptor agonist facilitated, blocking. Acb microinjections of a mu-opioid receptor antagonist also prevented unblocking. Microinjections of a delta-opioid receptor agonist or antagonist were without effect on blocking and unblocking. Our data show that the Acb mediates attentional selection between competing predictors of motivationally significant events to enable learning about the best predictor of such events at the expense of worse predictors. During fear learning, Acb mu-opioid receptors upregulate attention to conditioned stimuli that are predictive of shock, whereas kappa-opioid receptors downregulate attention to conditioned stimuli that are redundant or noninformative predictors of shock.

NMDA and muscarinic receptors of the nucleus accumbens have differential effects on taste memory formation

Animals recognize a taste cue as aversive when it has been associated with post-ingestive malaise; this associative learning is known as conditioned taste aversion (CTA). When an animal consumes a new taste and no negative consequences follow, it becomes recognized as a safe signal, leading to an increase in its consumption in subsequent presentations (attenuation of neophobia, AN). It has been shown that the nucleus accumbens (NAcc) has an important role in taste learning. To elucidate the involvement of N-methyl-D-aspartate (NMDA) and muscarinic receptors in the NAcc during safe and aversive taste memory formation, we administrated bilateral infusions of DL-2-amino-5-phosphonopentanoic acid (APV) or scopolamine in the NAcc shell or core respectively. Our results showed that pre-training injections of APV in the NAcc core and shell disrupted aversive but not safe taste memory formation, whereas pre-training injections of scopolamine in the NAcc shell, but not core, disrupted both CTA and AN. These results suggest that muscarinic receptors seem to be necessary for processing taste stimuli for either safe or aversive taste memory, whereas NMDA receptors are only involved in the aversive taste memory trace formation.

Latent inhibition of conditioned taste aversion is not disrupted, but can be enhanced, by selective nucleus accumbens shell lesions in rats

Latent inhibition is a form of negative priming in which repeated non-reinforced pre-exposures to a stimulus retard subsequent learning about the predictive significance of that stimulus. The nucleus accumbens shell and the anatomical projection it receives from the hippocampal formation have been attributed a pivotal role in the control or regulation of latent inhibition expression. A number of studies in rats have demonstrated the efficacy of selective shell lesions to disrupt latent inhibition in different associative learning paradigms, including conditioned active avoidance and conditioned emotional response. Here, we extended the test to the conditioned taste aversion paradigm, in which the effect of direct hippocampal damage on latent inhibition remains controversial. We demonstrated the expected effect of selective shell lesions on latent inhibition of conditioned emotional response and of conditioned active avoidance, before evaluating in a separate cohort of rats the effect of comparable selective lesions on latent inhibition of conditioned taste aversion: a null effect of the lesions was first obtained using parameters known to be sensitive to amphetamine treatment, then an enhancement of latent inhibition was revealed with a modified conditioned taste aversion procedure. Our results show that depending on the associative learning paradigm chosen, shell lesions can disrupt or enhance the expression of latent inhibition; and the pattern is reminiscent of that seen following hippocampal damage.

Effects of physiological and pharmacological stimuli on dopamine release in the rat globus pallidus

A major aspect of understanding functions of the globus pallidus (GP) within the basal ganglia is the significance of its dopamine innervation. Here, we used in vivo-microdialysis in rats to characterize pallidal dopamine release in response to a number of physiological and pharmacological stimuli known to activate dopamine neurons. Results reveal that an aversive stimulus, i.e. handling for 20 min, significantly increased dialysate dopamine in the globus pallidus to about 130% of baseline levels. Likewise, a novel and appetitive stimulus, i.e. presentation of unfamiliar, palatable food, significantly elevated pallidal dopamine to about 150% of baseline levels both in rats which did and did not consume the food reward. These findings provide evidence that increases of dopamine (DA) efflux may largely reflect stimulus saliency implicating an involvement of pallidal dopamine signalling in control of behaviour governed by salient stimuli. Results further showed that reverse microdialysis of D-amphetamine and cocaine in augmenting concentrations of 0.1-100 microM elevated dialysate dopamine in a concentration-dependent manner suggesting a role of pallidal dopamine in mediating behavioural effects of psychostimulant drugs.

The role of dopamine in conditioning and latent inhibition: what, when, where and how?

It is well established that dopamine is released in the nucleus accumbens (NAC) in animals in rewarding or reinforcing situations, and widely believed that this release is the substrate of, or at least closely related to, the experience of reward. The demonstration of conditioned release of dopamine by stimuli conditioned to primary rewards has reinforced this view. However, a number of observations do not sit comfortably with this interpretation, most notably that dopamine is released equally effectively in NAC by aversive stimuli, and stimuli conditioned to them. Furthermore, additional release of dopamine is seen during conditioning, even if motivational stimuli of either type are not involved. It is suggested here that one important action of NAC dopamine release is to restore the salience of potential conditioned stimuli, when this has been reduced by prior un-reinforced experience. The paradigm of latent inhibition (LI) demonstrates a behavioural effect of this type, and extensive studies on the role of dopamine in LI have been undertaken by us and others. Those studies are reviewed here, together with some previously unpublished data, to demonstrate that (1) amphetamine disruption of LI is indeed a function of calcium-dependant dopamine release in the NAC at the time of conditioning; (2) other drugs acting on LI via changes in dopamine transmission act at the same locus; (3) the disruptive effect of indirect dopamine agonists on LI can be prevented by either D-1 selective receptor antagonists, or D-2 selective receptor antagonists. It is concluded that dopamine release in these very varied behavioural contexts (reward, punishment, conditioning, modulation of salience) must be differentiated in some way, and that this should be investigated. An alternative explanation, if they are not differentiated, would be that the release in fact does have the same functional significance in each case. We suggest that this common significance might be the broadening of attention to take in potentially conditionable stimuli, which have previously been devalued.

Latent inhibition is disrupted by nucleus accumbens shell lesion but is abnormally persistent following entire nucleus accumbens lesion: The neural site controlling the expression and disruption of the stimulus preexposure effect

Latent inhibition (LI) is the proactive interference of repeated nonreinforced preexposure to a stimulus with subsequent performance on a learning task involving that stimulus. The present experiments investigated the role of the nucleus accumbens (NAC) in LI. LI was measured in a thirst motivated conditioned emotional response procedure with low or high number of conditioning trials, and in two-way active avoidance procedure with the stages of preexposure and conditioning taking place in the same or different contexts. Sham-lesioned rats showed LI with low but not high number of conditioning trials and if preexposure and conditioning took place in the same context but not if the context was changed between the stages. Lesion to the shell subregion of the NAC disrupted LI but LI was preserved in rats with a combined lesion to the NAC shell and core subregions. Moreover, rats with a combined shell-core lesion persisted in showing LI in spite of high number of conditioning trials and in spite of context change. These results show that the NAC is not essential for the acquisition of LI but rather plays a key role in regulating the expression of LI. Moreover, they suggest that the two subregions of the NAC contribute competitively and cooperatively to this process, selecting the response appropriate to the stimulus-no event or the stimulus-reinforcement association in conditioning.

Disruption of learned irrelevance in acute schizophrenia in a novel continuous within-subject paradigm suitable for fMRI

Learned irrelevance (LIrr) is closely related to latent inhibition (LI). In LI a to-be-conditioned stimulus (CS) is prexposed alone prior to the opportunity to learn an association between the CS and an unconditioned stimulus (UCS). In LIrr preexposure consists of intermixed presentations of both CS and UCS in a random relationship to each other. In both paradigms preexposure leads in normal subjects to reduced or retarded learning of the CS-UCS association. Acute schizophrenics fail to show LI. LI is usually demonstrated as a one-off, between-groups difference in trials to learning, so posing problems for neuroimaging. We have developed a novel, continuous, within-subject paradigm in which normal subjects show robust and repeated LIrr. We show that this paradigm is suitable for functional magnetic resonance imaging (fMRI) and gives rise, in normal subjects, to activation in the hippocampal formation, consistent with data from animal experiments on LI. We also report, consistent with previous studies of LI, loss (indeed, significant reversal) of LIrr in acute (first 2 weeks of current psychotic episode) schizophrenics. Chronic schizophrenics failed to demonstrate learning, precluding measurement in this group of LIrr. These findings establish the likely value of the new paradigm for neuroimaging studies of attentional dysfunction in acute schizophrenia.

Systemic or intra-accumbens injection of D-amphetamine delays habituation to a tone stimulus in rats

Dopamine release within the nucleus accumbens shell is suggested to control the salience of environmental stimuli, and previous research has shown that the indirect dopamine agonist D-amphetamine can alter the salience of both aversive and neutral stimuli. In experiment 1, the effect of systemic injection of D-amphetamine (0.5, 1 mg/kg) on fear conditioning to a tone was assessed in an 'off-baseline' conditioned suppression procedure using several footshock intensities. Although the effects of amphetamine on conditioning were unclear, the results indicated a deficit of simple tone habituation in amphetamine-treated rats. In experiment 2, habituation of the orienting reaction to a tone was assessed by the progressive reduction of lick suppression upon repeated presentation of the auditory stimulus. D-Amphetamine delayed tone habituation, whether administered systemically (0.5, 1 mg/kg) or into the nucleus accumbens shell (3, 10 microg/0.5 microl). These data are consistent with electrophysiological and neurochemical data demonstrating the role of nucleus accumbens dopamine in novelty processing. The relevance of the data to latent inhibition is discussed.

A pre-clinical study showing how dopaminergic drugs administered during pre-exposure can impair or facilitate latent inhibition

RATIONALE

It has been suggested that, in classical conditioning, dopamine (DA) codes for (a) attention to the conditioned stimulus (CS) or (b) the intensity of the unconditioned stimulus.

OBJECTIVES

To clarify the role of DA in pre-clinical classical conditioning studies.

METHODS

An existing model of classical conditioning presented by Schmajuk, Lam, and Gray (J Exp Psychol Anim Behav Process 22:321-349, 1996) suggests that DA cells in the ventral midbrain area code for the attentionally modulated internal representation of the CS. It is assumed that this representation is increased by dopaminergic agonists and decreased by dopaminergic antagonists. Computer simulations with the model describe the effect of nicotine and haloperidol on latent inhibition.

RESULTS

Simulations replicate experimental results demonstrating that both nicotine and haloperidol affect latent inhibition when administered during the pre-exposure phase. In addition, the model reproduces data showing that administration of nicotine or haloperidol results in the impairment or facilitation of latent inhibition depending on the duration of CS or the number of CSs.

CONCLUSIONS

The model demonstrates that pre-clinical experimental results, including cell activity and pharmacological data, are consistent with an attentional role for DA in classical conditioning.

Amphetamine injections into the nucleus accumbens affect neither acquisition/expression of conditioned fear nor baseline startle response

The acoustic startle response is enhanced during states of fear and attenuated during pleasant ones. Our question was whether pharmacological stimulation of the reward system disrupts the learning and retrieval of conditioned fear as measured by fear-potentiated startle. We therefore injected the dopamine agonist amphetamine into the nucleus accumbens (NAC) immediately before either acquisition or expression of conditioned fear and measured the effect of these injections on fear-potentiated startle and baseline startle response. This study clearly showed that amphetamine injections into the NAC had no effect on baseline startle amplitude and acquisition/expression of conditioned fear. In contrast, amphetamine injections into the nucleus accumbens clearly enhanced spontaneous motor activity. These results suggest that dopamine within the NAC is not involved in modulation of fear-potentiated startle and baseline startle.

Role of basolateral amygdala dopamine in modulating prepulse inhibition and latent inhibition in the rat

RATIONALE

The dopamine (DA) projection to the basolateral amygdala (BLA) modulates nucleus accumbens (NAc) and medial prefrontal cortex (mPFC) DA transmission. Given the involvement of the BLA, and of NAc and mPFC DA, in select forms of information processing, we sought to determine the role of BLA DA in modulating prepulse inhibition (PPI) and latent inhibition (LI).

OBJECTIVE

The effects of BLA D1 (SCH 23390) and D2/D3 (raclopride) receptor blockade on PPI and LI were examined.

METHODS

Separate groups of male Long-Evans rats received bilateral intra-BLA infusions of SCH 23390 (3.2 or 6.4 microg/0.5 microl per side), raclopride (2.5 or 5.0 microg/0.5 microl per side) or saline prior to testing. In two experiments, the effects of BLA DA receptor antagonism on PPI of the acoustic startle response (ASR) and LI of conditioned taste aversion were determined. A control group received bilateral intra-striatal infusions of SCH 23390 or raclopride prior to PPI testing.

RESULTS

Intra-BLA SCH 23390 or raclopride had no effect on the ASR. Intra-BLA SCH 23390 enhanced and raclopride disrupted PPI, both in a dose-related manner. Intra-striatal SCH 23390 or raclopride had no effect on PPI or ASR magnitude. Finally, BLA DA receptor blockade had no effect on LI.

CONCLUSIONS

These results indicate that PPI is modulated by BLA DA and suggest that this modulation occurs independently of changes in NAc and/or mPFC DA transmission. They also suggest that BLA DA is not involved in modulating LI and add to evidence indicating that PPI and LI are mediated by different neural substrates.