Lesions of the perirhinal cortex impair sensory preconditioning in rats

How common is a common error term? The rules that govern associative learning in sensory preconditioning and second-order conditioning

In standard (first-order) Pavlovian conditioning protocols, pairings of an initially neutral conditioned stimulus (CS) and a biologically significant unconditioned stimulus (US) result in the formation of a CS-US association. The strength of this association is theoretically regulated by prediction error: specifically, the difference between the total level of conditioning supported by the US and the degree to which it is predicted by all stimuli present (i.e., a common error term). In higher-order conditioning protocols (e.g., sensory preconditioning and second-order conditioning), a Pavlovian CS is used to condition responses to other stimuli with which it is paired. At present, it is unknown whether error-correction processes regulate associative learning in higher-order conditioning and, if so, whether these processes are the same as those that regulate formation of a CS-US association in first-order conditioning. Here we review studies that have provided findings relevant to this question: specifically, studies that have examined blocking and/or inhibitory learning in sensory preconditioning and second-order conditioning. These studies show that: (1) animals can form inhibitory associations between relatively neutral sensory stimuli; (2) the learning that occurs in sensory preconditioning and second-order conditioning can be blocked; and, finally, (3) a first-order CS can block conditioning to a second-order CS, and vice versa. The findings are taken to imply that a common error term regulates associative learning in higher-order conditioning, just as it regulates associative learning in first-order conditioning. They are discussed with respect to the nature of the error signal that underlies conditioning and future work that is needed to advance our understanding of the rules that govern different types of learning.

Higher-order trace conditioning in newborn rabbits

Temporal contingency is a key factor in associative learning but remains weakly investigated early in life. Few data suggest simultaneous presentation is required for young to associate different stimuli, whereas adults can learn them sequentially. Here, we investigated the ability of newborn rabbits to perform sensory preconditioning and second-order conditioning using trace intervals between odor presentations. Strikingly, pups are able to associate odor stimuli with 10- and 30-sec intervals in sensory preconditioning and second-order conditioning, respectively. The effectiveness of higher-order trace conditioning in newborn rabbits reveals that very young animals can display complex learning despite their relative immaturity.

The neural substrates of higher-order conditioning: A review

Sensory preconditioned and second-order conditioned responding are each well-documented. The former occurs in subjects (typically rats) exposed to pairings of two relatively neutral stimuli, S2 and S1, and then to pairings of S1 and a motivationally significant event [an unconditioned stimulus (US)]; the latter occurs when the order of these experiences is reversed with rats being exposed to S1-US pairings and then to S2-S1 pairings. In both cases, rats respond when tested with S2 in a manner appropriate to the affective nature of the US, e.g., approach when the US is appetitive and withdrawal when it is aversive. This paper reviews the neural substrates of sensory preconditioning and second-order conditioning. It identifies commonalities and differences in the substrates of these so-called higher-order conditioning protocols and discusses these commonalities/differences in relation to what is learned. In so doing, the review highlights ways in which these types of conditioning enhance our understanding of how the brain encodes and retrieves different types of information to generate appropriate behavior.

Excitotoxic lesions of the perirhinal cortex leave intact rats' gustatory sensory preconditioning

We report findings from two sensory preconditioning experiments in which rats consumed two flavoured solutions, each with two gustatory components (AX and BY), composed of sweet, bitter, salt, and acid elements. After this pre-exposure, rats were conditioned to X by pairing with lithium chloride. Standard sensory preconditioning was observed: Consumption of flavour A was less than that of B. We found that sensory preconditioning was maintained when X was added to A and B. Both experiments included one group of rats with lesions of the perirhinal cortex, which did not influence sensory preconditioning. We discuss our findings in the light of other sensory preconditioning procedures that involve the perirhinal cortex and conclude that differences in experimental variables invoke different mechanisms of sensory preconditioning, which vary in their requirement of the perirhinal cortex.

Not "either-or" but "which-when": A review of the evidence for integration in sensory preconditioning

Sensory preconditioning protocols can be used to assess how the brain integrates memories that share common features. In these protocols, animals are first exposed to pairings of two relatively innocuous stimuli, S2 and S1 (stage 1), and then to pairings of one of these stimuli, S1, with an event of motivational significance (stage 2). Following this training, test presentations of S2 elicit responses appropriate to the motivationally significant event, and these responses are taken to indicate formation of distinct S2-S1 and S1-event memories that are integrated in some way to generate that responding. This paper reviews studies of sensory preconditioning in rats, mice, rabbits and people to determine whether S2-S1 and S1-event memories are integrated through a chaining process at the time of their retrieval (i.e., test presentations of S2 trigger retrieval of S1, and thereby, responses appropriate to the event); or "online" at the time of memory formation (i.e., in stage 2, S1 activates a representation of S2 such that both stimuli associate with the motivationally significant event). It finds that the type of integration is determined by the manner in which stimuli are presented in preconditioning as well as their familiarity. When the stimuli in preconditioning are presented repeatedly and/or serially (i.e., one after the other), the S2-S1 and S1-event memories are chained at the time of retrieval/testing. In contrast, when the stimuli in preconditioning are relatively novel and/or presented simultaneously, the S2-S1 and S1-event memories are integrated online. These statements are related to prior claims regarding the circumstances that promote different types of memory integration and, more generally, mechanisms of information processing in the mammalian brain.

Higher-Order Conditioning and Dopamine: Charting a Path Forward

Higher-order conditioning involves learning causal links between multiple events, which then allows one to make novel inferences. For example, observing a correlation between two events (e.g., a neighbor wearing a particular sports jersey), later helps one make new predictions based on this knowledge (e.g., the neighbor's wife's favorite sports team). This type of learning is important because it allows one to benefit maximally from previous experiences and perform adaptively in complex environments where many things are ambiguous or uncertain. Two procedures in the lab are often used to probe this kind of learning, second-order conditioning (SOC) and sensory preconditioning (SPC). In second-order conditioning (SOC), we first teach subjects that there is a relationship between a stimulus and an outcome (e.g., a tone that predicts food). Then, an additional stimulus is taught to precede the predictive stimulus (e.g., a light leads to the food-predictive tone). In sensory preconditioning (SPC), this order of training is reversed. Specifically, the two neutral stimuli (i.e., light and tone) are first paired together and then the tone is paired separately with food. Interestingly, in both SPC and SOC, humans, rodents, and even insects, and other invertebrates will later predict that both the light and tone are likely to lead to food, even though they only experienced the tone directly paired with food. While these processes are procedurally similar, a wealth of research suggests they are associatively and neurobiologically distinct. However, midbrain dopamine, a neurotransmitter long thought to facilitate basic Pavlovian conditioning in a relatively simplistic manner, appears critical for both SOC and SPC. These findings suggest dopamine may contribute to learning in ways that transcend differences in associative and neurological structure. We discuss how research demonstrating that dopamine is critical to both SOC and SPC places it at the center of more complex forms of cognition (e.g., spatial navigation and causal reasoning). Further, we suggest that these more sophisticated learning procedures, coupled with recent advances in recording and manipulating dopamine neurons, represent a new path forward in understanding dopamine's contribution to learning and cognition.

Neural Substrates of Incidental Associations and Mediated Learning: The Role of Cannabinoid Receptors

The ability to form associations between different stimuli in the environment to guide adaptive behavior is a central element of learning processes, from perceptual learning in humans to Pavlovian conditioning in animals. Like so, classical conditioning paradigms that test direct associations between low salience sensory stimuli and high salience motivational reinforcers are extremely informative. However, a large part of everyday learning cannot be solely explained by direct conditioning mechanisms - this includes to a great extent associations between individual sensory stimuli, carrying low or null immediate motivational value. This type of associative learning is often described as incidental learning and can be captured in animal models through sensory preconditioning procedures. Here we summarize the evolution of research on incidental and mediated learning, overview the brain systems involved and describe evidence for the role of cannabinoid receptors in such higher-order learning tasks. This evidence favors a number of contemporary hypotheses concerning the participation of the endocannabinoid system in psychosis and psychotic experiences and provides a conceptual framework for understanding how the use of cannabinoid drugs can lead to altered perceptive states.

Appetitive and aversive sensory preconditioning in rats is impaired by disruption of the postrhinal cortex

Episodic memory involves binding stimuli and/or events together in time and place. Furthermore, memories become more complex when new experiences influence the meaning of stimuli within the original memory. Thus collectively, complex episodic memory formation and maintenance involves processes such as encoding, storage, retrieval, updating and reconsolidation, which can be studied using animal models of higher-order conditioning. In the present study aversive and appetitive sensory preconditioning paradigms were used to test the hypothesis that the postrhinal cortex (POR), which is a component of the hippocampal memory system, is involved in higher-order conditioning. Drawing on the known role of the POR in contextual learning, Experiment 1 employed a four-phase sensory preconditioning task that involved fear learning and context discrimination in rats with or without permanent lesions of the POR. In parallel, to examine POR function during higher-order conditioning in the absence of a particular spatial arrangement, Experiments 2 and 3 used a three-phase sensory preconditioning paradigm involving phasic stimuli. In Experiment 2, bilateral lesions of the POR were made and in Experiment 3, a chemogenetic approach was used to temporarily inactivate POR neurons during each phase of the paradigm. Evidence of successful sensory preconditioning was observed in sham rats which, during the critical context discrimination test, demonstrated higher levels of freezing behavior when re-exposed to the paired versus the unpaired context, whereas POR-lesioned rats did not. Data from the appetitive sensory preconditioning paradigm also confirmed the hypothesis in that during the critical auditory discrimination test, sham rats showed greater food cup responding following presentations of the paired compared to the unpaired auditory stimulus, whereas POR-lesioned rats did not. Lastly, in Experiment 3, when the POR was inactivated only during preconditioning or only during conditioning, discrimination during the critical auditory test was impaired. Thus, regardless of whether stimulus-stimulus associations were formed between static or phasic stimuli or whether revaluation of the paired stimulus occurred through association with an aversive or an appetitive unconditioned stimulus, the effects were the same; POR lesions disrupted the ability to use higher-order conditioned stimuli to guide prospective behavior.

Memory guidance of value-based decision making at an abstract level of representation

Value-based decisions about alternatives we have never experienced can be guided by associations between current choice options and memories of prior reward. A critical question is how similar memories need to be to the current situation to effectively guide decisions. We address this question in the context of associative learning of faces using a sensory preconditioning paradigm. We find that memories of reward spread along established associations between faces to guide decision making. While memory guidance is specific for associated facial identities, it does not only occur for the specific images that were originally encountered. Instead, memory guidance generalizes across different images of the associated identities. This suggests that memory guidance does not rely on a pictorial format of representation but on a higher, view-invariant level of abstraction. Thus, memory guidance operates on a level of representation that neither over- nor underspecifies associative relationships in the context of obtaining reward.

Neuronal Computation Underlying Inferential Reasoning in Humans and Mice

Every day we make decisions critical for adaptation and survival. We repeat actions with known consequences. But we also draw on loosely related events to infer and imagine the outcome of entirely novel choices. These inferential decisions are thought to engage a number of brain regions; however, the underlying neuronal computation remains unknown. Here, we use a multi-day cross-species approach in humans and mice to report the functional anatomy and neuronal computation underlying inferential decisions. We show that during successful inference, the mammalian brain uses a hippocampal prospective code to forecast temporally structured learned associations. Moreover, during resting behavior, coactivation of hippocampal cells in sharp-wave/ripples represent inferred relationships that include reward, thereby "joining-the-dots" between events that have not been observed together but lead to profitable outcomes. Computing mnemonic links in this manner may provide an important mechanism to build a cognitive map that stretches beyond direct experience, thus supporting flexible behavior.

Cortico-Hippocampal Computational Modeling Using Quantum Neural Networks to Simulate Classical Conditioning Paradigms

Most existing cortico-hippocampal computational models use different artificial neural network topologies. These conventional approaches, which simulate various biological paradigms, can get slow training and inadequate conditioned responses for two reasons: increases in the number of conditioned stimuli and in the complexity of the simulated biological paradigms in different phases. In this paper, a cortico-hippocampal computational quantum (CHCQ) model is proposed for modeling intact and lesioned systems. The CHCQ model is the first computational model that uses the quantum neural networks for simulating the biological paradigms. The model consists of two entangled quantum neural networks: an adaptive single-layer feedforward quantum neural network and an autoencoder quantum neural network. The CHCQ model adaptively updates all the weights of its quantum neural networks using quantum instar, outstar, and Widrow–Hoff learning algorithms. Our model successfully simulated several biological processes and maintained the output-conditioned responses quickly and efficiently. Moreover, the results were consistent with prior biological studies.

Green model to adapt classical conditioning learning in the hippocampus

Compared with the biological paradigms of classical conditioning, non-adaptive computational models are not capable of realistically simulating the biological behavioural functions of the hippocampal regions, because of their implausible requirement for a large number of learning trials, which can be on the order of hundreds. Additionally, these models did not attain a unified, final stable state even after hundreds of learning trials. Conversely, the output response has a different threshold for similar tasks in various models with prolonged transient response of unspecified status via the training or even testing phases. Accordingly, a green model is a combination of adaptive neuro-computational hippocampal and cortical models that is proposed by adaptively updating the whole weights in all layers for both intact networks and lesion networks using instar and outstar learning rules with adaptive resonance theory (ART). The green model sustains and expands the classical conditioning biological paradigms of the non-adaptive models. The model also overcomes the irregular output response behaviour by using the proposed feature of adaptivity. Further, the model successfully simulates the hippocampal regions without passing the final output response back to the whole network, which is considered to be biologically implausible. The results of the Green model showed a significant improvement confirmed by empirical studies of different tasks. In addition, the results indicated that the model outperforms the previously published models. All the obtained results successfully and quickly attained a stable, desired final state (with a unified concluding state of either "1" or "0") with a significantly shorter transient duration.

Retrosplenial cortex and its role in cue-specific learning and memory

The retrosplenial cortex (RSC) contributes to spatial navigation, as well as contextual learning and memory. However, a growing body of research suggests that the RSC also contributes to learning and memory for discrete cues, such as auditory or visual stimuli. In this review, we summarize and assess the Pavlovian and instrumental conditioning experiments that have examined the role of the RSC in cue-specific learning and memory. We use the term cue-specific to refer to these putatively non-spatial conditioning paradigms that involve discrete cues. Although these paradigms emphasize behavior related to cue presentations, we note that cue-specific learning and memory always takes place against a background of contextual stimuli. We review multiple ways by which contexts can influence responding to discrete cues and suggest that RSC contributions to cue-specific learning and memory are intimately tied to contextual learning and memory. Indeed, although the RSC is involved in several forms of cue-specific learning and memory, we suggest that many of these can be linked to processing of contextual stimuli.

Danger Changes the Way the Mammalian Brain Stores Information About Innocuous Events: A Study of Sensory Preconditioning in Rats

The amygdala is a critical substrate for learning about cues that signal danger. Less is known about its role in processing innocuous or background information. The present study addressed this question using a sensory preconditioning protocol in male rats. In each experiment, rats were exposed to pairings of two innocuous stimuli in stage 1, S2 and S1, and then to pairings of S1 and shock in stage 2. As a consequence of this training, control rats displayed defensive reactions (freezing) when tested with both S2 and S1. The freezing to S2 is a product of two associations formed in training: an S2-S1 association in stage 1 and an S1-shock association in stage 2. We examined the roles of two medial temporal lobe (MTL) structures in consolidation of the S2-S1 association: the perirhinal cortex (PRh) and basolateral complex of the amygdala (BLA). When the S2-S1 association formed in a safe context, its consolidation required neuronal activity in the PRh (but not BLA), including activation of AMPA receptors and MAPK signaling. In contrast, when the S2-S1 association formed in a dangerous context, or when the context was rendered dangerous immediately after the association had formed, its consolidation required neuronal activity in the BLA (but not PRh), including activation of AMPA receptors and MAPK signaling. These roles of the PRh and BLA show that danger changes the way the mammalian brain stores information about innocuous events. They are discussed with respect to danger-induced changes in stimulus processing.

Putting fear in context: Elucidating the role of the retrosplenial cortex in context discrimination in rats

The retrosplenial cortex (RSC), which receives visuo-spatial sensory input and interacts with numerous hippocampal memory system structures, has a well-established role in contextual learning and memory. While it has been demonstrated that RSC function is necessary to learn to recognize a single environment that is directly paired with an aversive event, the role of the RSC in discriminating between two different contexts remains largely unknown. To address this, first order (Experiment 1) and higher order (Experiment 2) fear conditioning paradigms were conducted with sham and RSC-lesioned rats. In Experiment 1 rats were exposed to one context in which shock was delivered and to a second, distinct context without shock. Their ability to discriminate between the contexts was assessed during a re-exposure test. In a second experiment, a new cohort of RSC-lesioned rats was exposed to two contexts made distinct through visual, olfactory and auditory stimuli. In a subsequent conditioning phase, the salience of one of the auditory stimuli was paired to an aversive footshock while the other was not. Similar to Experiment 1, freezing behavior was analyzed upon re-exposure to the contexts in the absence of both the auditory cue and the footshock. The results revealed that RSC is not necessary for rats to use contextual information to successfully discriminate between two contexts under the relatively simple demands involved in this first order conditioning paradigm but that context discrimination is impaired when the processing of complex and/or ambiguous contextual stimuli is required to select appropriate behavioral responses.

A dangerous context changes the way that rats learn about and discriminate between innocuous events in sensory preconditioning

Four experiments used a sensory preconditioning protocol to examine how a dangerous context influences learning about innocuous events. In Experiments 1, 2, and 3, rats were exposed to presentations of a tone followed immediately or 20-sec later by presentations of a light. These tone-light pairings occurred in a context that was either familiar and safe, or equally familiar but dangerous, that is, it was a context in which rats had been exposed to footshock. Rats were next exposed to parings of the light and shock and then tested with the tone (and light). The experiments showed that a dangerous context permits formation of a tone-light association under circumstances that preclude formation of that same association in a safe context (Experiments 1 and 2), and that this facilitative effect on associative formation depends on the content being currently dangerous rather than having been dangerous in the past (Experiment 3). Experiment 4 examined whether a dangerous context facilitates discrimination between two innocuous events. In a safe or dangerous context, rats were exposed to a tone that signaled the light and then to a white noise presented alone. Subsequent to conditioning of the light, the tests revealed that rats that had been exposed to these tone-light and white noise alone presentations in a dangerous context froze to the tone but not to the noise, whereas those exposed in a safe context froze to both the tone and the white noise. The results were related to previous evidence that the amygdala is critical for processing information about innocuous stimuli in a dangerous but not a safe context. They were attributed to an amygdala-based enhancement of arousal and/or attention in a dangerous context, hence the facilitation of associative formation and enhanced discriminability in this context.

Transitions in the temporal parameters of sensory preconditioning during infancy

Sensory preconditioning (SPC) is a form of latent learning in which preexposure to co-occurring neutral stimuli (S1 -S2 ) permits subsequent learning to be transferred from one stimulus (S1 ) to the other (S2 ). We examined whether human infants exhibit developmental transitions in the temporal parameters of SPC by manipulating the preexposure regimen. Infants received simultaneous or sequential preexposure to puppets S1 and S2 (Days 1-2); saw target actions modeled on S1 (Day 3); and were tested for deferred imitation with S2 (Day 4). Although 6-, 9-, and 12-month-olds associated the puppets, there was a shift in the effective regimen from simultaneous to sequential preexposure-similar to prior findings with rat pups (Experiment 1). Experiment 2 revealed that human infants potentially exhibit another transition in SPC at 15 and 18 months of age. We consider the roles of ontogenetic shifts in infants' ecological niche, selective attention, and unitization in developmental transitions in SPC.

Over the river, through the woods: cognitive maps in the hippocampus and orbitofrontal cortex

The hippocampus and the orbitofrontal cortex (OFC) both have important roles in cognitive processes such as learning, memory and decision making. Nevertheless, research on the OFC and hippocampus has proceeded largely independently, and little consideration has been given to the importance of interactions between these structures. Here, evidence is reviewed that the hippocampus and OFC encode parallel, but interactive, cognitive 'maps' that capture complex relationships between cues, actions, outcomes and other features of the environment. A better understanding of the interactions between the OFC and hippocampus is important for understanding the neural bases of flexible, goal-directed decision making.

Learning history and cholinergic modulation in the dorsal hippocampus are necessary for rats to infer the status of a hidden event

Identifying statistical patterns between environmental stimuli enables organisms to respond adaptively when cues are later observed. However, stimuli are often obscured from detection, necessitating behavior under conditions of ambiguity. Considerable evidence indicates decisions under ambiguity rely on inference processes that draw on past experiences to generate predictions under novel conditions. Despite the high demand for this process and the observation that it deteriorates disproportionately with age, the underlying mechanisms remain unknown. We developed a rodent model of decision-making during ambiguity to examine features of experience that contribute to inference. Rats learned either a simple (positive patterning) or complex (negative patterning) instrumental discrimination between the illumination of one or two lights. During test, only one light was lit while the other relevant light was blocked from physical detection (covered by an opaque shield, rendering its status ambiguous). We found experience with the complex negative patterning discrimination was necessary for rats to behave sensitively to the ambiguous test situation. These rats behaved as if they inferred the presence of the hidden light, responding differently than when the light was explicitly absent (uncovered and unlit). Differential expression profiles of the immediate early gene cFos indicated hippocampal involvement in the inference process while localized microinfusions of the muscarinic antagonist, scopolamine, into the dorsal hippocampus caused rats to behave as if only one light was present. That is, blocking cholinergic modulation prevented the rat from inferring the presence of the hidden light. Collectively, these results suggest cholinergic modulation mediates recruitment of hippocampal processes related to past experiences and transfer of these processes to make decisions during ambiguous situations. Our results correspond with correlations observed between human brain function and inference abilities, suggesting our experiments may inform interventions to alleviate or prevent cognitive dysfunction. © 2015 Wiley Periodicals, Inc.

Neural correlates of sensory preconditioning: a preliminary fMRI investigation

Sensory preconditioning (SPC; also known as behaviorally silent learning) consists of a combination of two neutral stimuli, none of which elicits an unconditional response. After one of them is later paired with an unconditional stimulus (US), the other neutral stimulus also yields a conditional response although it has never been paired with the US. In this study, an event-related functional magnetic resonance imaging (fMRI) paradigm was used to specify brain regions involved in SPC. The results demonstrated that SPC was associated with significant changes in activity of several regions, notably, the left amygdala, the left hippocampus, the bilateral thalamus, the bilateral medial globus pallidus, the bilateral cerebellum, the bilateral premotor cortex, and the bilateral middle frontal gyrus. This is a first effort to use fMRI to examine the effects of SPC on brain activation. Our data suggest that there is a distributed network of structures involved in SPC including both cortical and subcortical regions, therefore add to our understanding of the neural mechanisms underlying the ability to associative learning.

The basolateral amygdala is critical for learning about neutral stimuli in the presence of danger, and the perirhinal cortex is critical in the absence of danger

The perirhinal cortex (PRh) and basolateral amygdala (BLA) appear to mediate distinct aspects of learning and memory. Here, we used rats to investigate the involvement of the PRh and BLA in acquisition and extinction of associations between two different environmental stimuli (e.g., a tone and a light) in higher-order conditioning. When both stimuli were neutral, infusion of the GABAA, muscimol, or the NMDA receptor (NMDAR) antagonist ifenprodil into the PRh impaired associative formation. However, when one stimulus was neutral and the other was a learned danger signal, acquisition and extinction of the association between them was unaffected by manipulations targeting the PRh. Temporary inactivation of the BLA had the opposite effect: formation and extinction of an association between two stimuli was spared when both stimuli were neutral, but impaired when one stimulus was a learned danger signal. Subsequent experiments showed that the experience of fear per se shifts processing of an association between neutral stimuli from the PRh to the BLA. When training was conducted in a dangerous environment, formation and extinction of an association between neutral stimuli was impaired by BLA inactivation or NMDAR blockade in this region, but was unaffected by PRh inactivation. These double dissociations in the roles of the PRh and BLA in learning under different stimulus and environmental conditions imply that fear-induced activation of the amygdala changes how the brain processes sensory stimuli. Harmless stimuli are treated as potentially harmful, resulting in a shift from cortical to subcortical processing in the BLA.

Parallel pathways for cross-modal memory retrieval in Drosophila

Memory-retrieval processing of cross-modal sensory preconditioning is vital for understanding the plasticity underlying the interactions between modalities. As part of the sensory preconditioning paradigm, it has been hypothesized that the conditioned response to an unreinforced cue depends on the memory of the reinforced cue via a sensory link between the two cues. To test this hypothesis, we studied cross-modal memory-retrieval processing in a genetically tractable model organism, Drosophila melanogaster. By expressing the dominant temperature-sensitive shibire(ts1) (shi(ts1)) transgene, which blocks synaptic vesicle recycling of specific neural subsets with the Gal4/UAS system at the restrictive temperature, we specifically blocked visual and olfactory memory retrieval, either alone or in combination; memory acquisition remained intact for these modalities. Blocking the memory retrieval of the reinforced olfactory cues did not impair the conditioned response to the unreinforced visual cues or vice versa, in contrast to the canonical memory-retrieval processing of sensory preconditioning. In addition, these conditioned responses can be abolished by blocking the memory retrieval of the two modalities simultaneously. In sum, our results indicated that a conditioned response to an unreinforced cue in cross-modal sensory preconditioning can be recalled through parallel pathways.

Damage to posterior parietal cortex impairs two forms of relational learning

The posterior parietal cortex (PPC) is a component of a major cortico-hippocampal circuit that is involved in relational learning, yet the specific contribution of PPC to hippocampal-dependent learning is unresolved. To address this, two experiments were carried out to test the effects of PPC damage on tasks that involve forming associations between multiple sensory stimuli. In Experiment 1, sham or electrolytic lesions of the PPC were made before rats were tested on a three-phase sensory preconditioning task. During the first phase, half of the training trials consisted of pairings of an auditory stimulus followed by a light. During the other trials, a second auditory stimulus was presented alone. In the next phase of training, the same light was paired with food, but no auditory stimuli were presented. During the final phase of the procedure both auditory stimuli were presented in the absence of reinforcement during a single test session. As is typically observed during the test session, control rats exhibited greater conditioned responding to the auditory cue that was previously paired with light compared to the unpaired cue. In contrast, PPC-lesioned rats responded equally to both auditory cues. In Experiment 2, PPC-lesioned and control rats were trained in a compound feature negative discrimination task consisting of reinforced presentations of a tone-alone and non-reinforced simultaneous presentations of a light-tone compound stimulus. Control rats but not rats with damage to the PPC successfully learned the discrimination. Collectively, these results support the idea that the PPC contributes to relational learning involving multimodal sensory stimuli, perhaps by regulating the attentional processing of conditioned stimuli.

Involvement of retrosplenial cortex in forming associations between multiple sensory stimuli

The retrosplenial cortex (RSP) is highly interconnected with medial temporal lobe structures, yet relatively little is known about its specific contributions to learning and memory. One possibility is that RSP is involved in forming associations between multiple sensory stimuli. Indeed, damage to RSP disrupts learning about spatial or contextual cues and also impairs learning about co-occurring conditioned stimuli (CSs). Two experiments were conducted to test this notion more rigorously. In Experiment 1, rats were trained in a serial feature negative discrimination task consisting of reinforced presentations of a tone alone and nonreinforced serial presentations of a light followed by the tone. Thus, in contrast to prior studies, this paradigm involved serial presentation of conditioned stimuli (CS), rather than simultaneous presentation. Rats with damage to RSP failed to acquire the discrimination, indicating that RSP is required for forming associations between sensory stimuli regardless of whether they occur serially or simultaneously. In Experiment 2, a sensory preconditioning task was used to determine if RSP was necessary for forming associations between stimuli even in the absence of reinforcement. During the first phase of this procedure, one auditory stimulus was paired with a light while a second auditory stimulus was presented alone. In the next phase of training, the same light was paired with food. During the final phase of the procedure both auditory stimuli were presented alone during a single session. Control, but not RSP-lesioned rats, exhibited more food cup behavior following presentation of the auditory cue that was previously paired with light compared with the unpaired auditory stimulus, indicating that a stimulus-stimulus association was formed during the first phase of training. These results support the idea that RSP has a fundamental role in forming associations between environmental stimuli.

The entorhinal cortex, but not the dorsal hippocampus, is necessary for single-cue latent learning

Two experiments were conducted to examine the roles of the entorhinal cortex (EC), dorsal hippocampus (DH), and ventral hippocampus (VH) in a modified Latent Cue Preference (LCP) task. The modified LCP task utilized one visual cue in each compartment, compared to several multimodal cues used in a previous version. In the single-cue LCP task, water-replete rats drink water in one compartment of the LCP box on 1 day, and then have no water in a second compartment of the LCP box the following day (one training trial), for a total of three training trials. Rats are then water-deprived prior to a preference test, in which they are allowed to move freely between the two compartments with the water removed. Latent learning is demonstrated when water-deprived rats spend more time in the compartment that previously contained the water. Experiment 1 demonstrated that the single-cue LCP task results in the same irrelevant-incentive latent learning as the multicue LCP task. In addition, Experiment 1 replicated the finding that a compartment preference based on this latent learning requires a deprivation state during the preference test, while a compartment preference based on conditioning does not. Experiment 2 examined the effects of pretraining neurotoxin lesions of the EC, DH, and VH on this single-cue LCP task. Results showed that lesions of the EC and VH disrupted the irrelevant-incentive latent learning, while lesions of the DH did not. These results indicate that a latent learning task that involves one discrete compartment cue, rather than several compartmental cues, does not require the DH. Therefore, the EC appears to play a central role in single-cue latent learning in the LCP task.

Conceptual similarity promotes generalization of higher order fear learning

We tested the hypothesis that conceptual similarity promotes generalization of conditioned fear. Using a sensory preconditioning procedure, three groups of subjects learned an association between two cues that were conceptually similar, unrelated, or mismatched. Next, one of the cues was paired with a shock. The other cue was then reintroduced to test for fear generalization, as measured by the skin conductance response. Results showed enhanced fear generalization that correlated with trait anxiety levels in the group that learned an association between conceptually similar stimuli. These findings suggest that conceptual representations of conditional stimuli influence human fear learning processes.

The basolateral amygdala is critical for the acquisition and extinction of associations between a neutral stimulus and a learned danger signal but not between two neutral stimuli

We studied the neural substrates of higher-order conditioned fear in rats. We first studied acquisition and extinction of second-order fear. One stimulus (S1) was paired with a footshock unconditioned stimulus (US), a second stimulus (S2) was paired with S1, and, finally, fear of S2 was extinguished by S2 alone exposures. Reversible inactivation of the basolateral amygdala (BLA) via muscimol, systemic injection of the NMDA receptor (NMDAr) antagonist MK-801 [(+)-5-methyl-10,11-dihydro-5H-dibenzo [a,d] cyclohepten-5,10-imine maleate], or intra-amygdala infusion of the NMDAr NR2B subunit selective antagonist ifenprodil impaired both acquisition and extinction of fear to S2. We then studied acquisition and extinction of sensory preconditioned fear. S2 was first paired with S1, S1 was then paired with the US, and, finally, fear of S2 was extinguished by S2 alone exposures. Extinction of sensory preconditioned fear was impaired by a BLA infusion of muscimol or ifenprodil and by MK-801. Acquisition of the S2-S1 association and extinction of this association by S2 alone exposures before conditioning of S1 was impaired by MK-801 but not by a BLA infusion of muscimol. These results show that NMDAr activation in the BLA is critical for acquisition of second-order conditioned fear and for the extinction of both second-order and sensory preconditioned fear just as it is for acquisition and extinction of first-order conditioned fear. Acquisition and extinction of an association between two neutral stimuli also require NMDAr activation. However, the present results show that the acquisition and extinction of these associations do not require the BLA.

Associatively learned representations of taste outcomes activate taste-encoding neural ensembles in gustatory cortex

Through learning processes, cues associated with emotionally salient reinforcing outcomes can come to act as substitutes for the reinforcer itself. According to one account of this phenomenon, the predictive cue associatively elicits a representation of the expected outcome by reactivating cells responsible for encoding features of the primary reinforcer. We tested this hypothesis by examining the role of neural ensembles in gustatory cortex (GC) during receipt of gustatory stimuli (sucrose and water) and cues associated with those stimuli using the immediate early genes (IEGs) Arc and Homer1a. Because these plasticity-related IEGs are expressed in the neuronal nucleus 5 and 30 min, respectively, after salient events, we examined how individual neurons encoded these stimuli in two separate behavioral epochs. In experiment 1, we showed that tasting identical sucrose solutions, but not tasteless water, in the two epochs increased both IEG activity and the degree of overlap between neural ensembles in GC. In experiment 2, odor cues associated with sucrose, but not water, evoked potentiation of IEG activity in GC similar to sucrose itself. Surprisingly, lesions of the basolateral amygdala had minimal effects on associative encoding in GC. Finally, these associatively driven representations of sucrose appeared to be outcome specific, as neural ensembles that were activated by the sucrose-associated cue were also activated by sucrose itself. This degree of overlap between associative and primary taste activity at the ensemble level suggests that GC neurons encode important information about anticipated outcomes. Such representations may provide outcome-specific information for guiding goal-directed behavior.

Cerebellar inactivation impairs cross modal savings of eyeblink conditioning

Eyeblink conditioning using a conditioned stimulus (CS) from one sensory modality (e.g., an auditory CS) is greatly enhanced when the subject is previously trained with a CS from a different sensory modality (e.g., a visual CS). The enhanced acquisition to the second modality CS results from cross modal savings. The current study was designed to examine the role of the cerebellum in establishing cross modal savings in eyeblink conditioning with rats. In the first experiment rats were given paired or unpaired presentations with a CS (tone or light) and an unconditioned stimulus. All rats were then given paired training with a different modality CS. Only rats given paired training showed cross modal savings to the second modality CS. Experiment 2 showed that cerebellar inactivation during initial acquisition to the first modality CS completely prevented savings when training was switched to the second modality CS. Experiment 3 showed that cerebellar inactivation during initial cross modal training also prevented savings to the second modality stimulus. These results indicate that the cerebellum plays an essential role in establishing cross modal savings of eyeblink conditioning.

A neurocomputational model of classical conditioning phenomena: a putative role for the hippocampal region in associative learning

Some existing models of hippocampal function simulate performance in classical conditioning tasks using the error backpropagation algorithm to guide learning (Gluck, M.A., and Myers, C.E., (1993). Hippocampal mediation of stimulus representation: a computational theory. Hippocampus, 3(4), 491-516.). This algorithm is not biologically plausible because it requires information to be passed backward through layers of nodes and assumes that the environment provides information to the brain about what correct outputs should be. Here, we show that the same information-processing function proposed for the hippocampal region in the Gluck and Myers (1993) model can also be implemented in a network without using the backpropagation algorithm. Instead, our newer instantiation of the theory uses only (a) Hebbian learning methods which match more closely with synaptic and associative learning mechanisms ascribed to the hippocampal region and (b) a more plausible representation of input stimuli. We demonstrate here that this new more biologically plausible model is able to simulate various behavioral effects, including latent inhibition, acquired equivalence, sensory preconditioning, negative patterning, and context shift effects. In addition, the newer model is able to address some new phenomena including the effect of the number of training trials on blocking and overshadowing.

Metabolic mapping of rat forebrain and midbrain during delay and trace eyeblink conditioning

While the essential neural circuitry for delay eyeblink conditioning has been largely identified, much of the neural circuitry for trace conditioning has yet to be determined. The major difference between delay and trace conditioning is a time gap between the presentation of the conditioned stimulus (CS) and the unconditioned stimulus (US) during trace conditioning. It is this time gap, which accounts for the additional memory component and may require extra neural structures, including hippocampus and prefrontal cortex. A metabolic marker of energy use, radioactively labeled glucose analog, was used to compare differences in glucose analog uptake between delay, trace, and unpaired experimental groups (rats, Long-Evans), to identify possible new areas of involvement within forebrain and midbrain. Here, we identify increased 2-DG uptake for the delay group compared to the unpaired group in various areas including: the medial geniculate nuclei (MGN), the amygdala, cingulate cortex, auditory cortex, medial dorsal thalamus, and frontal cortices. For the trace group, compared to the unpaired group, there was an increase in 2-DG uptake for the medial orbital frontal cortex and the medial MGN. The trace group also exhibited more increases lateralized to the right hemisphere, opposite to the side of US delivery, in various areas including: CA1, subiculum, presubiculum, perirhinal cortex, ventral and dorsal MGN, and the basolateral and central amygdala. While some of these areas have been identified as important for delay or trace conditioning, some new structures have been identified such as the orbital frontal cortex for both delay and trace groups.

Multiple memory systems are unnecessary to account for infant memory development: an ecological model

How the memory of adults evolves from the memory abilities of infants is a central problem in cognitive development. The popular solution holds that the multiple memory systems of adults mature at different rates during infancy. The early-maturing system (implicit or nondeclarative memory) functions automatically from birth, whereas the late-maturing system (explicit or declarative memory) functions intentionally, with awareness, from late in the first year. Data are presented from research on deferred imitation, sensory preconditioning, potentiation, and context for which this solution cannot account and present an alternative model that eschews the need for multiple memory systems. The ecological model of infant memory development (N. E. Spear, 1984) holds that members of all species are perfectly adapted to their niche at each point in ontogeny and exhibit effective, evolutionarily selected solutions to whatever challenges each new niche poses. Because adults and infants occupy different niches, what they perceive, learn, and remember about the same event differs, but their raw capacity to learn and remember does not.

On the interdependence of cognition and emotion

Affect and cognition have long been treated as independent entities, but in the current review we suggest that affect and cognition are in fact highly interdependent. We open the article by discussing three classic views for the independence of affect. These are (i) the affective independence hypothesis, that emotion is processed independently from cognition, (ii) the affective primacy hypothesis, that evaluative processing precedes semantic processing, and (iii) the affective automaticity hypothesis, that affectively potent stimuli commandeer attention and evaluation is automatic. We argue that affect is not independent from cognition, that affect is not primary to cognition, nor is affect automatically elicited. The second half of the paper discusses several instances of how affect influences cognition. We review experiments showing affective involvement in perception, semantic activation, and attitude activation. We conclude that one function of affect is to regulate cognitive processing.

Lesions of the basolateral amygdala disrupt conditioning based on the retrieved representations of motivationally significant events

One recent perspective (Blundell et al., 2001; 2003; Killcross and Blundell, 2002; Balleine et al. 2003) on the function of the basolateral region of the amygdala (BLA) suggests that it plays an important role in the representation of the sensory features of motivationally significant events. This predicts that lesions of the BLA will not produce a decrement in performance in conditioning procedures based on the formation of associations between the sensory aspects of neutral events but will interfere with conditioning based on associations between neutral cues and motivationally significant events. This prediction is supported by the evidence that BLA lesions were without effect on a sensory preconditioning procedure (experiment 1A) that used neutral cues but that BLA lesions did significantly impair representation-mediated conditioning (experiment 1B) when the target cues were motivationally significant at the time of training. These results demonstrate that animals with lesions of the BLA can represent the sensory aspects of neutral events but not the sensory aspects of motivationally significant events.

Perirhinal cortex lesions impair simultaneous but not serial feature-positive discrimination learning

The role of the perirhinal cortex in discriminative eyeblink conditioning was examined by means of feature-positive discrimination procedures with simultaneous (A-/XA+) and serial (A-/X-->A+) stimulus compounds. Lesions of the perirhinal cortex severely impaired acquisition of simultaneous feature-positive discrimination but produced no impairment in serial feature-positive discrimination. The results suggest that the perirhinal cortex plays a role in discriminative eyeblink conditioning by resolving ambiguity in discriminations with overlapping stimulus elements.

Semantic Processing Precedes Affect Retrieval: The Neurological Case for Cognitive Primacy in Visual Processing

According to the affective primacy hypothesis, visual stimuli can be evaluated prior to and independent of object identification and semantic analysis (Zajonc, 1980, 2000 ). Our review concludes that the affective primacy hypothesis is, from the available evidence, not likely correct. Although people can react to objects that they cannot consciously identify, such affective reactions are dependent upon prior semantic analysis within the visual cortex. The authors propose that the features of objects must first be integrated, and then the objects themselves must be categorized and identified, all prior to affective analysis. Additionally, the authors offer a preliminary neurological analysis of the mere exposure and affective priming effects that is consistent with the claim that semantic analysis is needed to elicit these effects. In sum, the authors conclude that the brain must know what something is in order to know whether it is good or bad.

Excitotoxic Lesions of the Entorhinal Cortex Leave Gustatory Within-Event Learning Intact

The ability of rats with ibotenate lesions of the entorhinal cortex to form memories for events was assessed by using a gustatory within-event learning procedure. Rats first received exposure to 2 events, AX and BY, each composed of a pair of flavors. Following this exposure period, Flavor X alone was paired with the delivery of lithium chloride. Lesioned and control rats showed a greater aversion to A than to B and to AX than to BX. These results challenge theories that suppose that the entorhinal cortex plays a general role in forming representations of patterns of stimulation.

Objects and Positions in Visual Scenes: Effects of Perirhinal and Postrhinal Cortex Lesions in the Rat

The authors assessed rats' encoding of the appearance or egocentric position of objects within visual scenes containing 3 objects (Experiment 1) or 1 object (Experiment 2A). Experiment 2B assessed encoding of the shape and fill pattern of single objects, and encoding of configurations (object + position, shape + fill). All were assessed by testing rats' ability to discriminate changes from familiar scenes (constant-negative paradigm). Perirhinal cortex lesions impaired encoding of objects and their shape; postrhinal cortex lesions impaired encoding of egocentric position, but the effect may have been partly due to entorhinal involvement. Neither lesioned group was impaired in detecting configural change. In Experiment 1, both lesion groups were impaired in detecting small changes in relative position of the 3 objects, suggesting that more sensitive tests might reveal configural encoding deficits.

Preserved sensitivity to outcome value after lesions of the basolateral amygdala

Recent work (Blundell et al., 2001; Balleine et al., 2003) has suggested that the basolateral region of the amygdala (BLA) is important in the representation of the sensory and incentive aspects of motivationally significant events. In common with other theories of function of the BLA, this predicts that lesions of the BLA will interfere with reinforcer devaluation after appetitive Pavlovian or instrumental conditioning. However, this hypothesis also predicts that BLA lesions will be without effect on postconditioning changes in reinforcer value if initial learning is only about the sensory aspects of otherwise neutral events. This interpretation is supported by evidence for significant detrimental effects of BLA lesions on reinforcer devaluation in a Pavlovian autoshaping procedure, but no effect of postconditioning devaluation using a sensory preconditioning procedure. These results demonstrate that animals with BLA lesions can remain sensitive to post-training changes in the motivational value of outcomes.

Hippocampal function during behaviorally silent associative learning: dissociation of memory storage and expression

In laboratory studies, the assessment of memory is typically associated with overt behavioral responses. Thus, it has been difficult to determine whether the enhancement of hippocampal sensory-evoked potentials that often accompany memory formation are the neurophysiological manifestation of a memory "trace" or are a secondary product of the behavioral expression of the memory. We addressed this issue by examining changes in evoked hippocampal field potentials during sensory preconditioning, a form of behaviorally silent relational learning that requires an intact hippocampus for execution. Rats were exposed to presentations of a white noise (S1) that terminated with a tone (S2). These pairings of ostensibly "neutral" stimuli supported no change in the behavior elicited by the noise. However, if the tone was subsequently paired with mild footshock (US), suppression of ongoing licking behavior (indicative of fear) was elicited by the noise, indicating that the animal had associated the noise with tone (S1-S2), and had represented the noise-tone-shock (S1-S2-US) relationship. Pre-training neurotoxic lesions of the hippocampus had no effect on conditioned suppression to tone after tone-shock (S2-US) pairings, but disrupted the expression of continued suppression to noise (S1) after tone-shock pairings. In a second experiment, sensory-evoked field potentials in the dorsal hippocampus were recorded with extracellular electrodes. No changes in the hippocampal response evoked by white noise were observed after pairings of noise and tone, i.e., no evidence for a memory trace could be detected. In contrast, after tone was paired with footshock, two short-latency negative potentials within the noise-evoked field response increased in amplitude, a response often presumed to reflect a neurophysiological correlate of memory storage. In total, these results suggest that although the hippocampus critically contributes to the processing of a behaviorally silent associative memory, there may be no role for changes in the amplitude of hippocampal sensory-evoked field potentials in storing representations of the relationships between sensory experiences.

Emotion and motivation: the role of the amygdala, ventral striatum, and prefrontal cortex

Emotions are multifaceted, but a key aspect of emotion involves the assessment of the value of environmental stimuli. This article reviews the many psychological representations, including representations of stimulus value, which are formed in the brain during Pavlovian and instrumental conditioning tasks. These representations may be related directly to the functions of cortical and subcortical neural structures. The basolateral amygdala (BLA) appears to be required for a Pavlovian conditioned stimulus (CS) to gain access to the current value of the specific unconditioned stimulus (US) that it predicts, while the central nucleus of the amygdala acts as a controller of brainstem arousal and response systems, and subserves some forms of stimulus-response Pavlovian conditioning. The nucleus accumbens, which appears not to be required for knowledge of the contingency between instrumental actions and their outcomes, nevertheless influences instrumental behaviour strongly by allowing Pavlovian CSs to affect the level of instrumental responding (Pavlovian-instrumental transfer), and is required for the normal ability of animals to choose rewards that are delayed. The prelimbic cortex is required for the detection of instrumental action-outcome contingencies, while insular cortex may allow rats to retrieve the values of specific foods via their sensory properties. The orbitofrontal cortex, like the BLA, may represent aspects of reinforcer value that govern instrumental choice behaviour. Finally, the anterior cingulate cortex, implicated in human disorders of emotion and attention, may have multiple roles in responding to the emotional significance of stimuli and to errors in performance, preventing responding to inappropriate stimuli.

Medial dorsal thalamic lesions impair blocking and latent inhibition of the conditioned eyeblink response in rats

The effects of lesions of the medial dorsal thalamic nucleus (MD) on blocking and latent inhibition (LI) of the rat eyeblink response were examined in the present study. Previous work has demonstrated that the cingulate cortex and related thalamic areas are involved in processing conditioning stimuli throughout training. The experiments in the present study tested the hypothesis that disruption of cingulothalamic stimulus processing produced by lesions of the MD would impair 2 types of associative learning that involve decremental changes in attention. In Experiment 1, MD lesions severely impaired blocking. In Experiment 2, MD lesions severely impaired LI. The results indicate that lesions of the MD impair incremental, decremental, or both types of changes in stimulus processing during learning.