Higher-order conditioning and the retrosplenial cortex

The Basolateral Amygdala: The Core of a Network for Threat Conditioning, Extinction, and Second-Order Threat Conditioning

Threat conditioning, extinction, and second-order threat conditioning studied in animal models provide insight into the brain-based mechanisms of fear- and anxiety-related disorders and their treatment. Much attention has been paid to the role of the basolateral amygdala (BLA) in such processes, an overview of which is presented in this review. More recent evidence suggests that the BLA serves as the core of a greater network of structures in these forms of learning, including associative and sensory cortices. The BLA is importantly regulated by hippocampal and prefrontal inputs, as well as by the catecholaminergic neuromodulators, norepinephrine and dopamine, that may provide important prediction-error or learning signals for these forms of learning. The sensory cortices may be required for the long-term storage of threat memories. As such, future research may further investigate the potential of the sensory cortices for the long-term storage of extinction and second-order conditioning memories.

Higher-order trace conditioning in newborn rabbits

Temporal contingency is a key factor in associative learning but remains weakly investigated early in life. Few data suggest simultaneous presentation is required for young to associate different stimuli, whereas adults can learn them sequentially. Here, we investigated the ability of newborn rabbits to perform sensory preconditioning and second-order conditioning using trace intervals between odor presentations. Strikingly, pups are able to associate odor stimuli with 10- and 30-sec intervals in sensory preconditioning and second-order conditioning, respectively. The effectiveness of higher-order trace conditioning in newborn rabbits reveals that very young animals can display complex learning despite their relative immaturity.

The neural substrates of higher-order conditioning: A review

Sensory preconditioned and second-order conditioned responding are each well-documented. The former occurs in subjects (typically rats) exposed to pairings of two relatively neutral stimuli, S2 and S1, and then to pairings of S1 and a motivationally significant event [an unconditioned stimulus (US)]; the latter occurs when the order of these experiences is reversed with rats being exposed to S1-US pairings and then to S2-S1 pairings. In both cases, rats respond when tested with S2 in a manner appropriate to the affective nature of the US, e.g., approach when the US is appetitive and withdrawal when it is aversive. This paper reviews the neural substrates of sensory preconditioning and second-order conditioning. It identifies commonalities and differences in the substrates of these so-called higher-order conditioning protocols and discusses these commonalities/differences in relation to what is learned. In so doing, the review highlights ways in which these types of conditioning enhance our understanding of how the brain encodes and retrieves different types of information to generate appropriate behavior.

Examining a role for the retrosplenial cortex in age-related memory impairment

Aging is often characterized by changes in the ability to form and accurately recall episodic memories, and this is especially evident in neuropsychiatric conditions including Alzheimer's disease and dementia. Memory impairments and cognitive decline associated with aging mirror the impairments observed following damage to the retrosplenial cortex, suggesting that this region might be important for continued cognitive function throughout the lifespan. Here, we review lines of evidence demonstrating that degeneration of the retrosplenial cortex is critically involved in age-related memory impairment and suggest that preservation of function in this region as part of a larger circuit that supports memory maintenance will decrease the deleterious effects of aging on memory processing.

The retrosplenial cortex as a possible "sensory integration" area: A neural network modeling approach of the differential outcomes effect in negative patterning

We explored the hypothesis that learning a Pavlovian negative patterning task would be facilitated when training with differential, as opposed to non-differential, reinforcing outcomes. Two groups of rats received pairings of one visual and one auditory stimulus with food reward when these stimuli were presented on separate training trials, but without reward when both stimuli were presented on simultaneous stimulus compound trials (V+, A+, AV-; similar to an XOR problem). For Group Differential, each stimulus was separately paired with distinctively tasting food rewards, whereas for Group Non-Differential each stimulus was randomly paired with both food reward types across different stimulus element trials. We observed that rats learned the negative patterning task more rapidly and effectively when trained with differential outcomes. These data support a multi-layered connectionist model introduced by Delamater (2012) in which a multi-modal processing structure plays the role of a "sensory integration" area like that hypothesized for the retrosplenial cortex by Dave Bucci and his colleagues (e.g., Todd, Fournier, & Bucci, 2019). We discuss how such a region may develop different "negative occasion setting" and "configural inhibition" mechanisms in solving negative patterning and related tasks.

Contributions of the rodent cingulate-retrosplenial cortical axis to associative learning and memory: A proposed circuit for persistent memory maintenance

While the anterior cingulate (ACC) and retrosplenial (RSC) cortices have been extensively studied for their role in spatial navigation, less is known about how they contribute to associative learning and later memory recall. The limited work that has been conducted on this topic suggests that each of these cortical regions makes distinct, but similar contributions to associative learning and memory. Here, we review evidence from the rodent literature demonstrating that while ACC activity seems to be necessary at remote time points associated with imprecise or generalized memories, the role of the RSC seems to be uniform over time. Together, the lines of evidence reviewed here suggest that the ACC and RSC likely function together to support memory formation and maintenance following associative learning.

Higher-Order Conditioning and Dopamine: Charting a Path Forward

Higher-order conditioning involves learning causal links between multiple events, which then allows one to make novel inferences. For example, observing a correlation between two events (e.g., a neighbor wearing a particular sports jersey), later helps one make new predictions based on this knowledge (e.g., the neighbor's wife's favorite sports team). This type of learning is important because it allows one to benefit maximally from previous experiences and perform adaptively in complex environments where many things are ambiguous or uncertain. Two procedures in the lab are often used to probe this kind of learning, second-order conditioning (SOC) and sensory preconditioning (SPC). In second-order conditioning (SOC), we first teach subjects that there is a relationship between a stimulus and an outcome (e.g., a tone that predicts food). Then, an additional stimulus is taught to precede the predictive stimulus (e.g., a light leads to the food-predictive tone). In sensory preconditioning (SPC), this order of training is reversed. Specifically, the two neutral stimuli (i.e., light and tone) are first paired together and then the tone is paired separately with food. Interestingly, in both SPC and SOC, humans, rodents, and even insects, and other invertebrates will later predict that both the light and tone are likely to lead to food, even though they only experienced the tone directly paired with food. While these processes are procedurally similar, a wealth of research suggests they are associatively and neurobiologically distinct. However, midbrain dopamine, a neurotransmitter long thought to facilitate basic Pavlovian conditioning in a relatively simplistic manner, appears critical for both SOC and SPC. These findings suggest dopamine may contribute to learning in ways that transcend differences in associative and neurological structure. We discuss how research demonstrating that dopamine is critical to both SOC and SPC places it at the center of more complex forms of cognition (e.g., spatial navigation and causal reasoning). Further, we suggest that these more sophisticated learning procedures, coupled with recent advances in recording and manipulating dopamine neurons, represent a new path forward in understanding dopamine's contribution to learning and cognition.

Rat Retrosplenial Cortical Involvement in Wayfinding Using Visual and Locomotor Cues

The retrosplenial cortex (RSC) has been implicated in wayfinding using different sensory cues. However, the neural mechanisms of how the RSC constructs spatial representations to code an appropriate route under different sensory cues are unknown. In this study, rat RSC neurons were recorded while rats ran on a treadmill affixed to a motion stage that was displaced along a figure-8-shaped track. The activity of some RSC neurons increased during specific directional displacements, while the activity of other neurons correlated with the running speed on the treadmill regardless of the displacement directions. Elimination of visual cues by turning off the room lights and/or locomotor cues by turning off the treadmill decreased the activity of both groups of neurons. The ensemble activity of the former group of neurons discriminated displacements along the common central path of different routes in the track, even when visual or locomotor cues were eliminated where different spatial representations must be created based on different sensory cues. The present results provide neurophysiological evidence of an RSC involvement in wayfinding under different spatial representations with different sensory cues.

Mechanisms of higher-order learning in the amygdala

Adaptive behaviour is under the potent control of environmental cues. Such cues can acquire value by virtue of their associations with outcomes of motivational significance, be they appetitive or aversive. There are at least two ways through which an environmental cue can acquire value, through first-order and higher-order conditioning. In first-order conditioning, a neutral cue is directly paired with an outcome of motivational significance. In higher-order conditioning, a cue is indirectly associated with motivational events via a directly conditioned first-order stimulus. The present article reviews some of the associations that support learning in first- and higher-order conditioning, as well as the role of the BLA and the molecular mechanisms involved in these two types of learning.

Cortical Contributions to Higher-Order Conditioning: A Review of Retrosplenial Cortex Function

In higher-order conditioning paradigms, such as sensory preconditioning or second-order conditioning, discrete (e.g., phasic) or contextual (e.g., static) stimuli can gain the ability to elicit learned responses despite never being directly paired with reinforcement. The purpose of this mini-review is to examine the neuroanatomical basis of high-order conditioning, by selectively reviewing research that has examined the role of the retrosplenial cortex (RSC) in sensory preconditioning and second-order conditioning. For both forms of higher-order conditioning, we first discuss the types of associations that may occur and then review findings from RSC lesion/inactivation experiments. These experiments demonstrate a role for the RSC in sensory preconditioning, suggesting that this cortical region might contribute to higher-order conditioning via the encoding of neutral stimulus-stimulus associations. In addition, we address knowledge gaps, avenues for future research, and consider the contribution of the RSC to higher-order conditioning in relation to related brain structures.

Ceftriaxone inhibits stress-induced bladder hyperalgesia and alters cerebral micturition and nociceptive circuits in the rat: A multidisciplinary approach to the study of urologic chronic pelvic pain syndrome research network study

AIMS

Emotional stress plays a role in the exacerbation and development of interstitial cystitis/bladder pain syndrome (IC/BPS). Given the significant overlap of brain circuits involved in stress, anxiety, and micturition, and the documented role of glutamate in their regulation, we examined the effects of an increase in glutamate transport on central amplification of stress-induced bladder hyperalgesia, a core feature of IC/BPS.

METHODS

Wistar-Kyoto rats were exposed to water avoidance stress (WAS, 1 hour/day x 10 days) or sham stress, with subgroups receiving daily administration of ceftriaxone (CTX), an activator of glutamate transport. Thereafter, cystometrograms were obtained during bladder infusion with visceromotor responses (VMR) recorded simultaneously. Cerebral blood flow (CBF) mapping was performed by intravenous injection of [¹⁴ C]-iodoantipyrine during passive bladder distension. Regional CBF was quantified in autoradiographs of brain slices and analyzed in three dimensional reconstructed brains with statistical parametric mapping.

RESULTS

WAS elicited visceral hypersensitivity during bladder filling as demonstrated by a decreased pressure threshold and VMR threshold triggering the voiding phase. Brain maps revealed stress effects in regions noted to be responsive to bladder filling. CTX diminished visceral hypersensitivity and attenuated many stress-related cerebral activations within the supraspinal micturition circuit and in overlapping limbic and nociceptive regions, including the posterior midline cortex (posterior cingulate/anterior retrosplenium), somatosensory cortex, and anterior thalamus.

CONCLUSIONS

CTX diminished bladder hyspersensitivity and attenuated regions of the brain that contribute to nociceptive and micturition circuits, show stress effects, and have been reported to demonstrated altered functionality in patients with IC/BPS. Glutamatergic pharmacologic strategies modulating stress-related bladder dysfunction may be a novel approach to the treatment of IC/BPS.

Retrosplenial cortex and its role in cue-specific learning and memory

The retrosplenial cortex (RSC) contributes to spatial navigation, as well as contextual learning and memory. However, a growing body of research suggests that the RSC also contributes to learning and memory for discrete cues, such as auditory or visual stimuli. In this review, we summarize and assess the Pavlovian and instrumental conditioning experiments that have examined the role of the RSC in cue-specific learning and memory. We use the term cue-specific to refer to these putatively non-spatial conditioning paradigms that involve discrete cues. Although these paradigms emphasize behavior related to cue presentations, we note that cue-specific learning and memory always takes place against a background of contextual stimuli. We review multiple ways by which contexts can influence responding to discrete cues and suggest that RSC contributions to cue-specific learning and memory are intimately tied to contextual learning and memory. Indeed, although the RSC is involved in several forms of cue-specific learning and memory, we suggest that many of these can be linked to processing of contextual stimuli.

Fear-context association during memory retrieval requires input from granular to dysgranular retrosplenial cortex

The contribution of the granular (area 29, A29) and dysgranular (area 30, A30) subdivisions of the retrosplenial cortex (RSC) to contextual fear memory (CFM) retrieval remains elusive. Here, intact and orchiectomized (ORC) male rats received an intraperitoneal (I.P.) injection of saline (control) or 5 mg/Kg MK801 after training and memory formation. In ORC, but not in intact males, this MK801 treatment selectively induces overt loss of neurons in layers IV-Va of A29 (A29^MK801 neurons) (Sigwald et al., 2016). Compared to ORC-saline, ORC-MK801 rats showed impaired CFM retrieval in an A-B-A design for contextual fear conditioning (CFC), however context recognition was not affected. In ORC-MK801 rats, neither novel object recognition nor object-in-context discrimination were impaired, further indicating that A29^MK801 neurons are not required for contextual recognition. Elevated plus maze test showed that anxiety-like behavior was not affected in ORC-MK801 animals, suggesting that loss of A29^MK801 neurons does not affect the emotional state that could impair freezing during test. Importantly, in a sensory preconditioning test, higher order CFM retrieval was abolished in ORC-MK801, but not in male-MK801. Collectively, these observations indicate that A29^MK801 neurons are critically required for retrieving fear-context association. For dissecting the anatomofunctional contribution of A29^MK801 neurons to CFM retrieval, expression of c-Fos and Egr-1 was used to map brain-wide neuronal activity. In control male rats CFC and CFM retrieval was associated with significant enhancement of both proteins in limbic structures and A30, but not in A29, suggesting that neurons in A30 and limbic structures encode and store the associative experience. Notably, in ORC but not in intact males, MK801 impairs CFM retrieval and expression of c-Fos and Egr-1 proteins in A30, without affecting their expression in limbic structures. Thus, the loss of A29^MK801 neurons after CFM formation precludes activation of associative neurons in A30, impairing CFM recall. FluoroGold retrograde track-tracing confirmed that A29^MK801 neurons project to A30. Silver staining provide evidence that MK801 in ORC rats induces axonal deafferentation of A29^MK801 neuron in A30. Collectively, our experiments provide the first evidence that A30 neurons participate in encoding and storing CFM while A29 is required for their activation during recall.

Permanent damage or temporary silencing of retrosplenial cortex impairs the expression of a negative patterning discrimination

The retrosplenial cortex (RSC) is positioned at the interface between cortical sensory regions and the hippocampal/parahippocampal memory system. As such, it has been theorized that RSC may have a fundamental role in linking sensory stimuli together in the service of forming complex representations. To test this, three experiments were carried out to determine the effects of RSC damage or temporary inactivation on learning or performing a negative patterning discrimination. In this procedure, two conditioned stimuli are reinforced when they are presented individually (i.e., stimulus elements) but are non-reinforced when they are presented simultaneously as a compound stimulus. Normal rats successfully discriminate between the two types of trials as evidenced by more responding to the elements compared to the compound stimulus. This is thought to reflect the formation of a configural representation of the compound stimulus; that is, the two cues are linked together in such a fashion that the compound stimulus is a wholly different, unique stimulus. Permanent lesions of RSC made prior to training (Experiment 1) had no effect on learning the discrimination. However, lesions (Experiment 2) or temporary chemogenetic inactivation (Experiment 3) of RSC made after training impaired subsequent performance of the discrimination. We argue that this pattern of results indicates that RSC may normally be involved in forming the configural representations manifested in negative patterning, but that absent the RSC, other brain systems or structures can compensate sufficiently to result in normal behavior.

When is the rat retrosplenial cortex required for stimulus integration?

The rodent retrosplenial cortex is known to be vital for spatial cognition, but evidence has also pointed to a role in processing nonspatial information. It has been suggested that the retrosplenial cortex may serve as a site of integration of incoming sensory information. To examine this proposal, the current set of experiments assessed the impact of excitotoxic lesions in the retrosplenial cortex on two behavioral tasks that tax animals' ability to process multiple and overlapping environmental stimuli. In Experiment 1, rats with retrosplenial lesions acquired a negative patterning discrimination, a form of configural learning that can be solved only by learning the conjunction of cues. Subsequent transfer tests confirmed that both the lesion and control animals had solved the task by using configural representations. Furthermore, in Experiment 2, a 2nd cohort of retrosplenial lesion animals successfully acquired conditioned inhibition. Nevertheless, the same animals failed a subsequent summation test that assesses the ability to transfer what has been learned about one stimulus to another stimulus in the absence of reinforcement. Taken together, these results suggest that in the nonspatial domain, the retrosplenial cortex is not required for forming associations between multiple or overlapping environmental stimuli and, consequently, retrosplenial engagement in such processes is more selective than was previously envisaged. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Retrosplenial cortex has a time-dependent role in memory for visual stimuli

Although the retrosplenial cortex (RSC) is critically involved in spatial learning and memory, it appears to have more selective contributions to learning and memory for discrete cues. For example, damage to the RSC does not impair Pavlovian delay fear conditioning to a discrete auditory cue (e.g., tone), when RSC manipulation occurs just prior to, or shortly after, conditioning. In contrast, when lesions of the RSC occur following a substantial retention interval (e.g., 28 days), the RSC is necessary for retrieval of fear to the tone. Thus, the RSC makes time-dependent contributions to memory retrieval for discrete auditory cues. The purpose of the current experiment was to assess if the time-dependent involvement of the RSC in cue-specific fear memory extended to cues of other sensory modalities. Rats firsts underwent fear conditioning to a visual stimulus, and lesions of the RSC subsequently occurred 1 or 28 days later. Lesions of the RSC impaired fear expression when made 28 days after conditioning, but not when made 1 day following conditioning. Coupled with previous findings, the current results suggest the RSC is necessary for retrieval of remotely acquired cued fear memories across multiple modalities. (PsycINFO Database Record (c) 2018 APA, all rights reserved).

Putting fear in context: Elucidating the role of the retrosplenial cortex in context discrimination in rats

The retrosplenial cortex (RSC), which receives visuo-spatial sensory input and interacts with numerous hippocampal memory system structures, has a well-established role in contextual learning and memory. While it has been demonstrated that RSC function is necessary to learn to recognize a single environment that is directly paired with an aversive event, the role of the RSC in discriminating between two different contexts remains largely unknown. To address this, first order (Experiment 1) and higher order (Experiment 2) fear conditioning paradigms were conducted with sham and RSC-lesioned rats. In Experiment 1 rats were exposed to one context in which shock was delivered and to a second, distinct context without shock. Their ability to discriminate between the contexts was assessed during a re-exposure test. In a second experiment, a new cohort of RSC-lesioned rats was exposed to two contexts made distinct through visual, olfactory and auditory stimuli. In a subsequent conditioning phase, the salience of one of the auditory stimuli was paired to an aversive footshock while the other was not. Similar to Experiment 1, freezing behavior was analyzed upon re-exposure to the contexts in the absence of both the auditory cue and the footshock. The results revealed that RSC is not necessary for rats to use contextual information to successfully discriminate between two contexts under the relatively simple demands involved in this first order conditioning paradigm but that context discrimination is impaired when the processing of complex and/or ambiguous contextual stimuli is required to select appropriate behavioral responses.

Distinct retrosplenial cortex cell populations and their spike dynamics during ketamine-induced unconscious state

Ketamine is known to induce psychotic-like symptoms, including delirium and visual hallucinations. It also causes neuronal damage and cell death in the retrosplenial cortex (RSC), an area that is thought to be a part of high visual cortical pathways and at least partially responsible for ketamine's psychotomimetic activities. However, the basic physiological properties of RSC cells as well as their response to ketamine in vivo remained largely unexplored. Here, we combine a computational method, the Inter-Spike Interval Classification Analysis (ISICA), and in vivo recordings to uncover and profile excitatory cell subtypes within layers 2&3 and 5&6 of the RSC in mice within both conscious, sleep, and ketamine-induced unconscious states. We demonstrate two distinct excitatory principal cell sub-populations, namely, high-bursting excitatory principal cells and low-bursting excitatory principal cells, within layers 2&3, and show that this classification is robust over the conscious states, namely quiet awake, and natural unconscious sleep periods. Similarly, we provide evidence of high-bursting and low-bursting excitatory principal cell sub-populations within layers 5&6 that remained distinct during quiet awake and sleep states. We further examined how these subtypes are dynamically altered by ketamine. During ketamine-induced unconscious state, these distinct excitatory principal cell subtypes in both layer 2&3 and layer 5&6 exhibited distinct dynamics. We also uncovered different dynamics of local field potential under various brain states in layer 2&3 and layer 5&6. Interestingly, ketamine administration induced high gamma oscillations in layer 2&3 of the RSC, but not layer 5&6. Our results show that excitatory principal cells within RSC layers 2&3 and 5&6 contain multiple physiologically distinct sub-populations, and they are differentially affected by ketamine.

Intact renewal after extinction of conditioned suppression with lesions of either the retrosplenial cortex or dorsal hippocampus

Extinction of fear to a Pavlovian conditioned stimulus (CS) is known to be context-specific. When the CS is tested outside the context of extinction, fear returns, or renews. Several studies have demonstrated that renewal depends upon the hippocampus, although there are also studies where renewal was not impacted by hippocampal damage, suggesting that under some conditions context encoding and/or retrieval of extinction depends upon other regions. One candidate region is the retrosplenial cortex (RSC), which is known to contribute to contextual and spatial learning and memory. Using a conditioned-suppression paradigm, Experiment 1 tested the impact of pre-training RSC lesions on renewal of extinguished fear. Consistent with previous studies, lesions of the RSC did not impact acquisition or extinction of conditioned fear to the CS. Further, there was no evidence that RSC lesions impaired renewal, indicating that contextual encoding and/or retrieval of extinction does not depend upon the RSC. In Experiment 2, post-extinction lesions of either the RSC or dorsal hippocampus (DH) also had no impact on renewal. However, in Experiment 3, both RSC and DH lesions did impair performance in an object-in-place procedure, an index of place memory. RSC and DH contributions to extinction and renewal are discussed.