The influence of associability changes in negative patterning and other discriminations

Occasion setting

Occasion setting refers to the ability of 1 stimulus, an occasion setter, to modulate the efficacy of the association between another, conditioned stimulus (CS) and an unconditioned stimulus (US) or reinforcer. Occasion setters and simple CSs are readily distinguished. For example, occasion setters are relatively immune to extinction and counterconditioning, and their combination and transfer functions differ substantially from those of simple CSs. Similarly, the acquisition of occasion setting is favored when stimuli are separated by longer intervals, by empty trace intervals, and are of different modalities, whereas the opposite conditions typically favor the acquisition of simple associations. Furthermore, the simple conditioning and occasion setting properties of a single stimulus can be independent, for example, that stimulus may simultaneously predict the occurrence of a reinforcer and indicate that another stimulus will not be reinforced. Many behavioral phenomena that are intractable to simple associative analysis are better understood within an occasion setting framework. Besides capturing the distinction between direct and modulatory control common to many arenas in neuroscience, occasion setting provides a model for the hierarchical organization of memory for events and event relations, and for contextual control more broadly. Although early lesion studies further differentiated between occasion setting and simple conditioning functions, little is known about the neurobiology of occasion setting. Modern techniques for precise manipulation and monitoring of neuronal activity in multiple brain regions are ideally suited for disentangling contributions of simple conditioning and occasion setting in associative learning. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Mini-review: Prediction errors, attention and associative learning

Most modern theories of associative learning emphasize a critical role for prediction error (PE, the difference between received and expected events). One class of theories, exemplified by the Rescorla-Wagner (1972) model, asserts that PE determines the effectiveness of the reinforcer or unconditioned stimulus (US): surprising reinforcers are more effective than expected ones. A second class, represented by the Pearce-Hall (1980) model, argues that PE determines the associability of conditioned stimuli (CSs), the rate at which they may enter into new learning: the surprising delivery or omission of a reinforcer enhances subsequent processing of the CSs that were present when PE was induced. In this mini-review we describe evidence, mostly from our laboratory, for PE-induced changes in the associability of both CSs and USs, and the brain systems involved in the coding, storage and retrieval of these altered associability values. This evidence favors a number of modifications to behavioral models of how PE influences event processing, and suggests the involvement of widespread brain systems in animals' responses to PE.

Dorsolateral striatum is critical for the expression of surprise-induced enhancements in cue associability

The dorsolateral striatum (DLS) is frequently implicated in sensory-motor integration, including the performance of sensory orienting responses (ORs) and learned stimulus-response habits. Our laboratory previously identified a role for the DLS in rats' performance of conditioned ORs to Pavlovian cues for food delivery. Here, we considered whether DLS is also critical to another aspect of attention in associative learning, the surprise-induced enhancement of cue associability. A large behavioral literature shows that a cue present when an expected event is omitted enters into new associations more rapidly when that cue is subsequently paired with food. Research from our laboratory has shown that both cue associability enhancements and conditioned ORs depend on the function of a circuit that includes the amygdala central nucleus and the substantia nigra pars compacta. In three experiments, we explored the involvement of DLS in surprise-induced associability enhancements, using a three-stage serial prediction task that permitted separation of DLS function in registering surprise (prediction error) and enhancing cue associability, and in using that increased associability to learn more rapidly about that cue later. The results showed that DLS is critical to the expression, but not the establishment, of the enhanced cue associability normally produced by surprise in this task. They extend the role of DLS and the amygdalo-nigro-striatal circuit underlying learned orienting to more subtle aspects of attention in associative learning, but are consistent with the general notion that DLS is more important in the expression of previously acquired tendencies than in their acquisition.

The basolateral amygdala is necessary for negative prediction errors to enhance cue salience, but not to produce conditioned inhibition

Behavioral evidence shows that prediction errors (PEs) not only drive associative learning, but also enhance the salience of predictive cues, making them better able to capture attention when they are next encountered. Research from our laboratory suggests that this latter consequence of PEs depends on a neural circuit that includes the amygdala. Lesions of the basolateral complex of the amygdala (BLA), for instance, selectively disrupt enhancements in cue processing that are normally induced by positive PEs without compromising simple excitatory learning. This result is consistent with electrophysiological evidence showing that BLA neurons track positive PEs. Interestingly, the same neurons also seem to track negative PEs, suggesting the possibility that the BLA might also use these errors to drive enhancements in cue processing. Here, we examined the role of the BLA in the processing (Experiment 1) and utilization (Experiment 2) of negative PEs in increasing cue salience in an unblocking procedure. Using FOS expression as an index of neural activity, Experiment 1 confirmed that BLA neurons track negative PEs with reinforcement downshifts. This tracking was evident both when these errors were generated by decreasing the concentration of a sucrose reinforcer (which encourages the development of conditioned inhibition) and when they were generated by decreasing the number of sucrose reinforcers (which encourages excitatory learning - unblocking - and allows the detection of enhancements in cue processing). Experiment 2 demonstrated that BLA lesions abolished enhancements in cue processing while sparing inhibitory learning. These results suggest a general role of the BLA in utilizing PEs, whatever their sign, for boosting cue processing.

Effects of dorsal or ventral medial prefrontal cortical lesions on five-choice serial reaction time performance in rats

Lesions of the rat medial prefrontal cortex (mPFC) produce behavioral impairments in the 5-choice serial reaction time (5CSRT) task, a widely used measure of sustained and selective visual attention. This experiment compared the effects of "dorsal" (centered on prelimbic and infralimbic cortices) and "ventral" (centered on dorsal peduncular cortex and tenia tecta) mPFC lesions on performance in a variant of the 5CSRT task. Because in some associative learning theories, the predictive validity of events determines the allocation of attention to them, we also examined the effects of cue validity in this task. Operant nosepoke responses to some briefly illuminated ports were consistently (100%) reinforced (CRF) with food, whereas for other ports, responding was reinforced on only 50% of the trials (partial reinforcement, PRF). Different patterns of impairment emerged depending on lesion location within the mPFC. Dorsal- and sham-lesioned rats responded more to CRF than to PRF cues, but ventral-lesioned rats responded similarly to CRF and PRF cues. Additionally, under some conditions of increased attentional demands, dorsal-lesioned rats failed to respond on many trials, whereas the impairment in ventral-lesioned rats was manifested as an increase in response errors. These results demonstrate separable roles for dorsal and ventral mPFC subregions in controlling attention.

Variations in unconditioned stimulus processing in unblocking

Three experiments examined the mechanisms by which downward shifts in reinforcer value influence learning in appetitive unblocking procedures. The downward shift was accomplished by omitting the 2nd of a 2-reinforcer sequence (food-food or food-sucrose). Performance of normal rats was compared with that of rats with lesions of the central nucleus of the amygdala, which are thought to interfere with surprise-induced enhancements of event processing. The results suggested that, in normal rats, omission of the 2nd reinforcer enhanced processing of the 1st reinforcer rather than processing of the conditioned stimuli and that lesions of the central nucleus eliminated this enhancement. The roles of reinforcement error signals in conditioning are discussed.

Conditioning and cognition

Animals' abilities to use internal representations of absent objects to guide adaptive behavior and acquire new information, and to represent multiple spatial, temporal, and object properties of complex events and event sequences, may underlie many aspects of human perception, memory, and symbolic thought. In this review, two classes of simple associative learning tasks that address these core cognitive capacities are discussed. The first set, including reinforcer revaluation and mediated learning procedures, address the power of Pavlovian conditioned stimuli to gain access, through learning, to representations of upcoming events. The second set of investigations concern the construction of complex stimulus representations, as illustrated in studies of contextual learning, the conjunction of explicit stimulus elements in configural learning procedures, and recent studies of episodic-like memory. The importance of identifying both cognitive process and brain system bases of performance in animal models is emphasized.

Conditional discrimination learning and negative patterning in rats with neonatal hippocampal lesion induced by ionizing radiation

This study was undertaken to investigate the associative process underlying serial feature positive conditional discrimination learning (X-->A+/A-) and the role of the hippocampus in the solution of tasks demanding a configural association strategy such as the negative patterning discrimination (XA-/X+/A+). It has been suggested that the hippocampus is essential for the learning of complex tasks, so, it is expected that hippocampal lesions would prove equally detrimental to performance in both tasks, but would not interfere with simple discrimination learning. Hippocampal lesions were made with X-radiation exposure to neonate rats after completion of a parametric study 'J. Neurosci. Methods 75 (1997) 41' that established the best radiation parameters to selectively lesion the hippocampal dentate gyrus. When adults, rats were submitted to a serial feature positive conditional discrimination task with the trials 'House light/Tone: water (H-->T+)', 'Tone: no water (T-)', and two simple discrimination with the trials 'Clicker: water (C+)' and 'Noise: no water (N-)' in Experiment I. In Experiment II, adult rats, irradiated and control, were submitted to the negative patterning task with the trials 'House light/Tone: no water (HT-)', 'House light: water (H+)', 'Tone: water (T+)', and to the non-conditional discrimination with the trial Noise: no water (N-)'. In contrast to the expectation of impaired performance in these tasks by lesioned rats, animals with damage to the hippocampal dentate gyrus learned the complex and the simple tasks as well as control subjects. These results suggest that the dentate gyrus does not participate directly in the modulation of acquisition of tasks demanding a complex strategy of occasion setting in procedures of serial conditional discrimination or a configural strategy, important for the negative patterning discrimination solution.