Extinction of conditioned blink responses by cerebello-olivary pathway stimulation

The Effect of Nucleo-Olivary Stimulation on Climbing Fiber EPSPs in Purkinje Cells

Climbing fibers, connecting the inferior olive and Purkinje cells, form the nervous system's strongest neural connection. These fibers activate after critical events like motor errors or anticipation of rewards, leading to bursts of excitatory postsynaptic potentials (EPSPs) in Purkinje cells. The number of EPSPs is a crucial variable when the brain is learning a new motor skill. Yet, we do not know what determines the number of EPSPs. Here, we measured the effect of nucleo-olivary stimulation on periorbital elicited climbing fiber responses through in-vivo intracellular Purkinje cell recordings in decerebrated ferrets. The results show that while nucleo-olivary stimulation decreased the probability of a response occurring at all, it did not reduce the number of EPSPs. The results suggest that nucleo-olivary stimulation does not influence the number of EPSPs in climbing fiber bursts.

A cerebello-olivary signal for negative prediction error is sufficient to cause extinction of associative motor learning

The brain generates negative prediction error (NPE) signals to trigger extinction, a type of inhibitory learning that is responsible for suppressing learned behaviors when they are no longer useful. Neurons encoding NPE have been reported in multiple brain regions. Here, we use an optogenetic approach to demonstrate that GABAergic cerebello-olivary neurons can generate a powerful NPE signal, capable of causing extinction of conditioned motor responses on its own.

Extinction of cognitive associations is preserved in patients with cerebellar disease

In the present study extinction and renewal of cognitive associations were assessed in two experiments in participants with focal and degenerative cerebellar disease. Using a predictive learning task, participants had to learn by trial and error the relationships between food items and the occurrence of stomach trouble in a hypothetical patient. In the first experiment, focus was on renewal effects. Participants with chronic cerebellar stroke (n = 14; mean age 50.9 ± 12 years), participants with degenerative cerebellar disease (n = 16; mean age 58 ± 12 years), age-, sex-, and education matched controls (n = 20; mean age 53.7 ± 10.8 years) and young controls (n = 19; mean age 23.2 ± 2.7 years) were tested. Acquisition and extinction of food-stomach trouble associations took part in two different contexts (represented by restaurants). In a subsequent test phase, food stimuli were presented in both contexts and no feedback was given. This allowed testing for renewal of the initially acquired associations in the acquisition context. Acquisition and extinction learning were not significantly different between groups. Significant renewal effects were present in young controls only. In the second experiment, focus was on extinction. To control for age effects, 19 young participants with chronic surgical lesions of the cerebellum (mean age 25.6 ± 6.1 years), and 24 age-, sex- and education-matched healthy controls were tested. Acquisition and extinction of food-stomach trouble associations took part in the same context. In the extinction phase, the relationship with stomach trouble was reversed in some of the food items. Acquisition and extinction learning were not significantly different between groups. The main finding of the present study was preserved extinction of learned cognitive associations in participants with chronic cerebellar disease. Findings agree with previous observations in the literature that cognitive abnormalities are frequently absent or weak in adults with cerebellar disease. This does not exclude a contribution of the cerebellum to extinction of learned associations. For example, findings may be different in more challenging cognitive tasks, and in participants with acute cerebellar disease with no time for compensation.

Inactivation of the interpositus nucleus during unpaired extinction does not prevent extinction of conditioned eyeblink responses or conditioning-specific reflex modification

For almost 75 years, classical eyeblink conditioning has been an invaluable tool for assessing associative learning processes across many species, thanks to its high translatability and well-defined neural circuitry. Our laboratory has adapted the paradigm to extensively detail associative changes in the rabbit reflexive eyeblink response (unconditioned response, UR), characterized by postconditioning increases in the frequency, size, and latency of the UR when the periorbital shock unconditioned stimulus (US) is presented alone, termed conditioning-specific reflex modification (CRM). Because the shape and timing of CRM closely resembles the conditioned eyeblink response (CR) to the tone conditioned stimulus (CS), we previously tested whether CRs and CRM share a common neural substrate, the interpositus nucleus of the cerebellum (IP), and found that IP inactivation during conditioning blocked the development of both CRs and the timing aspect of CRM. The goal of the current study was to examine whether extinction of CRs and CRM timing, accomplished simultaneously with unpaired CS/US extinction, also involves the IP. Results showed that muscimol inactivation of the IP during extinction blocked CR expression but not extinction of CRs or CRM timing, contrasting with the literature showing IP inactivation prevents CR extinction during CS-alone presentations. The continued presence of the US throughout the unpaired extinction procedure may have been sufficient to overcome IP blockade, promoting plasticity in the cerebellar cortex and/or extracerebellar components of the eyeblink conditioning pathway that can modulate extinction of CRs and CRM timing. Results therefore add support to the distributed plasticity view of cerebellar learning. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Extinction and Renewal of Conditioned Eyeblink Responses in Focal Cerebellar Disease

Extinction of conditioned aversive responses (CR) has been shown to be context-dependent. The hippocampus and prefrontal cortex are of particular importance. The cerebellum may contribute to context-related processes because of its known connections with the hippocampus and prefrontal cortex. Context dependency of extinction can be demonstrated by the renewal effect. When CR acquisition takes place in context A and is extinguished in context B, renewal refers to the recovery of the CR in context A (A-B-A paradigm). In the present study acquisition, extinction and renewal of classically conditioned eyeblink responses were tested in 18 patients with subacute focal cerebellar lesions and 18 age- and sex-matched healthy controls. Standard delay eyeblink conditioning was performed using an A-B-A paradigm. All cerebellar patients underwent a high-resolution T1-weighted brain MRI scan to perform lesion-symptom mapping. CR acquisition was not significantly different between cerebellar and control participants allowing to draw conclusions on extinction. CR extinction was significantly less in cerebellar patients. Reduction of CR extinction tended to be more likely in patients with lesions in the lateral parts of lobule VI and Crus I. A significant renewal effect was present in controls only. The present data provide further evidence that the cerebellum contributes to extinction of conditioned eyeblink responses. Because acquisition was preserved and extinction took place in another context than acquisition, more lateral parts of the cerebellar hemisphere may contribute to context-related processes. Furthermore, lack of renewal in cerebellar patients suggest a contribution of the cerebellum to context-related processes.

Sox14 Is Required for a Specific Subset of Cerebello-Olivary Projections

We identify Sox14 as an exclusive marker of inhibitory projection neurons in the lateral and interposed, but not the medial, cerebellar nuclei. Sox14⁺ neurons make up ∼80% of Gad1⁺ neurons in these nuclei and are indistinguishable by soma size from other inhibitory neurons. All Sox14⁺ neurons of the lateral and interposed cerebellar nuclei are generated at approximately E10/10.5 and extend long-range, predominantly contralateral projections to the inferior olive. A small Sox14⁺ population in the adjacent vestibular nucleus "Y" sends an ipsilateral projection to the oculomotor nucleus. Cerebellar Sox14⁺ and glutamatergic projection neurons assemble in non-overlapping populations at the nuclear transition zone, and their integration into a coherent nucleus depends on Sox14 function. Targeted ablation of Sox14⁺ cells by conditional viral expression of diphtheria toxin leads to significantly impaired motor learning. Contrary to expectations, associative learning is unaffected by unilateral Sox14⁺ neuron elimination in the interposed and lateral nuclei.SIGNIFICANCE STATEMENT The cerebellar nuclei are central to cerebellar function, yet how they modulate and process cerebellar inputs and outputs is still primarily unknown. Our study gives a direct insight into how nucleo-olivary projection neurons are generated, their projections, and their function in an intact behaving mouse. These neurons play a critical conceptual role in all models of cerebellar function, and this study represents the first specific analysis of their molecular identity and function and offers a powerful model for future investigation of cerebellar function in motor control and learning.

Memory consolidation within the central amygdala is not necessary for modulation of cerebellar learning

Amygdala lesions impair, but do not prevent, acquisition of cerebellum-dependent eyeblink conditioning suggesting that the amygdala modulates cerebellar learning. Two-factor theories of eyeblink conditioning posit that a fast-developing memory within the amygdala facilitates slower-developing memory within the cerebellum. The current study tested this hypothesis by impairing memory consolidation within the amygdala with inhibition of protein synthesis, transcription, and NMDA receptors in rats. Rats given infusions of anisomycin or DRB into the central amygdala (CeA) immediately after each eyeblink conditioning session were severely impaired in contextual and cued fear conditioning, but were completely unimpaired in eyeblink conditioning. Rats given the NMDA antagonist ifenprodil into the CeA before each eyeblink conditioning session also showed impaired fear conditioning, but no deficit in eyeblink conditioning. The results indicate that memory formation within the CeA is not necessary for its modulation of cerebellar learning mechanisms. The CeA may modulate cerebellar learning and retention through an attentional mechanism that develops within the training sessions.

Modulation of 7 T fMRI Signal in the Cerebellar Cortex and Nuclei During Acquisition, Extinction, and Reacquisition of Conditioned Eyeblink Responses

Classical delay eyeblink conditioning is likely the most commonly used paradigm to study cerebellar learning. As yet, few studies have focused on extinction and savings of conditioned eyeblink responses (CRs). Saving effects, which are reflected in a reacquisition after extinction that is faster than the initial acquisition, suggest that learned associations are at least partly preserved during extinction. In this study, we tested the hypothesis that acquisition-related plasticity is nihilated during extinction in the cerebellar cortex, but retained in the cerebellar nuclei, allowing for faster reacquisition. Changes of 7 T functional magnetic resonance imaging (fMRI) signals were investigated in the cerebellar cortex and nuclei of young and healthy human subjects. Main effects of acquisition, extinction, and reacquisition against rest were calculated in conditioned stimulus-only trials. First-level β values were determined for a spherical region of interest (ROI) around the acquisition peak voxel in lobule VI, and dentate and interposed nuclei ipsilateral to the unconditioned stimulus. In the cerebellar cortex and nuclei, fMRI signals were significantly lower in extinction compared to acquisition and reacquisition, but not significantly different between acquisition and reacquisition. These findings are consistent with the theory of bidirectional learning in both the cerebellar cortex and nuclei. It cannot explain, however, why conditioned responses reappear almost immediately in reacquisition following extinction. Although the present data do not exclude that part of the initial memory remains in the cerebellum in extinction, future studies should also explore changes in extracerebellar regions as a potential substrate of saving effects. Hum Brain Mapp 38:3957-3974, 2017. © 2017 Wiley Periodicals, Inc.

Purkinje cell activity during classical conditioning with different conditional stimuli explains central tenet of Rescorla–Wagner model [corrected]

A central tenet of Rescorla and Wagner's model of associative learning is that the reinforcement value of a paired trial diminishes as the associative strength between the presented stimuli increases. Despite its fundamental importance to behavioral sciences, the neural mechanisms underlying the model have not been fully explored. Here, we present findings that, taken together, can explain why a stronger association leads to a reduced reinforcement value, within the context of eyeblink conditioning. Specifically, we show that learned pause responses in Purkinje cells, which trigger adaptively timed conditioned eyeblinks, suppress the unconditional stimulus (US) signal in a graded manner. Furthermore, by examining how Purkinje cells respond to two distinct conditional stimuli and to a compound stimulus, we provide evidence that could potentially help explain the somewhat counterintuitive overexpectation phenomenon, which was derived from the Rescorla-Wagner model.

Changes in complex spike activity during classical conditioning

The cerebellar cortex is necessary for adaptively timed conditioned responses (CRs) in eyeblink conditioning. During conditioning, Purkinje cells acquire pause responses or "Purkinje cell CRs" to the conditioned stimuli (CS), resulting in disinhibition of the cerebellar nuclei (CN), allowing them to activate motor nuclei that control eyeblinks. This disinhibition also causes inhibition of the inferior olive (IO), via the nucleo-olivary pathway (N-O). Activation of the IO, which relays the unconditional stimulus (US) to the cortex, elicits characteristic complex spikes in Purkinje cells. Although Purkinje cell activity, as well as stimulation of the CN, is known to influence IO activity, much remains to be learned about the way that learned changes in simple spike firing affects the IO. In the present study, we analyzed changes in simple and complex spike firing, in extracellular Purkinje cell records, from the C3 zone, in decerebrate ferrets undergoing training in a conditioning paradigm. In agreement with the N-O feedback hypothesis, acquisition resulted in a gradual decrease in complex spike activity during the conditioned stimulus, with a delay that is consistent with the long N-O latency. Also supporting the feedback hypothesis, training with a short interstimulus interval (ISI), which does not lead to acquisition of a Purkinje cell CR, did not cause a suppression of complex spike activity. In contrast, observations that extinction did not lead to a recovery in complex spike activity and the irregular patterns of simple and complex spike activity after the conditioned stimulus are less conclusive.

Decorrelation learning in the cerebellum: computational analysis and experimental questions

Many cerebellar models use a form of synaptic plasticity that implements decorrelation learning. Parallel fibers carrying signals positively correlated with climbing-fiber input have their synapses weakened (long-term depression), whereas those carrying signals negatively correlated with climbing input have their synapses strengthened (long-term potentiation). Learning therefore ceases when all parallel-fiber signals have been decorrelated from climbing-fiber input. This is a computationally powerful rule for supervised learning and can be cast in a spike-timing dependent plasticity form for comparison with experimental evidence. Decorrelation learning is particularly well suited to sensory prediction, for example, in the reafference problem where external sensory signals are interfered with by reafferent signals from the organism's own movements, and the required circuit appears similar to the one found to mediate classical eye blink conditioning. However, for certain stimuli, avoidance is a much better option than simple prediction, and decorrelation learning can also be used to acquire appropriate avoidance movements. One example of a stimulus to be avoided is retinal slip that degrades visual processing, and decorrelation learning appears to play a role in the vestibulo-ocular reflex that stabilizes gaze in the face of unpredicted head movements. Decorrelation learning is thus suitable for both sensory prediction and motor control. It may also be well suited for generic spatial and temporal coordination, because of its ability to remove the unwanted side effects of movement. Finally, because it can be used with any kind of time-varying signal, the cerebellum could play a role in cognitive processing.

Feedback control of learning by the cerebello-olivary pathway

The ability to anticipate future events and to modify erroneous anticipatory actions is crucial for the survival of any organism. Both theoretical and empirical lines of evidence implicate the cerebellum in this ability. It is often suggested that the cerebellum acquires "expectations" or "internal models." However, except in a metaphorical sense, the cerebellum, which consists of a set of interconnected nerve cells, cannot contain "internal models" or "have expectations." In this chapter, we try to untangle these metaphors by translating them back into neurophysiological cause and effect relationships. We approach this task from within the paradigm of classical conditioning, in which a subject, through repeated presentations of a conditional stimulus, followed by an unconditional stimulus, acquires a conditioned response. Importantly, the conditioned response is timed so that it anticipates the unconditioned response. Available neurophysiological evidence suggests that Purkinje cells, in the cerebellar cortex, generate the conditioned response. In addition, Purkinje cells provide negative feedback to the inferior olive, which is a relay for the unconditional stimulus, via the nucleo-olivary pathway. Purkinje cells can therefore regulate the intensity of the signal derived from the unconditional stimulus, which, in turn, decides subsequent plasticity. Hence, as learning progresses, the olivary signal will become weaker and weaker due to increasing negative feedback from Purkinje cells. Thus, in an important sense, learning-induced changes in Purkinje cell activity constitute an "expectation" or "anticipation" of a future event (the unconditional stimulus), and, consistent with theoretical models, future learning depends on the accuracy of this expectation.

Blocking glutamate-mediated inferior olivary signals abolishes expression of conditioned eyeblinks but does not prevent their acquisition

The inferior olive (IO) is considered a crucial component of the eyeblink conditioning network. The cerebellar learning hypothesis proposes that the IO provides the cerebellum with a teaching signal that is required for the acquisition and maintenance of conditioned eyeblinks. Supporting this concept, previous experiments showed that lesions or inactivation of the IO blocked CR acquisition. However, these studies were not conclusive. The drawback of the methods used by those studies is that they not only blocked task-related signals, but also completely shut down the spontaneous activity within the IO, which affects the rest of the eyeblink circuits in a nonspecific manner. We hypothesized that more selective blocking of task-related IO signals could be achieved by using injections of glutamate antagonists, which reduce, but do not eliminate, the spontaneous activity in the IO. We expected that if glutamate-mediated IO signals are required for learning, then blocking these signals during training sessions should prevent conditioned response (CR) acquisition. To test this prediction, rabbits were trained to acquire conditioned eyeblinks to a mild vibrissal airpuff as the conditioned stimulus while injections of the glutamate antagonist γ-d-glutamylglycine were administered to the IO. Remarkably, even though this treatment suppressed CRs during training sessions, the postacquisition retention test revealed that CR acquisition had not been abolished. The ability to acquire CRs with IO unconditioned stimulus signals that were blocked or severely suppressed suggests that mechanisms responsible for CR acquisition are extremely resilient and probably less dependent on IO-task-related signals than previously thought.

Neural circuitry and plasticity mechanisms underlying delay eyeblink conditioning

Pavlovian eyeblink conditioning has been used extensively as a model system for examining the neural mechanisms underlying associative learning. Delay eyeblink conditioning depends on the intermediate cerebellum ipsilateral to the conditioned eye. Evidence favors a two-site plasticity model within the cerebellum with long-term depression of parallel fiber synapses on Purkinje cells and long-term potentiation of mossy fiber synapses on neurons in the anterior interpositus nucleus. Conditioned stimulus and unconditioned stimulus inputs arise from the pontine nuclei and inferior olive, respectively, converging in the cerebellar cortex and deep nuclei. Projections from subcortical sensory nuclei to the pontine nuclei that are necessary for eyeblink conditioning are beginning to be identified, and recent studies indicate that there are dynamic interactions between sensory thalamic nuclei and the cerebellum during eyeblink conditioning. Cerebellar output is projected to the magnocellular red nucleus and then to the motor nuclei that generate the blink response(s). Tremendous progress has been made toward determining the neural mechanisms of delay eyeblink conditioning but there are still significant gaps in our understanding of the necessary neural circuitry and plasticity mechanisms underlying cerebellar learning.

Sensory prediction or motor control? Application of marr-albus type models of cerebellar function to classical conditioning

Marr-Albus adaptive filter models of the cerebellum have been applied successfully to a range of sensory and motor control problems. Here we analyze their properties when applied to classical conditioning of the nictitating membrane response in rabbits. We consider a system-level model of eyeblink conditioning based on the anatomy of the eyeblink circuitry, comprising an adaptive filter model of the cerebellum, a comparator model of the inferior olive and a linear dynamic model of the nictitating membrane plant. To our knowledge, this is the first model that explicitly includes all these principal components, in particular the motor plant that is vital for shaping and timing the behavioral response. Model assumptions and parameters were systematically investigated to disambiguate basic computational capacities of the model from features requiring tuning of properties and parameter values. Without such tuning, the model robustly reproduced a range of behaviors related to sensory prediction, by displaying appropriate trial-level associative learning effects for both single and multiple stimuli, including blocking and conditioned inhibition. In contrast, successful reproduction of the real-time motor behavior depended on appropriate specification of the plant, cerebellum and comparator models. Although some of these properties appear consistent with the system biology, fundamental questions remain about how the biological parameters are chosen if the cerebellar microcircuit applies a common computation to many distinct behavioral tasks. It is possible that the response profiles in classical conditioning of the eyeblink depend upon operant contingencies that have previously prevailed, for example in naturally occurring avoidance movements.

Simple and complex spike firing patterns in Purkinje cells during classical conditioning

Classical blink conditioning is known to depend critically on the cerebellum and the relevant circuitry is gradually being unravelled. Several lines of evidence support the theory that the conditioned stimulus is transmitted by mossy fibers to the cerebellar cortex whereas the unconditioned stimulus is transmitted by climbing fibers. This view has been dramatically confirmed by recent Purkinje cell recordings during training with a classical conditioning paradigm. We have tracked the activity of single Purkinje cells with microelectrodes for several hours in decerebrate ferrets during learning, extinction, and relearning. Paired peripheral forelimb and periocular stimulation, as well as paired direct stimulation of cerebellar afferent pathways (mossy and climbing fibers) causes acquisition of a pause response in Purkinje cell simple spike firing. This conditioned Purkinje cell response has temporal properties that match those of the behavioral response. Its latency varies with the interstimulus interval and it responds to manipulations of the conditioned stimulus in the same way that the blink does. Complex spike firing largely mirrors the simple spike behavior. We have previously suggested that cerebellar learning is subject to a negative feedback control via the inhibitory nucleo-olivary pathway. As the Purkinje cell learns to respond to the conditioned stimulus with a suppression of simple spikes, disinhibition of anterior interpositus neurons would be expected to cause inhibition of the inferior olive. Observations of complex spike firing in the Purkinje cells during conditioning and extinction confirm this prediction. Before training, complex spikes are unaffected or facilitated by the conditioned stimulus, but as the simple spike pause response develops, spontaneous and stimulus-evoked complex spikes are also strongly suppressed by the conditioned stimulus. After extinction of the simple spike pause response, the complex spikes reappear.