Acquisition, extinction, and reacquisition of a cerebellar cortical memory trace

Inactivation of the interpositus nucleus blocks the acquisition of conditioned responses and timing changes in conditioning-specific reflex modification of the rabbit eyeblink response

Conditioning-specific reflex modification (CRM) of the rabbit eyeblink response is an associative phenomenon characterized by increases in the frequency, size, and peak latency of the reflexive unconditioned eyeblink response (UR) when the periorbital shock unconditioned stimulus (US) is presented alone following conditioning, particularly to lower intensity USs that produced minimal responding prior to conditioning. Previous work has shown that CRM shares many commonalities with the conditioned eyeblink response (CR) including a similar response topography, suggesting the two may share similar neural substrates. The following study examined the hypothesis that the interpositus nucleus (IP) of the cerebellum, an essential part of the neural circuitry of eyeblink conditioning, is also required for the acquisition of CRM. Tests for CRM occurred following delay conditioning under muscimol inactivation of the IP and also after additional conditioning without IP inactivation. Results showed that IP inactivation blocked acquisition of CRs and the timing aspect of CRM but did not prevent increases in UR amplitude and area. Following the cessation of inactivation, CRs and CRM latency changes developed similarly to controls with intact IP functioning, but with some indication that CRs may have been facilitated in muscimol rabbits. In conclusion, CRM timing and CRs both likely require the development of plasticity in the IP, but other associative UR changes may involve non-cerebellar structures interacting with the eyeblink conditioning circuitry, a strong candidate being the amygdala, which is also likely involved in the facilitation of conditioning. Other candidates worth consideration include the cerebellar cortex, prefrontal and motor cortices.

Absence of Parallel Fibre to Purkinje Cell LTD During Eyeblink Conditioning

Long-term depression (LTD) of parallel fibre/Purkinje cell synapses has been the favoured explanation for cerebellar motor learning such as classical eyeblink conditioning. Previous evidence against this interpretation has been contested. Here we wanted to test whether a classical conditioning protocol causes LTD. We applied a conditioning protocol, using a train of electrical pulses to the parallel fibres as the conditional stimulus. In order to rule out indirect effects caused by antidromic granule cell activation or output from Purkinje cells that might produce changes in Purkinje cell responsiveness, we focused the analysis on the first pulse in the conditional stimulus, that is, before any indirect effects would have time to occur. Purkinje cells learned to respond with a firing pause to the conditional stimulus. Yet, there was no depression of parallel fibre excitation after training.

Cerebellar Modules and Their Role as Operational Cerebellar Processing Units: A Consensus paper [corrected]

The compartmentalization of the cerebellum into modules is often used to discuss its function. What, exactly, can be considered a module, how do they operate, can they be subdivided and do they act individually or in concert are only some of the key questions discussed in this consensus paper. Experts studying cerebellar compartmentalization give their insights on the structure and function of cerebellar modules, with the aim of providing an up-to-date review of the extensive literature on this subject. Starting with an historical perspective indicating that the basis of the modular organization is formed by matching olivocorticonuclear connectivity, this is followed by consideration of anatomical and chemical modular boundaries, revealing a relation between anatomical, chemical, and physiological borders. In addition, the question is asked what the smallest operational unit of the cerebellum might be. Furthermore, it has become clear that chemical diversity of Purkinje cells also results in diversity of information processing between cerebellar modules. An additional important consideration is the relation between modular compartmentalization and the organization of the mossy fiber system, resulting in the concept of modular plasticity. Finally, examination of cerebellar output patterns suggesting cooperation between modules and recent work on modular aspects of emotional behavior are discussed. Despite the general consensus that the cerebellum has a modular organization, many questions remain. The authors hope that this joint review will inspire future cerebellar research so that we are better able to understand how this brain structure makes its vital contribution to behavior in its most general form.

Impact of parallel fiber to Purkinje cell long-term depression is unmasked in absence of inhibitory input

Pavlovian eyeblink conditioning has been used extensively to study the neural mechanisms underlying associative and motor learning. During this simple learning task, memory formation takes place at Purkinje cells in defined areas of the cerebellar cortex, which acquire a strong temporary suppression of their activity during conditioning. Yet, it is unknown which neuronal plasticity mechanisms mediate this suppression. Two potential mechanisms include long-term depression of parallel fiber to Purkinje cell synapses and feed-forward inhibition by molecular layer interneurons. We show, using a triple transgenic approach, that only concurrent disruption of both these suppression mechanisms can severely impair conditioning, highlighting that both processes can compensate for each other's deficits.

Multiple components in direction learning in smooth pursuit eye movements of monkeys

We analyzed behavioral features of smooth pursuit eye movements to characterize the course of acquisition and expression of multiple neural components of motor learning. Monkeys tracked a target that began to move in an initial "pursuit" direction and suddenly, but predictably, changed direction after a fixed interval of 250 ms. As the trial is repeated, monkeys learn to make eye movements that predict the change in target direction. Quantitative analysis of the learned response revealed evidence for multiple, dynamic, parallel processes at work during learning. 1) The overall learning followed at least two trial courses: a fast component grew and saturated rapidly over tens of trials, and a slow component grew steadily over up to 1,000 trials. 2) The temporal specificity of the learned response within each trial was crude during the first 100 trials but then improved gradually over the remaining trials. 3) External influences on the gain of pursuit initiation modulate the expression but probably not the acquisition of learning. The gain of pursuit initiation and the expression of the learned response decreased in parallel, both gradually through a 1,000-trial learning block and immediately between learning trials with different gains in the initiation of pursuit. We conclude that at least two distinct neural mechanisms drive the acquisition of pursuit learning over 100 to 1,000 trials (3 to 30 min). Both mechanisms generate underlying memory traces that are modulated in relation to the gain of pursuit initiation before expression in the final motor output. NEW & NOTEWORTHY We show that cerebellum-dependent direction learning in smooth pursuit eye movements grows in at least two components over 1,100 behavioral learning repetitions. One component grows over tens of trials and the other over hundreds. Within trials, learned temporal specificity gradually improves over hundreds of trials. The expression of each learning component on a given trial can be modified by external factors that do not affect the underlying memory trace.

Sensorimotor Integration and Amplification of Reflexive Whisking by Well-Timed Spiking in the Cerebellar Corticonuclear Circuit

To test how cerebellar crus I/II Purkinje cells and their targets in the lateral cerebellar nuclei (CbN) integrate sensory and motor-related inputs and contribute to reflexive movements, we recorded extracellularly in awake, head-fixed mice during non-contact whisking. Ipsilateral or contralateral air puffs elicited changes in population Purkinje simple spike rates that matched whisking kinematics (∼1 Hz/1° protraction). Responses remained relatively unaffected when ipsilateral sensory feedback was removed by lidocaine but were reduced by optogenetically inhibiting the reticular nuclei. Optogenetically silencing cerebellar output suppressed movements. During puff-evoked whisks, both Purkinje and CbN cells generated well-timed spikes in sequential 2- to 4-ms windows at response onset, such that they alternately elevated their firing rates just before protraction. With spontaneous whisks, which were smaller than puff-evoked whisks, well-timed spikes were absent and CbN cells were inhibited. Thus, sensory input can facilitate millisecond-scale, well-timed spiking in Purkinje and CbN cells and amplify reflexive whisker movements.

Cannabinoid agonist administration within the cerebellar cortex impairs motor learning

Systemic administration of cannabinoid agonists impairs cerebellum-dependent motor learning. The cannabinoid-induced impairment of motor learning has been hypothesized to be due to disruption of Purkinje cell plasticity within the cerebellar cortex. In the current study, we tested this hypothesis in rats with localized microinfusions of cannabinoid agonists and antagonists into the cerebellar cortex during eyeblink conditioning, a type of cerebellum-dependent motor learning. Infusions of the cannabinoid agonists WIN55,212-2 or ACEA directly into the eyeblink conditioning microzone of the cerebellar cortex severely impaired acquisition of eyeblink conditioning, whereas the CB1R antagonist SR141716A did not produce a significant impairment. Infusions of WIN55,212-2 outside of the eyeblink conditioning microzone did not impair motor learning, establishing anatomical specificity for the agonist effects. The motor learning impairment caused by WIN55,212-2 and ACEA was rescued by SR141716A, indicating that the learning deficit was produced through CB1Rs. The current findings demonstrate that the effects of cannabinoid receptor agonists on motor learning are localized to CB1Rs within a discrete microzone of the cerebellar cortex.

Conditioned climbing fiber responses in cerebellar cortex and nuclei

The eyeblink conditioning paradigm captures an elementary form of associative learning in a neural circuitry that is understood to an extraordinary degree. Cerebellar cortical Purkinje cell simple spike suppression is widely regarded as the main process underlying conditioned responses (CRs), leading to disinhibition of neurons in the cerebellar nuclei that innervate eyelid muscles downstream. However, recent work highlights the addition of a conditioned Purkinje cell complex spike response, which at the level of the interposed nucleus seems to translate to a transient spike suppression that can be followed by a rapid spike facilitation. Here, we review the characteristics of these responses at the cerebellar cortical and nuclear level, and discuss possible origins and functions.

A Multiple-Plasticity Spiking Neural Network Embedded in a Closed-Loop Control System to Model Cerebellar Pathologies

The cerebellum plays a crucial role in sensorimotor control and cerebellar disorders compromise adaptation and learning of motor responses. However, the link between alterations at network level and cerebellar dysfunction is still unclear. In principle, this understanding would benefit of the development of an artificial system embedding the salient neuronal and plastic properties of the cerebellum and operating in closed-loop. To this aim, we have exploited a realistic spiking computational model of the cerebellum to analyze the network correlates of cerebellar impairment. The model was modified to reproduce three different damages of the cerebellar cortex: (i) a loss of the main output neurons (Purkinje Cells), (ii) a lesion to the main cerebellar afferents (Mossy Fibers), and (iii) a damage to a major mechanism of synaptic plasticity (Long Term Depression). The modified network models were challenged with an Eye-Blink Classical Conditioning test, a standard learning paradigm used to evaluate cerebellar impairment, in which the outcome was compared to reference results obtained in human or animal experiments. In all cases, the model reproduced the partial and delayed conditioning typical of the pathologies, indicating that an intact cerebellar cortex functionality is required to accelerate learning by transferring acquired information to the cerebellar nuclei. Interestingly, depending on the type of lesion, the redistribution of synaptic plasticity and response timing varied greatly generating specific adaptation patterns. Thus, not only the present work extends the generalization capabilities of the cerebellar spiking model to pathological cases, but also predicts how changes at the neuronal level are distributed across the network, making it usable to infer cerebellar circuit alterations occurring in cerebellar pathologies.

Control of voluntary and optogenetically perturbed locomotion by spike rate and timing of neurons of the mouse cerebellar nuclei

Neurons of the cerebellar nuclei (CbN), which generate cerebellar output, are inhibited by Purkinje cells. With extracellular recordings during voluntary locomotion in head-fixed mice, we tested how the rate and coherence of inhibition influence CbN cell firing and well-practiced movements. Firing rates of Purkinje and CbN cells were modulated systematically through the stride cycle (~200–300 ms). Optogenetically stimulating ChR2-expressing Purkinje cells with light steps or trains evoked either asynchronous or synchronous inhibition of CbN cells. Steps slowed CbN firing. Trains suppressed CbN cell firing less effectively, but consistently altered millisecond-scale spike timing. Steps or trains that perturbed stride-related modulation of CbN cell firing rates correlated well with irregularities of movement, suggesting that ongoing locomotion is sensitive to alterations in modulated CbN cell firing. Unperturbed locomotion continued more often during trains than steps, however, suggesting that stride-related modulation of CbN spiking is less readily disrupted by synchronous than asynchronous inhibition.

Modulation of complex spike activity differs between zebrin-positive and -negative Purkinje cells in the pigeon cerebellum

The cerebellum is organized into parasagittal zones defined by its climbing and mossy fiber inputs, efferent projections, and Purkinje cell (PC) response properties. Additionally, parasagittal stripes can be visualized with molecular markers, such as heterogeneous expression of the isoenzyme zebrin II (ZII), where sagittal stripes of high ZII expression (ZII+) are interdigitated with stripes of low ZII expression (ZII-). In the pigeon vestibulocerebellum, a ZII+/- stripe pair represents a functional unit, insofar as both ZII+ and ZII- PCs within a stripe pair respond best to the same pattern of optic flow. In the present study, we attempted to determine whether there were any differences in the responses between ZII+ and ZII- PCs within a functional unit in response to optic flow stimuli. In pigeons of either sex, we recorded complex spike activity (CSA) from PCs in response to optic flow, marked recording sites with a fluorescent tracer, and determined the ZII identity of recorded PCs by immunohistochemistry. We found that CSA of ZII+ PCs showed a greater depth of modulation in response to the preferred optic flow pattern compared with ZII- PCs. We suggest that these differences in the depth of modulation to optic flow stimuli are due to differences in the connectivity of ZII+ and ZII- PCs within a functional unit. Specifically, ZII+ PCs project to areas of the vestibular nuclei that provide inhibitory feedback to the inferior olive, whereas ZII- PCs do not. NEW & NOTEWORTHY Although the cerebellum appears to be a uniform structure, Purkinje cells (PCs) are heterogeneous and can be categorized on the basis of the expression of molecular markers. These phenotypes are conserved across species, but the significance is undetermined. PCs in the vestibulocerebellum encode optic flow resulting from self-motion, and those that express the molecular marker zebrin II (ZII+) exhibit more sensitivity to optic flow than those that do not express zebrin II (ZII-).

No Medium-Term Spinocerebellar Input Plasticity in Deep Cerebellar Nuclear Neurons In Vivo?

The existence of input plasticity in the deep cerebellar nuclear (DCN) cells of the adult cerebellum could have profound implications for our understanding of cerebellar function. Whereas the existence of plastic changes in mossy fiber (mf) synaptic responses in DCN neurons has been demonstrated in juvenile slices, there has so far been no direct demonstration of this form of plasticity in the adult cerebellum in vivo. In the present paper, we recorded from neurons in the anterior interposed nucleus (AIN) and stimulated the spinocerebellar tracts (SCT) directly or via the skin to obtain mf activation and the inferior olive to activate climbing fibers (cfs) in the nonanesthetized, adult, decerebrated cat. We used three different types of protocols that theoretically could be expected to induce plasticity, each of which involved episodically intense afferent activation lasting for 10 min. These were conjunctive mf-cf activation, which effectively induces plasticity in cortical neurons; mf and cf activation in a pattern resembling the protocol for inducing classical conditioning; and conjunctive activation of two excitatory mf inputs. None of these protocols had any statistically significant effect on the evoked responses in the AIN neurons. We conclude that the input plasticity for excitatory mfs in the AIN cells of the adult cerebellum in vivo is likely to be less effective than that of parallel fiber synaptic inputs in cerebellar cortical cells, at least in the timespan of 1 h.

A cerebellar mechanism for learning prior distributions of time intervals

Knowledge about the statistical regularities of the world is essential for cognitive and sensorimotor function. In the domain of timing, prior statistics are crucial for optimal prediction, adaptation and planning. Where and how the nervous system encodes temporal statistics is, however, not known. Based on physiological and anatomical evidence for cerebellar learning, we develop a computational model that demonstrates how the cerebellum could learn prior distributions of time intervals and support Bayesian temporal estimation. The model shows that salient features observed in human Bayesian time interval estimates can be readily captured by learning in the cerebellar cortex and circuit level computations in the cerebellar deep nuclei. We test human behavior in two cerebellar timing tasks and find prior-dependent biases in timing that are consistent with the predictions of the cerebellar model.

Human timing behavior is biased towards previously encountered intervals and is predicted by Bayesian models. Here, the authors develop a computational model based in properties of the cerebellum to show how we might encode time estimates based on prior experience.

Cerebellar-dependent associative learning is impaired in very preterm born children and young adults

Preterm birth incorporates an increased risk for cerebellar developmental disorders likely contributing to motor and cognitive abnormalities. Experimental evidence of cerebellar dysfunction in preterm subjects, however, is sparse. In this study, classical eyeblink conditioning was used as a marker of cerebellar dysfunction. Standard delay conditioning was investigated in 20 adults and 32 preschool children born very preterm. Focal lesions were excluded based on structural magnetic resonance imaging. For comparison, an equal number of matched term born healthy peers were tested. Subgroups of children (12 preterm, 12 controls) were retested. Preterm subjects acquired significantly less conditioned responses (CR) compared to controls with slower learning rates. A likely explanation for these findings is that preterm birth impedes function of the cerebellum even in the absence of focal cerebellar lesions. The present findings are consistent with the assumption that prematurity results in long-term detrimental effects on the integrity of the cerebellum. It cannot be excluded, however, that extra-cerebellar pathology contributed to the present findings.

The Roles of the Olivocerebellar Pathway in Motor Learning and Motor Control. A Consensus Paper

For many decades, the predominant view in the cerebellar field has been that the olivocerebellar system's primary function is to induce plasticity in the cerebellar cortex, specifically, at the parallel fiber-Purkinje cell synapse. However, it has also long been proposed that the olivocerebellar system participates directly in motor control by helping to shape ongoing motor commands being issued by the cerebellum. Evidence consistent with both hypotheses exists; however, they are often investigated as mutually exclusive alternatives. In contrast, here, we take the perspective that the olivocerebellar system can contribute to both the motor learning and motor control functions of the cerebellum and might also play a role in development. We then consider the potential problems and benefits of it having multiple functions. Moreover, we discuss how its distinctive characteristics (e.g., low firing rates, synchronization, and variable complex spike waveforms) make it more or less suitable for one or the other of these functions, and why having multiple functions makes sense from an evolutionary perspective. We did not attempt to reach a consensus on the specific role(s) the olivocerebellar system plays in different types of movements, as that will ultimately be determined experimentally; however, collectively, the various contributions highlight the flexibility of the olivocerebellar system, and thereby suggest that it has the potential to act in both the motor learning and motor control functions of the cerebellum.

Granule cells control recovery from classical conditioned fear responses in the zebrafish cerebellum

Although previous studies show that the cerebellum is involved in classical fear conditioning, it is not clear which components in the cerebellum control it or how. We addressed this issue using a delayed fear-conditioning paradigm with late-stage zebrafish larvae, with the light extinguishment as the conditioned stimulus (CS) and an electric shock as the unconditioned stimulus (US). The US induced bradycardia in the restrained larvae. After paired-associate conditioning with the CS and US, a substantial population of the larvae displayed CS-evoked bradycardia responses. To investigate the roles of the zebrafish cerebellum in classical fear conditioning, we expressed botulinum toxin or the Ca2+ indicator GCaMP7a in cerebellar neurons. The botulinum-toxin-dependent inhibition of granule-cell transmissions in the corpus cerebelli (CCe, the medial lobe) did not suppress the CS-evoked bradycardia response, but rather prolonged the response. We identified cerebellar neurons with elevated CS-evoked activity after the conditioning. The CS-evoked activity of these neurons was progressively upregulated during the conditioning and was downregulated with repetition of the unpaired CS. Some of these neurons were activated immediately upon the CS presentation, whereas others were activated after a delay. Our findings indicate that granule cells control the recovery from conditioned fear responses in zebrafish.

Mechanisms underlying vestibulo-cerebellar motor learning in mice depend on movement direction

KEY POINTS

Directionality, inherent to movements, has behavioural and neuronal correlates. Direction of vestibular stimulation determines motor learning efficiency. Vestibulo-ocular reflex gain-increase correlates with Purkinje cell simple spike potentiation. The locus of neural correlates for vestibulo-ocular reflex adaptation is paradigm specific.

ABSTRACT

Compensatory eye movements elicited by head rotation, also known as vestibulo-ocular reflex (VOR), can be adapted with the use of visual feedback. The cerebellum is essential for this type of movement adaptation, although its neuronal correlates remain to be clarified. In the present study, we show that the direction of vestibular input determines the magnitude of eye movement adaptation induced by mismatched visual input in mice, with larger changes during contraversive head rotation. Moreover, the location of the neural correlate of this changed behaviour depends on the type of paradigm. Gain-increase paradigms induce increased simple spike (SS) activity in ipsilateral cerebellar Purkinje cells (PC), which is in line with eye movements triggered by optogenetic PC activation. By contrast, gain-decrease paradigms do not induce changes in SS activity, indicating that the murine vestibulo-cerebellar cortical circuitry is optimally designed to enhance ipsiversive eye movements.

Distinct responses of Purkinje neurons and roles of simple spikes during associative motor learning in larval zebrafish

To study cerebellar activity during learning, we made whole-cell recordings from larval zebrafish Purkinje cells while monitoring fictive swimming during associative conditioning. Fish learned to swim in response to visual stimulation preceding tactile stimulation of the tail. Learning was abolished by cerebellar ablation. All Purkinje cells showed task-related activity. Based on how many complex spikes emerged during learned swimming, they were classified as multiple, single, or zero complex spike (MCS, SCS, ZCS) cells. With learning, MCS and ZCS cells developed increased climbing fiber (MCS) or parallel fiber (ZCS) input during visual stimulation; SCS cells fired complex spikes associated with learned swimming episodes. The categories correlated with location. Optogenetically suppressing simple spikes only during visual stimulation demonstrated that simple spikes are required for acquisition and early stages of expression of learned responses, but not their maintenance, consistent with a transient, instructive role for simple spikes during cerebellar learning in larval zebrafish.

Learned response sequences in cerebellar Purkinje cells

Associative learning in the cerebellum has previously focused on single movements. In eyeblink conditioning, for instance, a subject learns to blink at the right time in response to a conditional stimulus (CS), such as a tone that is repeatedly followed by an unconditional corneal stimulus (US). During conditioning, the CS and US are transmitted by mossy/parallel fibers and climbing fibers to cerebellar Purkinje cells that acquire a precisely timed pause response that drives the overt blink response. The timing of this conditional Purkinje cell response is determined by the CS-US interval and is independent of temporal patterns in the input signal. In addition to single movements, the cerebellum is also believed to be important for learning complex motor programs that require multiple precisely timed muscle contractions, such as, for example, playing the piano. In the present work, we studied Purkinje cells in decerebrate ferrets that were conditioned using electrical stimulation of mossy fiber and climbing fiber afferents as CS and US, while alternating between short and long interstimulus intervals. We found that Purkinje cells can learn double pause responses, separated by an intermediate excitation, where each pause corresponds to one interstimulus interval. The results show that individual cells can not only learn to time a single response but that they also learn an accurately timed sequential response pattern.

Cerebellar learning modulates surface expression of a voltage-gated ion channel in cerebellar cortex

Numerous experiments using ex vivo electrophysiology suggest that mammalian learning and memory involves regulation of voltage-gated ion channels in terms of changes in function. Yet, little is known about learning-related regulation of voltage-gated ion channels in terms of changes in expression. In two experiments, we examined changes in cell surface expression of the voltage-gated potassium channel alpha-subunit Kv1.2 in a discrete region of cerebellar cortex after eyeblink conditioning (EBC), a well-studied form of cerebellar-dependent learning. Kv1.2 in cerebellar cortex is expressed almost entirely in basket cells, primarily in the axon terminal pinceaux (PCX) region, and Purkinje cells, primarily in dendrites. Cell surface expression of Kv1.2 was measured using both multiphoton microscopy, which allowed measurement confined to the PCX region, and biotinylation/western blot, which measured total cell surface expression. In the first experiment, rats underwent three sessions of EBC, explicitly unpaired stimulus exposure, or context-only exposure and the results revealed a decrease in Kv1.2 cell surface expression in the unpaired group as measured with microscopy but no change as measured with western blot. In the second experiment, the same three training groups underwent only one half of a session of training, and the results revealed an increase in Kv1.2 cell surface expression in the unpaired group as measured with western blot but no change as measured with microscopy. In addition, rats in the EBC group that did not express conditioned responses (CRs) exhibited the same increase in Kv1.2 cell surface expression as the unpaired group. The overall pattern of results suggests that cell surface expression of Kv1.2 is changed with exposure to EBC stimuli in the absence, or prior to the emergence, of CRs.

Modulation of 7 T fMRI Signal in the Cerebellar Cortex and Nuclei During Acquisition, Extinction, and Reacquisition of Conditioned Eyeblink Responses

Classical delay eyeblink conditioning is likely the most commonly used paradigm to study cerebellar learning. As yet, few studies have focused on extinction and savings of conditioned eyeblink responses (CRs). Saving effects, which are reflected in a reacquisition after extinction that is faster than the initial acquisition, suggest that learned associations are at least partly preserved during extinction. In this study, we tested the hypothesis that acquisition-related plasticity is nihilated during extinction in the cerebellar cortex, but retained in the cerebellar nuclei, allowing for faster reacquisition. Changes of 7 T functional magnetic resonance imaging (fMRI) signals were investigated in the cerebellar cortex and nuclei of young and healthy human subjects. Main effects of acquisition, extinction, and reacquisition against rest were calculated in conditioned stimulus-only trials. First-level β values were determined for a spherical region of interest (ROI) around the acquisition peak voxel in lobule VI, and dentate and interposed nuclei ipsilateral to the unconditioned stimulus. In the cerebellar cortex and nuclei, fMRI signals were significantly lower in extinction compared to acquisition and reacquisition, but not significantly different between acquisition and reacquisition. These findings are consistent with the theory of bidirectional learning in both the cerebellar cortex and nuclei. It cannot explain, however, why conditioned responses reappear almost immediately in reacquisition following extinction. Although the present data do not exclude that part of the initial memory remains in the cerebellum in extinction, future studies should also explore changes in extracerebellar regions as a potential substrate of saving effects. Hum Brain Mapp 38:3957-3974, 2017. © 2017 Wiley Periodicals, Inc.

Are Purkinje Cell Pauses Drivers of Classically Conditioned Blink Responses?

Several lines of evidence show that classical or Pavlovian conditioning of blink responses depends on the cerebellum. Recordings from cerebellar Purkinje cells that control the eyelid and the conditioned blink show that during training with a conditioning protocol, a Purkinje cell develops a pause response to the conditional stimulus. This conditioned cellular response has many of the properties that characterise the overt blink. The present paper argues that the learned Purkinje cell pause response is the memory trace and main driver of the overt conditioned blink and that it explains many well-known behavioural phenomena.

Encoding Temporal Features of Skilled Movements-What, Whether and How?

In order to reliably produce intelligible speech or fluently play a melody on a piano, learning the precise timing of muscle activations is essential. Surprisingly, the fundamental question of how memories of complex temporal dynamics of movement are stored across the brain is still unresolved. This review outlines the constraints that determine whether and how the timing of skilled movements is represented in the central nervous system and introduces different computational and neural mechanisms that can be harnessed for temporal encoding. It concludes by proposing a schematic model of how these different mechanisms may complement and interact with each other in fast feedback loops to achieve skilled motor timing.

Synaptic Specializations Support Frequency-Independent Purkinje Cell Output from the Cerebellar Cortex

The output of the cerebellar cortex is conveyed to the deep cerebellar nuclei (DCN) by Purkinje cells (PCs). Here, we characterize the properties of the PC-DCN synapse in juvenile and adult mice and find that prolonged high-frequency stimulation leads to steady-state responses that become increasingly frequency independent within the physiological firing range of PCs in older animals, resulting in a linear relationship between charge transfer and activation frequency. We used a low-affinity antagonist to show that GABAA-receptor saturation occurs at this synapse but does not underlie frequency-invariant transmission. We propose that PC-DCN synapses have two components of release: one prominent early in trains and another specialized to maintain transmission during prolonged activation. Short-term facilitation offsets partial vesicle depletion to produce frequency-independent transmission.

The Errors of Our Ways: Understanding Error Representations in Cerebellar-Dependent Motor Learning

The cerebellum is essential for error-driven motor learning and is strongly implicated in detecting and correcting for motor errors. Therefore, elucidating how motor errors are represented in the cerebellum is essential in understanding cerebellar function, in general, and its role in motor learning, in particular. This review examines how motor errors are encoded in the cerebellar cortex in the context of a forward internal model that generates predictions about the upcoming movement and drives learning and adaptation. In this framework, sensory prediction errors, defined as the discrepancy between the predicted consequences of motor commands and the sensory feedback, are crucial for both on-line movement control and motor learning. While many studies support the dominant view that motor errors are encoded in the complex spike discharge of Purkinje cells, others have failed to relate complex spike activity with errors. Given these limitations, we review recent findings in the monkey showing that complex spike modulation is not necessarily required for motor learning or for simple spike adaptation. Also, new results demonstrate that the simple spike discharge provides continuous error signals that both lead and lag the actual movements in time, suggesting errors are encoded as both an internal prediction of motor commands and the actual sensory feedback. These dual error representations have opposing effects on simple spike discharge, consistent with the signals needed to generate sensory prediction errors used to update a forward internal model.

A comparative approach to cerebellar function: insights from electrosensory systems

Despite its simple and highly-ordered circuitry the function of the cerebellum remains a topic of vigorous debate. This review explores connections between the cerebellum and sensory processing structures that closely resemble the cerebellum in terms of their evolution, development, patterns of gene expression, and circuitry. Recent studies of cerebellum-like structures involved in electrosensory processing in fish have provided insights into the functions of granule cells and unipolar brush cells-cell types shared with the cerebellum. We also discuss the possibility, supported by recent studies, that generating and subtracting predictions of the sensory consequences of motor commands may be core functions shared by both cerebellum-like structures and the cerebellum.

Neural Mechanisms for Predicting the Sensory Consequences of Behavior: Insights from Electrosensory Systems

Perception of the environment requires differentiating between external sensory inputs and those that are self-generated. Some of the clearest insights into the neural mechanisms underlying this process have come from studies of the electrosensory systems of fish. Neurons at the first stage of electrosensory processing generate negative images of the electrosensory consequences of the animal's own behavior. By canceling out the effects of predictable, self-generated inputs, negative images allow for the selective encoding of unpredictable, externally generated stimuli. Combined experimental and theoretical studies of electrosensory systems have led to detailed accounts of how negative images are formed at the level of synaptic plasticity rules, cells, and circuits. Here, I review these accounts and discuss their implications for understanding how predictions of the sensory consequences of behavior may be generated in other sensory structures and the cerebellum.

Mechanisms for motor timing in the cerebellar cortex

In classical eyeblink conditioning a subject learns to blink to a previously neutral stimulus. This conditional response is timed to occur just before an air puff to the eye. The learning is known to depend on the cerebellar cortex where Purkinje cells respond with adaptively timed pauses in their spontaneous firing. The pauses in the inhibitory Purkinje cells cause disinhibition of the cerebellar nuclei, which elicit the overt blinks. The timing of a Purkinje cell response was previously thought to require a temporal code in the input signal but recent work suggests that the Purkinje cells can learn to time their responses through an intrinsic mechanism that is activated by metabotropic glutamate receptors (mGluR7).

Cerebellar contributions to motor control and language comprehension: searching for common computational principles

The past 25 years have seen the functional domain of the cerebellum extend beyond the realm of motor control, with considerable discussion of how this subcortical structure contributes to cognitive domains including attention, memory, and language. Drawing on evidence from neuroanatomy, physiology, neuropsychology, and computational work, sophisticated models have been developed to describe cerebellar function in sensorimotor control and learning. In contrast, mechanistic accounts of how the cerebellum contributes to cognition have remained elusive. Inspired by the homogeneous cerebellar microanatomy and a desire for parsimony, many researchers have sought to extend mechanistic ideas from motor control to cognition. One influential hypothesis centers on the idea that the cerebellum implements internal models, representations of the context-specific dynamics of an agent's interactions with the environment, enabling predictive control. We briefly review cerebellar anatomy and physiology, to review the internal model hypothesis as applied in the motor domain, before turning to extensions of these ideas in the linguistic domain, focusing on speech perception and semantic processing. While recent findings are consistent with this computational generalization, they also raise challenging questions regarding the nature of cerebellar learning, and may thus inspire revisions of our views on the role of the cerebellum in sensorimotor control.

Inactivation of Cerebellar Cortical Crus II Disrupts Temporal Processing of Absolute Timing but not Relative Timing in Voluntary Movements

Several recent studies have demonstrated that the cerebellum plays an important role in temporal processing at the scale of milliseconds. However, it is not clear whether intrinsic cerebellar function involves the temporal processing of discrete or continuous events. Temporal processing during discrete events functions by counting absolute time like a stopwatch, while during continuous events it measures events at intervals. During the temporal processing of continuous events, animals might respond to rhythmic timing of sequential responses rather than to the absolute durations of intervals. Here, we tested the contribution of the cerebellar cortex to temporal processing of absolute and relative timings in voluntary movements. We injected muscimol and baclofen to a part of the cerebellar cortex of rats. We then tested the accuracy of their absolute or relative timing prediction using two timing tasks requiring almost identical reaching movements. Inactivation of the cerebellar cortex disrupted accurate temporal prediction in the absolute timing task. The rats formed two groups based on the changes to their timing accuracy following one of two distinct patterns which can be described as longer or shorter declines in the accuracy of learned intervals. However, a part of the cerebellar cortical inactivation did not affect the rats' performance of relative timing tasks. We concluded that a part of the cerebellar cortex, Crus II, contributes to the accurate temporal prediction of absolute timing and that the entire cerebellar cortex may be unnecessary in cases in which accurately knowing the absolute duration of an interval is not required for temporal prediction.

Contribution of Cerebellar Loops to Action Timing

Recent studies of sensorimotor processing have benefited from decision-making paradigms that emphasize the selection of appropriate movements. Selecting when to make those responses, or action timing, is important as well. Although the cerebellum is commonly viewed as a controller of movement dynamics, its role in action timing is also firmly supported. Several lines of research have now extended this idea. Anatomical findings have revealed connections between the cerebellum and broader timing circuits, neurophysiological results have suggested mechanisms for timing within its microcircuitry, and theoretical work has indicated how temporal signals are processed through it and decoded by its targets. These developments are inspiring renewed studies of the role of the cerebellar loops in action timing.

Climbing Fiber Regulation of Spontaneous Purkinje Cell Activity and Cerebellum-Dependent Blink Responses(1,2,3)

It has been known for a long time that GABAergic Purkinje cells in the cerebellar cortex, as well as their target neurons in the cerebellar nuclei, are spontaneously active. The cerebellar output will, therefore, depend on how input is integrated into this spontaneous activity. It has been shown that input from climbing fibers originating in the inferior olive controls the spontaneous activity in Purkinje cells. While blocking climbing fiber input to the Purkinje cells causes a dramatic increase in the firing rate, increased climbing fiber activity results in reduced Purkinje cell activity. However, the exact calibration of this regulation has not been examined systematically. Here we examine the relation between climbing fiber stimulation frequency and Purkinje cell activity in unanesthetized decerebrated ferrets. The results revealed a gradual suppression of Purkinje cell activity, starting at climbing fiber stimulation frequencies as low as 0.5 Hz. At 4 Hz, Purkinje cells were completely silenced. This effect lasted an average of 2 min after the stimulation rate was reduced to a lower level. We also examined the effect of sustained climbing fiber stimulation on overt behavior. Specifically, we analyzed conditioned blink responses, which are known to be dependent on the cerebellum, while stimulating the climbing fibers at different frequencies. In accordance with the neurophysiological data, the conditioned blink responses were suppressed at stimulation frequencies of ≥4 Hz.

The Anatomy and Physiology of Eyeblink Classical Conditioning

This chapter reviews the past research toward identifying the brain circuit and its computation underlying the associative memory in eyeblink classical conditioning. In the standard delay eyeblink conditioning paradigm, the conditioned stimulus (CS) and eyeblink-eliciting unconditioned stimulus (US) converge in the cerebellar cortex and interpositus nucleus (IPN) through the pontine nuclei and inferior olivary nucleus. Repeated pairings of CS and US modify synaptic weights in the cerebellar cortex and IPN, enabling IPN neurons to activate the red nucleus and generate the conditioned response (CR). In a variant of the standard paradigm, trace eyeblink conditioning, the CS and US are separated by a brief stimulus-free trace interval. Acquisition in trace eyeblink conditioning depends on several forebrain regions, including the hippocampus and medial prefrontal cortex as well as the cerebellar-brainstem circuit. Details of computations taking place in these regions remain unclear; however, recent evidence supports a view that the forebrain encodes a temporal sequence of the CS, trace interval, and US in a specific environmental context and signals the cerebellar-brainstem circuit to execute the CR when the US is likely to occur. Together, delay eyeblink conditioning represents one of the most successful cases of understanding the neural substrates of long-term memory in mammals, while trace eyeblink conditioning demonstrates its utility for uncovering detailed computations in the whole brain network underlying long-term memory.

A Model of In vitro Plasticity at the Parallel Fiber-Molecular Layer Interneuron Synapses

Theoretical and computational models of the cerebellum typically focus on the role of parallel fiber (PF)—Purkinje cell (PKJ) synapses for learned behavior, but few emphasize the role of the molecular layer interneurons (MLIs)—the stellate and basket cells. A number of recent experimental results suggest the role of MLIs is more important than previous models put forth. We investigate learning at PF—MLI synapses and propose a mathematical model to describe plasticity at this synapse. We perform computer simulations with this form of learning using a spiking neuron model of the MLI and show that it reproduces six in vitro experimental results in addition to simulating four novel protocols. Further, we show how this plasticity model can predict the results of other experimental protocols that are not simulated. Finally, we hypothesize what the biological mechanisms are for changes in synaptic efficacy that embody the phenomenological model proposed here.

Cerebellar Nuclear Neurons Use Time and Rate Coding to Transmit Purkinje Neuron Pauses

Neurons of the cerebellar nuclei convey the final output of the cerebellum to their targets in various parts of the brain. Within the cerebellum their direct upstream connections originate from inhibitory Purkinje neurons. Purkinje neurons have a complex firing pattern of regular spikes interrupted by intermittent pauses of variable length. How can the cerebellar nucleus process this complex input pattern? In this modeling study, we investigate different forms of Purkinje neuron simple spike pause synchrony and its influence on candidate coding strategies in the cerebellar nuclei. That is, we investigate how different alignments of synchronous pauses in synthetic Purkinje neuron spike trains affect either time-locking or rate-changes in the downstream nuclei. We find that Purkinje neuron synchrony is mainly represented by changes in the firing rate of cerebellar nuclei neurons. Pause beginning synchronization produced a unique effect on nuclei neuron firing, while the effect of pause ending and pause overlapping synchronization could not be distinguished from each other. Pause beginning synchronization produced better time-locking of nuclear neurons for short length pauses. We also characterize the effect of pause length and spike jitter on the nuclear neuron firing. Additionally, we find that the rate of rebound responses in nuclear neurons after a synchronous pause is controlled by the firing rate of Purkinje neurons preceding it.

Neurons can transmit information by two different coding strategies: Rate coding, where the firing rate of the neuron is vital, and time coding where timing of individual spikes carries relevant information. In this study we analyze the importance of brief cessations in firing of the presynaptic neuron (pauses) on the spiking of the postsynaptic neuron. We perform this analysis on the inhibitory synaptic connection between Purkinje neurons (presynaptic) and nuclear neurons (postsynaptic) of the cerebellum. We employ a computational model of nuclear neurons and “synthetic” Purkinje neuron spike trains to study the effect of synchronous pauses on the spiking responses of nuclear neurons. We find that synchronous pauses can cause both well-timed spikes and increased firing rate in the nuclear neuron. In addition, we characterize the effect of pause length, amount and type of pause synchrony, and spike jitter. As such, we conclude that nuclear cells use both rate and time coding to relay upstream spiking information.

Evolving Models of Pavlovian Conditioning: Cerebellar Cortical Dynamics in Awake Behaving Mice

Three decades of electrophysiological research on cerebellar cortical activity underlying Pavlovian conditioning have expanded our understanding of motor learning in the brain. Purkinje cell simple spike suppression is considered to be crucial in the expression of conditional blink responses (CRs). However, trial-by-trial quantification of this link in awake behaving animals is lacking, and current hypotheses regarding the underlying plasticity mechanisms have diverged from the classical parallel fiber one to the Purkinje cell synapse LTD hypothesis. Here, we establish that acquired simple spike suppression, acquired conditioned stimulus (CS)-related complex spike responses, and molecular layer interneuron (MLI) activity predict the expression of CRs on a trial-by-trial basis using awake behaving mice. Additionally, we show that two independent transgenic mouse mutants with impaired MLI function exhibit motor learning deficits. Our findings suggest multiple cerebellar cortical plasticity mechanisms underlying simple spike suppression, and they implicate the broader involvement of the olivocerebellar module within the interstimulus interval.

•

Simple spike suppression correlates trial by trial to conditioned eyelid behavior

•

Conditioned stimulus-related complex spikes relate to simple spikes and behavior

•

Molecular layer interneuron (MLI) modulation correlates to behavior

•

Transgenic deficits in MLI input result in partially impaired eyeblink conditioning

Purkinje cell activity during classical conditioning with different conditional stimuli explains central tenet of Rescorla–Wagner model [corrected]

A central tenet of Rescorla and Wagner's model of associative learning is that the reinforcement value of a paired trial diminishes as the associative strength between the presented stimuli increases. Despite its fundamental importance to behavioral sciences, the neural mechanisms underlying the model have not been fully explored. Here, we present findings that, taken together, can explain why a stronger association leads to a reduced reinforcement value, within the context of eyeblink conditioning. Specifically, we show that learned pause responses in Purkinje cells, which trigger adaptively timed conditioned eyeblinks, suppress the unconditional stimulus (US) signal in a graded manner. Furthermore, by examining how Purkinje cells respond to two distinct conditional stimuli and to a compound stimulus, we provide evidence that could potentially help explain the somewhat counterintuitive overexpectation phenomenon, which was derived from the Rescorla-Wagner model.

Motor Learning and the Cerebellum

Although our ability to store semantic declarative information can nowadays be readily surpassed by that of simple personal computers, our ability to learn and express procedural memories still outperforms that of supercomputers controlling the most advanced robots. To a large extent, our procedural memories are formed in the cerebellum, which embodies more than two-thirds of all neurons in our brain. In this review, we will focus on the emerging view that different modules of the cerebellum use different encoding schemes to form and express their respective memories. More specifically, zebrin-positive zones in the cerebellum, such as those controlling adaptation of the vestibulo-ocular reflex, appear to predominantly form their memories by potentiation mechanisms and express their memories via rate coding, whereas zebrin-negative zones, such as those controlling eyeblink conditioning, appear to predominantly form their memories by suppression mechanisms and express their memories in part by temporal coding using rebound bursting. Together, the different types of modules offer a rich repertoire to acquire and control sensorimotor processes with specific challenges in the spatiotemporal domain.

Relating cerebellar purkinje cell activity to the timing and amplitude of conditioned eyelid responses

How Purkinje cell (PC) activity may be altered by learning is central to theories of the cerebellum. Pavlovian eyelid conditioning, because of how directly it engages the cerebellum, has helped reveal many aspects of cerebellar learning and the underlying mechanisms. Theories of cerebellar learning assert that climbing fiber inputs control plasticity at synapses onto PCs, and thus PCs control the expression of learned responses. We tested this assertion by recording 184 eyelid PCs and 240 non-eyelid PCs during the expression of conditioned eyelid responses (CRs) in well trained rabbits. By contrasting the responses of eyelid and non-eyelid PCs and by contrasting the responses of eyelid PCs under conditions that produce differently timed CRs, we test the hypothesis that learning-related changes in eyelid PCs contribute to the learning and adaptive timing of the CRs. We used a variety of analyses to test the quantitative relationships between eyelid PC responses and the kinematic properties of the eyelid CRs. We find that the timing of eyelid PC responses varies systematically with the timing of the behavioral CRs and that there are differences in the magnitude of eyelid PC responses between larger-CR, smaller-CR, and non-CR trials. However, eyelid PC activity does not encode any single kinematic property of the behavioral CRs at a fixed time lag, nor does it linearly encode CR amplitude. Even so, the results are consistent with the hypothesis that learning-dependent changes in PC activity contribute to the adaptively timed expression of conditioned eyelid responses.

The challenge of understanding the brain: where we stand in 2015

Starting with the work of Cajal more than 100 years ago, neuroscience has sought to understand how the cells of the brain give rise to cognitive functions. How far has neuroscience progressed in this endeavor? This Perspective assesses progress in elucidating five basic brain processes: visual recognition, long-term memory, short-term memory, action selection, and motor control. Each of these processes entails several levels of analysis: the behavioral properties, the underlying computational algorithm, and the cellular/network mechanisms that implement that algorithm. At this juncture, while many questions remain unanswered, achievements in several areas of research have made it possible to relate specific properties of brain networks to cognitive functions. What has been learned reveals, at least in rough outline, how cognitive processes can be an emergent property of neurons and their connections.

Integrated plasticity at inhibitory and excitatory synapses in the cerebellar circuit

The way long-term potentiation (LTP) and depression (LTD) are integrated within the different synapses of brain neuronal circuits is poorly understood. In order to progress beyond the identification of specific molecular mechanisms, a system in which multiple forms of plasticity can be correlated with large-scale neural processing is required. In this paper we take as an example the cerebellar network, in which extensive investigations have revealed LTP and LTD at several excitatory and inhibitory synapses. Cerebellar LTP and LTD occur in all three main cerebellar subcircuits (granular layer, molecular layer, deep cerebellar nuclei) and correspondingly regulate the function of their three main neurons: granule cells (GrCs), Purkinje cells (PCs) and deep cerebellar nuclear (DCN) cells. All these neurons, in addition to be excited, are reached by feed-forward and feed-back inhibitory connections, in which LTP and LTD may either operate synergistically or homeostatically in order to control information flow through the circuit. Although the investigation of individual synaptic plasticities in vitro is essential to prove their existence and mechanisms, it is insufficient to generate a coherent view of their impact on network functioning in vivo. Recent computational models and cell-specific genetic mutations in mice are shedding light on how plasticity at multiple excitatory and inhibitory synapses might regulate neuronal activities in the cerebellar circuit and contribute to learning and memory and behavioral control.

Medial auditory thalamus is necessary for acquisition and retention of eyeblink conditioning to cochlear nucleus stimulation

Associative learning tasks commonly involve an auditory stimulus, which must be projected through the auditory system to the sites of memory induction for learning to occur. The cochlear nucleus (CN) projection to the pontine nuclei has been posited as the necessary auditory pathway for cerebellar learning, including eyeblink conditioning. However, the medial auditory thalamic nuclei (MATN), consisting of the medial division of the medial geniculate, suprageniculate, and posterior interlaminar nucleus have also been implicated as a critical auditory relay to the pontine nuclei for cerebellum-dependent motor learning. The MATN also conveys auditory information to the amygdala necessary for avoidance and fear conditioning. The current study used CN stimulation to increase activity in the pontine nuclei, relative to a tone stimulus, and possibly provide sufficient input to the cerebellum for acquisition or retention of eyeblink conditioning during MATN inactivation. Primary and secondary effects of CN stimulation and MATN inactivation were examined using 2-deoxy-glucose autoradiography. Stimulation of CN increased activity in the pontine nuclei, however, this increase was not sufficient for cerebellar learning during MATN inactivation. Results of the current experiment provide additional evidence indicating the MATN may be the critical auditory relay for many associative learning tasks.

Redefining the cerebellar cortex as an assembly of non-uniform Purkinje cell microcircuits

The adult mammalian cerebellar cortex is generally assumed to have a uniform cytoarchitecture. Differences in cerebellar function are thought to arise primarily through distinct patterns of input and output connectivity rather than as a result of variations in cortical microcircuitry. However, evidence from anatomical, physiological and genetic studies is increasingly challenging this orthodoxy, and there are now various lines of evidence indicating that the cerebellar cortex is not uniform. Here, we develop the hypothesis that regional differences in properties of cerebellar cortical microcircuits lead to important differences in information processing.