QUANTITATIVE MODELING OF SPATIO-TEMPORAL DYNAMICS OF INFERIOR OLIVE NEURONS WITH A SIMPLE CONDUCTANCE-BASED MODEL

Chaos may enhance expressivity in cerebellar granular layer

Recent evidence suggests that Golgi cells in the cerebellar granular layer are densely connected to each other with massive gap junctions. Here, we propose that the massive gap junctions between the Golgi cells contribute to the representational complexity of the granular layer of the cerebellum by inducing chaotic dynamics. We construct a model of cerebellar granular layer with diffusion coupling through gap junctions between the Golgi cells, and evaluate the representational capability of the network with the reservoir computing framework. First, we show that the chaotic dynamics induced by diffusion coupling results in complex output patterns containing a wide range of frequency components. Second, the long non-recursive time series of the reservoir represents the passage of time from an external input. These properties of the reservoir enable mapping different spatial inputs into different temporal patterns.

Electrical coupling controls dimensionality and chaotic firing of inferior olive neurons

We previously proposed, on theoretical grounds, that the cerebellum must regulate the dimensionality of its neuronal activity during motor learning and control to cope with the low firing frequency of inferior olive neurons, which form one of two major inputs to the cerebellar cortex. Such dimensionality regulation is possible via modulation of electrical coupling through the gap junctions between inferior olive neurons by inhibitory GABAergic synapses. In addition, we previously showed in simulations that intermediate coupling strengths induce chaotic firing of inferior olive neurons and increase their information carrying capacity. However, there is no in vivo experimental data supporting these two theoretical predictions. Here, we computed the levels of synchrony, dimensionality, and chaos of the inferior olive code by analyzing in vivo recordings of Purkinje cell complex spike activity in three different coupling conditions: carbenoxolone (gap junctions blocker), control, and picrotoxin (GABA-A receptor antagonist). To examine the effect of electrical coupling on dimensionality and chaotic dynamics, we first determined the physiological range of effective coupling strengths between inferior olive neurons in the three conditions using a combination of a biophysical network model of the inferior olive and a novel Bayesian model averaging approach. We found that effective coupling co-varied with synchrony and was inversely related to the dimensionality of inferior olive firing dynamics, as measured via a principal component analysis of the spike trains in each condition. Furthermore, for both the model and the data, we found an inverted U-shaped relationship between coupling strengths and complexity entropy, a measure of chaos for spiking neural data. These results are consistent with our hypothesis according to which electrical coupling regulates the dimensionality and the complexity in the inferior olive neurons in order to optimize both motor learning and control of high dimensional motor systems by the cerebellum.

Computational theory suggests that the cerebellum must decrease the dimensionality of its neuronal activity to learn and control high dimensional motor systems effectively, while being constrained by the low firing frequency of inferior olive neurons, one of the two major source of input signals to the cerebellum. We previously proposed that the cerebellum adaptively controls the dimensionality of inferior olive firing by adjusting the level of synchrony and that such control is made possible by modulating the electrical coupling strength between inferior olive neurons. Here, we developed a novel method that uses a biophysical model of the inferior olive to accurately estimate the effective coupling strengths between inferior olive neurons from in vivo recordings of spike activity in three different coupling conditions. We found that high coupling strengths induce synchronous firing and decrease the dimensionality of inferior olive firing dynamics. In contrast, intermediate coupling strengths lead to chaotic firing and increase the dimensionality of the firing dynamics. Thus, electrical coupling is a feasible mechanism to control dimensionality and chaotic firing of inferior olive neurons. In sum, our results provide insights into possible mechanisms underlying cerebellar function and, in general, a biologically plausible framework to control the dimensionality of neural coding.

Chaotic dynamics as a mechanism of rapid transition of hippocampal local field activity between theta and non-theta states

We propose a dynamical model of the local hippocampal circuit realizing the transition between the theta and non-theta states. We model the interaction between hippocampal local rhythm generators and the external periodic input from the medial septum and diagonal band of Broca (MS-DBB). With our model, bifurcation of the nonlinear dynamics serves as a mechanism that realizes two distinctive oscillations in the hippocampus, where the amplitude of the oscillatory input from the MS-DBB works as a bifurcation parameter. We model the network of the hippocampal interneurons with a network of simple class 1 neuron models connected mutually with gap junctions. The model neurons exhibit highly synchronous periodic oscillations under the existence of an external force from the MS-DBB, just as the real hippocampus shows theta oscillation under the rhythmic input from the MS-DBB. The model shows diffusion-induced chaotic dynamics under an aperiodic MS-DBB activity, just as the large amplitude irregular activity appears following the disappearance of the rhythmicity of the MS-DBB neurons in the real brain. The model is consistent with both previous experimental findings reporting the existence of local rhythm generators in the hippocampus and the executive role of the MS-DBB in synchronizing theta oscillation in vivo. Our model also replicates the traveling waves of theta oscillations in two-dimensionally coupled networks.

A Multiple-Plasticity Spiking Neural Network Embedded in a Closed-Loop Control System to Model Cerebellar Pathologies

The cerebellum plays a crucial role in sensorimotor control and cerebellar disorders compromise adaptation and learning of motor responses. However, the link between alterations at network level and cerebellar dysfunction is still unclear. In principle, this understanding would benefit of the development of an artificial system embedding the salient neuronal and plastic properties of the cerebellum and operating in closed-loop. To this aim, we have exploited a realistic spiking computational model of the cerebellum to analyze the network correlates of cerebellar impairment. The model was modified to reproduce three different damages of the cerebellar cortex: (i) a loss of the main output neurons (Purkinje Cells), (ii) a lesion to the main cerebellar afferents (Mossy Fibers), and (iii) a damage to a major mechanism of synaptic plasticity (Long Term Depression). The modified network models were challenged with an Eye-Blink Classical Conditioning test, a standard learning paradigm used to evaluate cerebellar impairment, in which the outcome was compared to reference results obtained in human or animal experiments. In all cases, the model reproduced the partial and delayed conditioning typical of the pathologies, indicating that an intact cerebellar cortex functionality is required to accelerate learning by transferring acquired information to the cerebellar nuclei. Interestingly, depending on the type of lesion, the redistribution of synaptic plasticity and response timing varied greatly generating specific adaptation patterns. Thus, not only the present work extends the generalization capabilities of the cerebellar spiking model to pathological cases, but also predicts how changes at the neuronal level are distributed across the network, making it usable to infer cerebellar circuit alterations occurring in cerebellar pathologies.

New insights into olivo-cerebellar circuits for learning from a small training sample

Artificial intelligence such as deep neural networks exhibited remarkable performance in simulated video games and 'Go'. In contrast, most humanoid robots in the DARPA Robotics Challenge fell down to ground. The dramatic contrast in performance is mainly due to differences in the amount of training data, which is huge and small, respectively. Animals are not allowed with millions of the failed trials, which lead to injury and death. Humans fall only several thousand times before they balance and walk. We hypothesize that a unique closed-loop neural circuit formed by the Purkinje cells, the cerebellar deep nucleus and the inferior olive in and around the cerebellum and the highest density of gap junctions, which regulate synchronous activities of the inferior olive nucleus, are computational machinery for learning from a small sample. We discuss recent experimental and computational advances associated with this hypothesis.

Transient dynamics and rhythm coordination of inferior olive spatio-temporal patterns

The inferior olive (IO) is a neural network belonging to the olivo-cerebellar system whose neurons are coupled with electrical synapses and display subthreshold oscillations and spiking activity. The IO is frequently proposed as the generator of timing signals to the cerebellum. Electrophysiological and imaging recordings show that the IO network generates complex spatio-temporal patterns. The generation and modulation of coherent spiking activity in the IO is one key issue in cerebellar research. In this work, we build a large scale IO network model of electrically coupled conductance-based neurons to study the emerging spatio-temporal patterns of its transient neuronal activity. Our modeling reproduces and helps to understand important phenomena observed in IO in vitro and in vivo experiments, and draws new predictions regarding the computational properties of this network and the associated cerebellar circuits. The main factors studied governing the collective dynamics of the IO network were: the degree of electrical coupling, the extent of the electrotonic connections, the presence of stimuli or regions with different excitability levels and the modulatory effect of an inhibitory loop (IL). The spatio-temporal patterns were analyzed using a discrete wavelet transform to provide a quantitative characterization. Our results show that the electrotonic coupling produces quasi-synchronized subthreshold oscillations over a wide dynamical range. The synchronized oscillatory activity plays the role of a timer for a coordinated representation of spiking rhythms with different frequencies. The encoding and coexistence of several coordinated rhythms is related to the different clusterization and coherence of transient spatio-temporal patterns in the network, where the spiking activity is commensurate with the quasi-synchronized subthreshold oscillations. In the presence of stimuli, different rhythms are encoded in the spiking activity of the IO neurons that nevertheless remains constrained to a commensurate value of the subthreshold frequency. The stimuli induced spatio-temporal patterns can reverberate for long periods, which contributes to the computational properties of the IO. We also show that the presence of regions with different excitability levels creates sinks and sources of coordinated activity which shape the propagation of spike wave fronts. These results can be generalized beyond IO studies, as the control of wave pattern propagation is a highly relevant problem in the context of normal and pathological states in neural systems (e.g., related to tremor, migraine, epilepsy) where the study of the modulation of activity sinks and sources can have a potential large impact.

Role of the olivo-cerebellar complex in motor learning and control

How is the cerebellum capable of efficient motor learning and control despite very low firing of the inferior olive (IO) inputs, which are postulated to carry errors needed for learning and contribute to on-line motor control? IO neurons form the largest electrically coupled network in the adult human brain. Here, we discuss how intermediate coupling strengths can lead to chaotic resonance and increase information transmission of the error signal despite the very low IO firing rate. This increased information transmission can then lead to more efficient learning than with weak or strong coupling. In addition, we argue that a dynamic modulation of IO electrical coupling via the Purkinje cell-deep cerebellar neurons – IO triangle could speed up learning and improve on-line control. Initially strong coupling would allow transmission of large errors to multiple functionally related Purkinje cells, resulting in fast but coarse learning as well as significant effects on deep cerebellar nucleus and on-line motor control. In the late phase of learning decreased coupling would allow desynchronized IO firing, allowing high-fidelity transmission of error, resulting in slower but fine learning, and little on-line motor control effects.

Solution to the inverse problem of estimating gap-junctional and inhibitory conductance in inferior olive neurons from spike trains by network model simulation

The inferior olive (IO) possesses synaptic glomeruli, which contain dendritic spines from neighboring neurons and presynaptic terminals, many of which are inhibitory and GABAergic. Gap junctions between the spines electrically couple neighboring neurons whereas the GABAergic synaptic terminals are thought to act to decrease the effectiveness of this coupling. Thus, the glomeruli are thought to be important for determining the oscillatory and synchronized activity displayed by IO neurons. Indeed, the tendency to display such activity patterns is enhanced or reduced by the local administration of the GABA-A receptor blocker picrotoxin (PIX) or the gap junction blocker carbenoxolone (CBX), respectively. We studied the functional roles of the glomeruli by solving the inverse problem of estimating the inhibitory (gi) and gap-junctional conductance (gc) using an IO network model. This model was built upon a prior IO network model, in which the individual neurons consisted of soma and dendritic compartments, by adding a glomerular compartment comprising electrically coupled spines that received inhibitory synapses. The model was used in the forward mode to simulate spike data under PIX and CBX conditions for comparison with experimental data consisting of multi-electrode recordings of complex spikes from arrays of Purkinje cells (complex spikes are generated in a one-to-one manner by IO spikes and thus can substitute for directly measuring IO spike activity). The spatiotemporal firing dynamics of the experimental and simulation spike data were evaluated as feature vectors, including firing rates, local variation, auto-correlogram, cross-correlogram, and minimal distance, and were contracted onto two-dimensional principal component analysis (PCA) space. gc and gi were determined as the solution to the inverse problem such that the simulation and experimental spike data were closely matched in the PCA space. The goodness of the match was confirmed by an analysis of variance (ANOVA) of the PCA scores between the experimental and simulation spike data. In the PIX condition, gi was found to decrease to approximately half its control value. CBX caused an approximately 30% decrease in gc from control levels. These results support the hypothesis that the glomeruli are control points for determining the spatiotemporal characteristics of olivocerebellar activity and thus may shape its ability to convey signals to the cerebellum that may be used for motor learning or motor control purposes.

Adaptive coupling of inferior olive neurons in cerebellar learning

In the cerebellar learning hypothesis, inferior olive neurons are presumed to transmit high fidelity error signals, despite their low firing rates. The idea of chaotic resonance has been proposed to realize efficient error transmission by desynchronized spiking activities induced by moderate electrical coupling between inferior olive neurons. A recent study suggests that the coupling strength between inferior olive neurons can be adaptive and may decrease during the learning process. We show that such a decrease in coupling strength can be beneficial for motor learning, since efficient coupling strength depends upon the magnitude of the error signals. We introduce a scheme of adaptive coupling that enhances the learning of a neural controller for fast arm movements. Our numerical study supports the view that the controlling strategy of the coupling strength provides an additional degree of freedom to optimize the actual learning in the cerebellum.

Dynamical robustness in complex networks: the crucial role of low-degree nodes

Many social, biological, and technological networks consist of a small number of highly connected components (hubs) and a very large number of loosely connected components (low-degree nodes). It has been commonly recognized that such heterogeneously connected networks are extremely vulnerable to the failure of hubs in terms of structural robustness of complex networks. However, little is known about dynamical robustness, which refers to the ability of a network to maintain its dynamical activity against local perturbations. Here we demonstrate that, in contrast to the structural fragility, the nonlinear dynamics of heterogeneously connected networks can be highly vulnerable to the failure of low-degree nodes. The crucial role of low-degree nodes results from dynamical processes where normal (active) units compensate for the failure of neighboring (inactive) units at the expense of a reduction in their own activity. Our finding highlights the significant difference between structural and dynamical robustness in complex networks.

Bifurcation of orbits and synchrony in inferior olive neurons

Inferior olive neurons (IONs) have rich dynamics and can exhibit stable, unstable, periodic, and even chaotic trajectories. This paper presents an analysis of bifurcation of periodic orbits of an ION when its two key parameters (a, μ) are varied in a two-dimensional plane. The parameter a describes the shape of the parabolic nonlinearity in the model and μ is the extracellular stimulus. The four-dimensional ION model considered here is a cascade connection of two subsystems (S(a) and S(b)). The parameter plane (a - μ) is delineated into several subregions. The ION has distinct orbit structure and stability property in each subregion. It is shown that the subsystem S(a) or S(b) undergoes supercritical Poincare-Andronov-Hopf (PAH) bifurcation at a critical value μ(c)(a) of the extracellular stimulus and periodic orbits of the neuron are born. Based on the center manifold theory, the existence of periodic orbits in the asymptotically stable S(a), when the subsystem S(b) undergoes PAH bifurcation, is established. In such a case, both subsystems exhibit periodic orbits. Interestingly when S(b) is under PAH bifurcation and S(a) is unstable, the trajectory of S(a) exhibits periodic bursting, interrupted by periods of quiescence. The bifurcation analysis is followed by the design of (i) a linear first-order filter and (ii) a nonlinear control system for the synchronization of IONs. The first controller uses a single output of each ION, but the nonlinear control system uses two state variables for feedback. The open-loop and closed-loop responses are presented which show bifurcation of orbits and synchronization of oscillating neurons.

Cerebellar supervised learning revisited: biophysical modeling and degrees-of-freedom control

The biophysical models of spike-timing-dependent plasticity have explored dynamics with molecular basis for such computational concepts as coincidence detection, synaptic eligibility trace, and Hebbian learning. They overall support different learning algorithms in different brain areas, especially supervised learning in the cerebellum. Because a single spine is physically very small, chemical reactions at it are essentially stochastic, and thus sensitivity-longevity dilemma exists in the synaptic memory. Here, the cascade of excitable and bistable dynamics is proposed to overcome this difficulty. All kinds of learning algorithms in different brain regions confront with difficult generalization problems. For resolution of this issue, the control of the degrees-of-freedom can be realized by changing synchronicity of neural firing. Especially, for cerebellar supervised learning, the triangle closed-loop circuit consisting of Purkinje cells, the inferior olive nucleus, and the cerebellar nucleus is proposed as a circuit to optimally control synchronous firing and degrees-of-freedom in learning.