Desynchronizing electrical and sensory coordinated reset neuromodulation

Feedback control of collective dynamics in an oscillator population with time-dependent connectivity

We present a numerical study of pulsatile feedback-based control of synchrony level in a highly-interconnected oscillatory network. We focus on a nontrivial case when the system is close to the synchronization transition point and exhibits collective rhythm with strong amplitude modulation. We pay special attention to technical but essential steps like causal real-time extraction of the signal of interest from a noisy measurement and estimation of instantaneous phase and amplitude. The feedback loop's parameters are tuned automatically to suppress synchrony. Though the study is motivated by neuroscience, the results are relevant to controlling oscillatory activity in ensembles of various natures and, thus, to the rapidly developing field of network physiology.

BGRL: Basal Ganglia inspired Reinforcement Learning based framework for deep brain stimulators

Deep Brain Stimulation (DBS) is an implantable medical device used for electrical stimulation to treat neurological disorders. Traditional DBS devices provide fixed frequency pulses, but personalized adjustment of stimulation parameters is crucial for optimal treatment. This paper introduces a Basal Ganglia inspired Reinforcement Learning (BGRL) approach, incorporating a closed-loop feedback mechanism to suppress neural synchrony during neurological fluctuations. The BGRL approach leverages the resemblance between the Basal Ganglia region of brain by incorporating the actor-critic architecture of reinforcement learning (RL). Simulation results demonstrate that BGRL significantly reduces synchronous electrical pulses compared to other standard RL algorithms. BGRL algorithm outperforms existing RL methods in terms of suppression capability and energy consumption, validated through comparisons using ensemble oscillators. Results shown in the paper demonstrate BGRL suppressed the synchronous electrical pulses across three signaling regimes namely regular, chaotic and bursting by 40%, 146% and 40% respectively as compared to soft actor-critic model. BGRL shows promise in effectively suppressing neural synchrony in DBS therapy, providing an efficient alternative to open-loop methodologies.

Closing the loop in psychiatric deep brain stimulation: physiology, psychometrics, and plasticity

Deep brain stimulation (DBS) is an invasive approach to precise modulation of psychiatrically relevant circuits. Although it has impressive results in open-label psychiatric trials, DBS has also struggled to scale to and pass through multi-center randomized trials. This contrasts with Parkinson disease, where DBS is an established therapy treating thousands of patients annually. The core difference between these clinical applications is the difficulty of proving target engagement, and of leveraging the wide range of possible settings (parameters) that can be programmed in a given patient's DBS. In Parkinson's, patients' symptoms change rapidly and visibly when the stimulator is tuned to the correct parameters. In psychiatry, those same changes take days to weeks, limiting a clinician's ability to explore parameter space and identify patient-specific optimal settings. I review new approaches to psychiatric target engagement, with an emphasis on major depressive disorder (MDD). Specifically, I argue that better engagement may come by focusing on the root causes of psychiatric illness: dysfunction in specific, measurable cognitive functions and in the connectivity and synchrony of distributed brain circuits. I overview recent progress in both those domains, and how it may relate to other technologies discussed in companion articles in this issue.

Synaptic network structure shapes cortically evoked spatio-temporal responses of STN and GPe neurons in a computational model

Introduction

The basal ganglia (BG) are involved in motor control and play an essential role in movement disorders such as hemiballismus, dystonia, and Parkinson's disease. Neurons in the motor part of the BG respond to passive movement or stimulation of different body parts and to stimulation of corresponding cortical regions. Experimental evidence suggests that the BG are organized somatotopically, i.e., specific areas of the body are associated with specific regions in the BG nuclei. Signals related to the same body part that propagate along different pathways converge onto the same BG neurons, leading to characteristic shapes of cortically evoked responses. This suggests the existence of functional channels that allow for the processing of different motor commands or information related to different body parts in parallel. Neurological disorders such as Parkinson's disease are associated with pathological activity in the BG and impaired synaptic connectivity, together with reorganization of somatotopic maps. One hypothesis is that motor symptoms are, at least partly, caused by an impairment of network structure perturbing the organization of functional channels.

Methods

We developed a computational model of the STN-GPe circuit, a central part of the BG. By removing individual synaptic connections, we analyzed the contribution of signals propagating along different pathways to cortically evoked responses. We studied how evoked responses are affected by systematic changes in the network structure. To quantify the BG's organization in the form of functional channels, we suggested a two-site stimulation protocol.

Results

Our model reproduced the cortically evoked responses of STN and GPe neurons and the contributions of different pathways suggested by experimental studies. Cortical stimulation evokes spatio-temporal response patterns that are linked to the underlying synaptic network structure. Our two-site stimulation protocol yielded an approximate functional channel width.

Discussion/conclusion

The presented results provide insight into the organization of BG synaptic connectivity, which is important for the development of computational models. The synaptic network structure strongly affects the processing of cortical signals and may impact the generation of pathological rhythms. Our work may motivate further experiments to analyze the network structure of BG nuclei and their organization in functional channels.

Mean-Field Approximations With Adaptive Coupling for Networks With Spike-Timing-Dependent Plasticity

Understanding the effect of spike-timing-dependent plasticity (STDP) is key to elucidating how neural networks change over long timescales and to design interventions aimed at modulating such networks in neurological disorders. However, progress is restricted by the significant computational cost associated with simulating neural network models with STDP and by the lack of low-dimensional description that could provide analytical insights. Phase-difference-dependent plasticity (PDDP) rules approximate STDP in phase oscillator networks, which prescribe synaptic changes based on phase differences of neuron pairs rather than differences in spike timing. Here we construct mean-field approximations for phase oscillator networks with STDP to describe part of the phase space for this very high-dimensional system. We first show that single-harmonic PDDP rules can approximate a simple form of symmetric STDP, while multiharmonic rules are required to accurately approximate causal STDP. We then derive exact expressions for the evolution of the average PDDP coupling weight in terms of network synchrony. For adaptive networks of Kuramoto oscillators that form clusters, we formulate a family of low-dimensional descriptions based on the mean-field dynamics of each cluster and average coupling weights between and within clusters. Finally, we show that such a two-cluster mean-field model can be fitted to synthetic data to provide a low-dimensional approximation of a full adaptive network with symmetric STDP. Our framework represents a step toward a low-dimensional description of adaptive networks with STDP, and could for example inform the development of new therapies aimed at maximizing the long-lasting effects of brain stimulation.

Perspectives on adaptive dynamical systems

Adaptivity is a dynamical feature that is omnipresent in nature, socio-economics, and technology. For example, adaptive couplings appear in various real-world systems, such as the power grid, social, and neural networks, and they form the backbone of closed-loop control strategies and machine learning algorithms. In this article, we provide an interdisciplinary perspective on adaptive systems. We reflect on the notion and terminology of adaptivity in different disciplines and discuss which role adaptivity plays for various fields. We highlight common open challenges and give perspectives on future research directions, looking to inspire interdisciplinary approaches.

Efficient suppression of parkinsonian beta oscillations in a closed-loop model of deep brain stimulation with amplitude modulation

Introduction

Parkinson's disease (PD) is a movement disorder characterized by the pathological beta band (15-30 Hz) neural oscillations within the basal ganglia (BG). It is shown that the suppression of abnormal beta oscillations is correlated with the improvement of PD motor symptoms, which is a goal of standard therapies including deep brain stimulation (DBS). To overcome the stimulation-induced side effects and inefficiencies of conventional DBS (cDBS) and to reduce the administered stimulation current, closed-loop adaptive DBS (aDBS) techniques were developed. In this method, the frequency and/or amplitude of stimulation are modulated based on various disease biomarkers.

Methods

Here, by computational modeling of a cortico-BG-thalamic network in normal and PD conditions, we show that closed-loop aDBS of the subthalamic nucleus (STN) with amplitude modulation leads to a more effective suppression of pathological beta oscillations within the parkinsonian BG.

Results

Our results show that beta band neural oscillations are restored to their normal range and the reliability of the response of the thalamic neurons to motor cortex commands is retained due to aDBS with amplitude modulation. Furthermore, notably less stimulation current is administered during aDBS compared with cDBS due to a closed-loop control of stimulation amplitude based on the STN local field potential (LFP) beta activity.

Discussion

Efficient models of closed-loop stimulation may contribute to the clinical development of optimized aDBS techniques designed to reduce potential stimulation-induced side effects of cDBS in PD patients while leading to a better therapeutic outcome.

Interplay of different synchronization modes and synaptic plasticity in a system of class I neurons

We analyze the effect of spike-timing-dependent plasticity (STDP) on a system of pulse-coupled class I neurons. Our research begins with a system of two mutually connected quadratic integrate-and-fire (QIF) neurons, which are canonical representatives of class I neurons. Along with various asymptotic modes previously observed in other neuronal models with plastic synapses, we found a stable synchronous mode characterized by unidirectional link from a slower neuron to a faster neuron. In this frequency-locked mode, the faster neuron emits multiple spikes per cycle of the slower neuron. We analytically obtain the Arnold tongues for this mode without STDP and with STDP. We also consider larger plastic networks of QIF neurons and show that the detected mode can manifest itself in such a way that slow neurons become pacemakers. As a result, slow and fast neurons can form large synchronous clusters that generate low-frequency oscillations. We demonstrate the generality of the results obtained with two connected QIF neurons using Wang-Buzsáki and Morris-Lecar biophysically plausible class I neuron models.

Synaptic reshaping of plastic neuronal networks by periodic multichannel stimulation with single-pulse and burst stimuli

Synaptic dysfunction is associated with several brain disorders, including Alzheimer's disease, Parkinson's disease (PD) and obsessive compulsive disorder (OCD). Utilizing synaptic plasticity, brain stimulation is capable of reshaping synaptic connectivity. This may pave the way for novel therapies that specifically counteract pathological synaptic connectivity. For instance, in PD, novel multichannel coordinated reset stimulation (CRS) was designed to counteract neuronal synchrony and down-regulate pathological synaptic connectivity. CRS was shown to entail long-lasting therapeutic aftereffects in PD patients and related animal models. This is in marked contrast to conventional deep brain stimulation (DBS) therapy, where PD symptoms return shortly after stimulation ceases. In the present paper, we study synaptic reshaping by periodic multichannel stimulation (PMCS) in networks of leaky integrate-and-fire (LIF) neurons with spike-timing-dependent plasticity (STDP). During PMCS, phase-shifted periodic stimulus trains are delivered to segregated neuronal subpopulations. Harnessing STDP, PMCS leads to changes of the synaptic network structure. We found that the PMCS-induced changes of the network structure depend on both the phase lags between stimuli and the shape of individual stimuli. Single-pulse stimuli and burst stimuli with low intraburst frequency down-regulate synapses between neurons receiving stimuli simultaneously. In contrast, burst stimuli with high intraburst frequency up-regulate these synapses. We derive theoretical approximations of the stimulation-induced network structure. This enables us to formulate stimulation strategies for inducing a variety of network structures. Our results provide testable hypotheses for future pre-clinical and clinical studies and suggest that periodic multichannel stimulation may be suitable for reshaping plastic neuronal networks to counteract pathological synaptic connectivity. Furthermore, we provide novel insight on how the stimulus type may affect the long-lasting outcome of conventional DBS. This may strongly impact parameter adjustment procedures for clinical DBS, which, so far, primarily focused on acute effects of stimulation.

Dynamics of phase oscillator networks with synaptic weight and structural plasticity

We study the dynamics of Kuramoto oscillator networks with two distinct adaptation processes, one varying the coupling strengths and the other altering the network structure. Such systems model certain networks of oscillatory neurons where the neuronal dynamics, synaptic weights, and network structure interact with and shape each other. We model synaptic weight adaptation with spike-timing-dependent plasticity (STDP) that runs on a longer time scale than neuronal spiking. Structural changes that include addition and elimination of contacts occur at yet a longer time scale than the weight adaptations. First, we study the steady-state dynamics of Kuramoto networks that are bistable and can settle in synchronized or desynchronized states. To compare the impact of adding structural plasticity, we contrast the network with only STDP to one with a combination of STDP and structural plasticity. We show that the inclusion of structural plasticity optimizes the synchronized state of a network by allowing for synchronization with fewer links than a network with STDP alone. With non-identical units in the network, the addition of structural plasticity leads to the emergence of correlations between the oscillators' natural frequencies and node degrees. In the desynchronized regime, the structural plasticity decreases the number of contacts, leading to a sparse network. In this way, adding structural plasticity strengthens both synchronized and desynchronized states of a network. Second, we use desynchronizing coordinated reset stimulation and synchronizing periodic stimulation to induce desynchronized and synchronized states, respectively. Our findings indicate that a network with a combination of STDP and structural plasticity may require stronger and longer stimulation to switch between the states than a network with STDP only.

Inhibitory Spike-Timing-Dependent Plasticity Can Account for Pathological Strengthening of Pallido-Subthalamic Synapses in Parkinson's Disease

Parkinson's disease (PD) is a neurodegenerative brain disorder associated with dysfunction of the basal ganglia (BG) circuitry. Dopamine (DA) depletion in experimental PD models leads to the pathological strengthening of pallido-subthalamic synaptic connections, contributing to the emergence of abnormally synchronized neuronal activity in the external segment of the globus pallidus (GPe) and subthalamic nucleus (STN). Augmented GPe-STN transmission following loss of DA was attributed to heterosynaptic plasticity mechanisms induced by cortico-subthalamic inputs. However, synaptic plasticity may play a role in this process. Here, by employing computational modeling we show that assuming inhibitory spike-timing-dependent plasticity (iSTDP) at pallido-subthalamic synapses can account for pathological strengthening of pallido-subthalamic synapses in PD by further promoting correlated neuronal activity in the GPe-STN network. In addition, we show that GPe-STN transmission delays can shape bistable activity-connectivity states due to iSTDP, characterized by strong connectivity and strong synchronized activity (pathological states) as opposed to weak connectivity and desynchronized activity (physiological states). Our results may shed light on how abnormal reshaping of GPe-STN connectivity by synaptic plasticity during parkinsonism is related to the PD pathophysiology and contribute to the development of therapeutic brain stimulation techniques targeting plasticity-induced rewiring of network connectivity.

Shuffling Improves the Acute and Carryover Effect of Subthalamic Coordinated Reset Deep Brain Stimulation

Coordinated reset deep brain stimulation (CR DBS) in the subthalamic nucleus (STN) has been demonstrated effective for the treatment of the motor signs associated with Parkinson's disease (PD). A critical CR parameter is an order in which stimulation is delivered across contacts. The relative effect of alternating vs. not alternating this order, i.e., shuffling vs. non-shuffling, however, has not been evaluated in vivo. The objective of this study is to compare the effect of shuffled vs. non-shuffled STN CR DBS on Parkinsonian motor signs. Two Parkinsonian non-human primates were implanted with a DBS lead in the STN. The effects of STN CR DBS with and without shuffling were compared with the traditional isochronal DBS (tDBS) using a within-subject design. For each stimulation setting, DBS was delivered for 2 or 4 h/day for 5 consecutive days. The severity of PD was assessed using a modified clinical rating scale immediately before, during, and 1 h after DBS, as well as on days following the discontinuation of the 5 days of daily stimulation, i.e., carryover effect. Shuffled STN CR DBS produced greater acute and carryover improvements on Parkinsonian motor signs compared with non-shuffled CR. Moreover, this difference was more pronounced when more effective stimulation intensity and burst frequency settings were used. tDBS showed limited carryover effects. Given the significant effect of shuffling on the effectiveness of CR DBS, it will be critical for future studies to further define the relative role of different CR parameters for the clinical implementation of this novel stimulation paradigm.

Long-Lasting Desynchronization of Plastic Neuronal Networks by Double-Random Coordinated Reset Stimulation

Hypersynchrony of neuronal activity is associated with several neurological disorders, including essential tremor and Parkinson's disease (PD). Chronic high-frequency deep brain stimulation (HF DBS) is the standard of care for medically refractory PD. Symptoms may effectively be suppressed by HF DBS, but return shortly after cessation of stimulation. Coordinated reset (CR) stimulation is a theory-based stimulation technique that was designed to specifically counteract neuronal synchrony by desynchronization. During CR, phase-shifted stimuli are delivered to multiple neuronal subpopulations. Computational studies on CR stimulation of plastic neuronal networks revealed long-lasting desynchronization effects obtained by down-regulating abnormal synaptic connectivity. This way, networks are moved into attractors of stable desynchronized states such that stimulation-induced desynchronization persists after cessation of stimulation. Preclinical and clinical studies confirmed corresponding long-lasting therapeutic and desynchronizing effects in PD. As PD symptoms are associated with different pathological synchronous rhythms, stimulation-induced long-lasting desynchronization effects should favorably be robust to variations of the stimulation frequency. Recent computational studies suggested that this robustness can be improved by randomizing the timings of stimulus deliveries. We study the long-lasting effects of CR stimulation with randomized stimulus amplitudes and/or randomized stimulus timing in networks of leaky integrate-and-fire (LIF) neurons with spike-timing-dependent plasticity. Performing computer simulations and analytical calculations, we study long-lasting desynchronization effects of CR with and without randomization of stimulus amplitudes alone, randomization of stimulus times alone as well as the combination of both. Varying the CR stimulation frequency (with respect to the frequency of abnormal target rhythm) and the number of separately stimulated neuronal subpopulations, we reveal parameter regions and related mechanisms where the two qualitatively different randomization mechanisms improve the robustness of long-lasting desynchronization effects of CR. In particular, for clinically relevant parameter ranges double-random CR stimulation, i.e., CR stimulation with the specific combination of stimulus amplitude randomization and stimulus time randomization, may outperform regular CR stimulation with respect to long-lasting desynchronization. In addition, our results provide the first evidence that an effective reduction of the overall stimulation current by stimulus amplitude randomization may improve the frequency robustness of long-lasting therapeutic effects of brain stimulation.

Optimizing charge-balanced pulse stimulation for desynchronization

Collective synchronization in a large population of self-sustained units appears both in natural and engineered systems. Sometimes this effect is in demand, while in some cases, it is undesirable, which calls for control techniques. In this paper, we focus on pulsatile control, with the goal to either increase or decrease the level of synchrony. We quantify this level by the entropy of the phase distribution. Motivated by possible applications in neuroscience, we consider pulses of a realistic shape. Exploiting the noisy Kuramoto-Winfree model, we search for the optimal pulse profile and the optimal stimulation phase. For this purpose, we derive an expression for the change of the phase distribution entropy due to the stimulus. We relate this change to the properties of individual units characterized by generally different natural frequencies and phase response curves and the population's state. We verify the general result by analyzing a two-frequency population model and demonstrating a good agreement of the theory and numerical simulations.

Spike-Timing-Dependent Plasticity Mediated by Dopamine and its Role in Parkinson's Disease Pathophysiology

Parkinson's disease (PD) is a multi-systemic neurodegenerative brain disorder. Motor symptoms of PD are linked to the significant dopamine (DA) loss in substantia nigra pars compacta (SNc) followed by basal ganglia (BG) circuit dysfunction. Increasing experimental and computational evidence indicates that (synaptic) plasticity plays a key role in the emergence of PD-related pathological changes following DA loss. Spike-timing-dependent plasticity (STDP) mediated by DA provides a mechanistic model for synaptic plasticity to modify synaptic connections within the BG according to the neuronal activity. To shed light on how DA-mediated STDP can shape neuronal activity and synaptic connectivity in the PD condition, we reviewed experimental and computational findings addressing the modulatory effect of DA on STDP as well as other plasticity mechanisms and discussed their potential role in PD pathophysiology and related network dynamics and connectivity. In particular, reshaping of STDP profiles together with other plasticity-mediated processes following DA loss may abnormally modify synaptic connections in competing pathways of the BG. The cascade of plasticity-induced maladaptive or compensatory changes can impair the excitation-inhibition balance towards the BG output nuclei, leading to the emergence of pathological activity-connectivity patterns in PD. Pre-clinical, clinical as well as computational studies reviewed here provide an understanding of the impact of synaptic plasticity and other plasticity mechanisms on PD pathophysiology, especially PD-related network activity and connectivity, after DA loss. This review may provide further insights into the abnormal structure-function relationship within the BG contributing to the emergence of pathological states in PD. Specifically, this review is intended to provide detailed information for the development of computational network models for PD, serving as testbeds for the development and optimization of invasive and non-invasive brain stimulation techniques. Computationally derived hypotheses may accelerate the development of therapeutic stimulation techniques and potentially reduce the number of related animal experiments.

Clinical Efficacy and Dosing of Vibrotactile Coordinated Reset Stimulation in Motor and Non-motor Symptoms of Parkinson's Disease: A Study Protocol

Enhanced neuronal synchronization of the subthalamic nucleus (STN) is commonly found in PD patients and corresponds to decreased motor ability. Coordinated reset (CR) was developed to decouple synchronized states causing long lasting desynchronization of neural networks. Vibrotactile CR stimulation (vCR) was developed as non-invasive therapeutic that delivers gentle vibrations to the fingertips. A previous study has shown that vCR can desynchronize abnormal brain rhythms within the sensorimotor cortex of PD patients, corresponding to sustained motor relief after 3 months of daily treatment. To further develop vCR, we created a protocol that has two phases. Study 1, a double blinded randomized sham-controlled study, is designed to address motor and non-motor symptoms, sensorimotor integration, and potential calibration methods. Study 2 examines dosing effects of vCR using a remote study design. In Study 1, we will perform a 7-month double-blind sham-controlled study including 30 PD patients randomly placed into an active vCR or inactive (sham) vCR condition. Patients will receive stimulation for 4 h a day in 2-h blocks for 6 months followed by a 1-month pause in stimulation to assess long lasting effects. Our primary outcome measure is the Movement Disorders Society-Unified Parkinson's Disease Rating Scale (MDS-UPDRS) part III off medication after 6 months of treatment. Secondary measures include a freezing of gait (FOG) questionnaire, objective motor evaluations, sensorimotor electroencephalography (EEG) results, a vibratory temporal discrimination task (VTDT), non-motor symptom evaluations/tests such as sleep, smell, speech, quality of life measurements and Levodopa Equivalent Daily Dose (LEDD). Patients will be evaluated at baseline, 3, 6, and 7 months. In the second, unblinded study phase (Study 2), all patients will be given the option to receive active vCR stimulation at a reduced dose for an additional 6 months remotely. The remote MDS-UPDRS part III off medication will be our primary outcome measure. Secondary measures include sleep, quality of life, objective motor evaluations, FOG and LEDD. Patients will be evaluated in the same time periods as the first study. Results from this study will provide clinical efficacy of vCR and help validate our investigational vibrotactile device for the purpose of obtaining FDA clearance. Clinical Trial Registration: ClinicalTrials.gov, identifier: NCT04877015.

Long-Term Desynchronization by Coordinated Reset Stimulation in a Neural Network Model With Synaptic and Structural Plasticity

Several brain disorders are characterized by abnormal neuronal synchronization. To specifically counteract abnormal neuronal synchrony and, hence, related symptoms, coordinated reset (CR) stimulation was computationally developed. In principle, successive epochs of synchronizing and desynchronizing stimulation may reversibly move neural networks with plastic synapses back and forth between stable regimes with synchronized and desynchronized firing. Computationally derived predictions have been verified in pre-clinical and clinical studies, paving the way for novel therapies. However, as yet, computational models were not able to reproduce the clinically observed increase of desynchronizing effects of regularly administered CR stimulation intermingled by long stimulation-free epochs. We show that this clinically important phenomenon can be computationally reproduced by taking into account structural plasticity (SP), a mechanism that deletes or generates synapses in order to homeostatically adapt the firing rates of neurons to a set point-like target firing rate in the course of days to months. If we assume that CR stimulation favorably reduces the target firing rate of SP, the desynchronizing effects of CR stimulation increase after long stimulation-free epochs, in accordance with clinically observed phenomena. Our study highlights the pivotal role of stimulation- and dosing-induced modulation of homeostatic set points in therapeutic processes.

Long-Lasting Desynchronization Effects of Coordinated Reset Stimulation Improved by Random Jitters

Abnormally strong synchronized activity is related to several neurological disorders, including essential tremor, epilepsy, and Parkinson's disease. Chronic high-frequency deep brain stimulation (HF DBS) is an established treatment for advanced Parkinson's disease. To reduce the delivered integral electrical current, novel theory-based stimulation techniques such as coordinated reset (CR) stimulation directly counteract the abnormal synchronous firing by delivering phase-shifted stimuli through multiple stimulation sites. In computational studies in neuronal networks with spike-timing-dependent plasticity (STDP), it was shown that CR stimulation down-regulates synaptic weights and drives the network into an attractor of a stable desynchronized state. This led to desynchronization effects that outlasted the stimulation. Corresponding long-lasting therapeutic effects were observed in preclinical and clinical studies. Computational studies suggest that long-lasting effects of CR stimulation depend on the adjustment of the stimulation frequency to the dominant synchronous rhythm. This may limit clinical applicability as different pathological rhythms may coexist. To increase the robustness of the long-lasting effects, we study randomized versions of CR stimulation in networks of leaky integrate-and-fire neurons with STDP. Randomization is obtained by adding random jitters to the stimulation times and by shuffling the sequence of stimulation site activations. We study the corresponding long-lasting effects using analytical calculations and computer simulations. We show that random jitters increase the robustness of long-lasting effects with respect to changes of the number of stimulation sites and the stimulation frequency. In contrast, shuffling does not increase parameter robustness of long-lasting effects. Studying the relation between acute, acute after-, and long-lasting effects of stimulation, we find that both acute after- and long-lasting effects are strongly determined by the stimulation-induced synaptic reshaping, whereas acute effects solely depend on the statistics of administered stimuli. We find that the stimulation duration is another important parameter, as effective stimulation only entails long-lasting effects after a sufficient stimulation duration. Our results show that long-lasting therapeutic effects of CR stimulation with random jitters are more robust than those of regular CR stimulation. This might reduce the parameter adjustment time in future clinical trials and make CR with random jitters more suitable for treating brain disorders with abnormal synchronization in multiple frequency bands.

Adaptive Parameter Modulation of Deep Brain Stimulation Based on Improved Supervisory Algorithm

Clinically deployed deep brain stimulation (DBS) for the treatment of Parkinson's disease operates in an open loop with fixed stimulation parameters, and this may result in high energy consumption and suboptimal therapy. The objective of this manuscript is to establish, through simulation in a computational model, a closed-loop control system that can automatically adjust the stimulation parameters to recover normal activity in model neurons. Exaggerated beta band activity is recognized as a hallmark of Parkinson's disease and beta band activity in model neurons of the globus pallidus internus (GPi) was used as the feedback signal to control DBS of the GPi. Traditional proportional controller and proportional-integral controller were not effective in eliminating the error between the target level of beta power and the beta power under Parkinsonian conditions. To overcome the difficulties in tuning the controller parameters and improve tracking performance in the case of changes in the plant, a supervisory control algorithm was implemented by introducing a Radial Basis Function (RBF) network to build the inverse model of the plant. Simulation results show the successful tracking of target beta power in the presence of changes in Parkinsonian state as well as during dynamic changes in the target level of beta power. Our computational study suggests the feasibility of the RBF network-driven supervisory control algorithm for real-time modulation of DBS parameters for the treatment of Parkinson's disease.

Optimal closed-loop deep brain stimulation using multiple independently controlled contacts

Deep brain stimulation (DBS) is a well-established treatment option for a variety of neurological disorders, including Parkinson’s disease and essential tremor. The symptoms of these disorders are known to be associated with pathological synchronous neural activity in the basal ganglia and thalamus. It is hypothesised that DBS acts to desynchronise this activity, leading to an overall reduction in symptoms. Electrodes with multiple independently controllable contacts are a recent development in DBS technology which have the potential to target one or more pathological regions with greater precision, reducing side effects and potentially increasing both the efficacy and efficiency of the treatment. The increased complexity of these systems, however, motivates the need to understand the effects of DBS when applied to multiple regions or neural populations within the brain. On the basis of a theoretical model, our paper addresses the question of how to best apply DBS to multiple neural populations to maximally desynchronise brain activity. Central to this are analytical expressions, which we derive, that predict how the symptom severity should change when stimulation is applied. Using these expressions, we construct a closed-loop DBS strategy describing how stimulation should be delivered to individual contacts using the phases and amplitudes of feedback signals. We simulate our method and compare it against two others found in the literature: coordinated reset and phase-locked stimulation. We also investigate the conditions for which our strategy is expected to yield the most benefit.

In this paper we use computer models of brain tissue to derive an optimal control algorithm for a recently developed new generation of deep brain stimulation (DBS) devices. DBS is a treatment for a variety of neurological disorders including Parkinson’s disease, essential tremor, depression and pain. There is a growing amount of evidence to suggest that delivering stimulation according to feedback from patients, or closed-loop, has the potential to improve the efficacy, efficiency and side effects of the treatment. An important recent development in DBS technology are electrodes with multiple independently controllable contacts and this paper is a theoretical study into the effects of using this new technology. On the basis of a theoretical model, we devise a closed-loop strategy and address the question of how to best apply DBS across multiple contacts to maximally desynchronise neural populations. We demonstrate using numerical simulation that, for the systems we consider, our methods are more effective than two well-known alternatives, namely phase-locked stimulation and coordinated reset. We also predict that the benefits of using multiple contacts should depend strongly on the intrinsic neuronal response. The insights from this work should lead to a better understanding of how to implement and optimise closed-loop multi-contact DBS systems which in turn should lead to more effective and efficient DBS treatments.

A Computational Model of Working Memory Based on Spike-Timing-Dependent Plasticity

Working memory is closely involved in various cognitive activities, but its neural mechanism is still under exploration. The mainstream view has long been that persistent activity is the neural basis of working memory, but recent experiments have observed that activity-silent memory can also be correctly recalled. The underlying mechanism of activity-silent memory is considered to be an alternative scheme that rejects the theory of persistent activity. We propose a working memory model based on spike-timing-dependent plasticity (STDP). Different from models based on spike-rate coding, our model adopts temporal patterns of action potentials to represent information, so it can flexibly encode new memory representation. The model can work in both persistent and silent states, i.e., it is compatible with both of these seemingly conflicting neural mechanisms. We conducted a simulation experiment, and the results are similar to the real experimental results, which suggests that our model is plausible in biology.

Coordinated Reset Vibrotactile Stimulation Induces Sustained Cumulative Benefits in Parkinson's Disease

BACKGROUND

Abnormal synchronization of neuronal activity in dopaminergic circuits is related to motor impairment in Parkinson's disease (PD). Vibrotactile coordinated reset (vCR) fingertip stimulation aims to counteract excessive synchronization and induce sustained unlearning of pathologic synaptic connectivity and neuronal synchrony. Here, we report two clinical feasibility studies that examine the effect of regular and noisy vCR stimulation on PD motor symptoms. Additionally, in one clinical study (study 1), we examine cortical beta band power changes in the sensorimotor cortex. Lastly, we compare these clinical results in relation to our computational findings.

METHODS

Study 1 examines six PD patients receiving noisy vCR stimulation and their cortical beta power changes after 3 months of daily therapy. Motor evaluations and at-rest electroencephalographic (EEG) recordings were assessed off medication pre- and post-noisy vCR. Study 2 follows three patients for 6+ months, two of whom received daily regular vCR and one patient from study 1 who received daily noisy vCR. Motor evaluations were taken at baseline, and follow-up visits were done approximately every 3 months. Computationally, in a network of leaky integrate-and-fire (LIF) neurons with spike timing-dependent plasticity, we study the differences between regular and noisy vCR by using a stimulus model that reproduces experimentally observed central neuronal phase locking.

RESULTS

Clinically, in both studies, we observed significantly improved motor ability. EEG recordings observed from study 1 indicated a significant decrease in off-medication cortical sensorimotor high beta power (21-30 Hz) at rest after 3 months of daily noisy vCR therapy. Computationally, vCR and noisy vCR cause comparable parameter-robust long-lasting synaptic decoupling and neuronal desynchronization.

CONCLUSION

In these feasibility studies of eight PD patients, regular vCR and noisy vCR were well tolerated, produced no side effects, and delivered sustained cumulative improvement of motor performance, which is congruent with our computational findings. In study 1, reduction of high beta band power over the sensorimotor cortex may suggest noisy vCR is effectively modulating the beta band at the cortical level, which may play a role in improved motor ability. These encouraging therapeutic results enable us to properly plan a proof-of-concept study.

Long-Lasting Desynchronization of Plastic Neural Networks by Random Reset Stimulation

Excessive neuronal synchrony is a hallmark of neurological disorders such as epilepsy and Parkinson's disease. An established treatment for medically refractory Parkinson's disease is high-frequency (HF) deep brain stimulation (DBS). However, symptoms return shortly after cessation of HF-DBS. Recently developed decoupling stimulation approaches, such as Random Reset (RR) stimulation, specifically target pathological connections to achieve long-lasting desynchronization. During RR stimulation, a temporally and spatially randomized stimulus pattern is administered. However, spatial randomization, as presented so far, may be difficult to realize in a DBS-like setup due to insufficient spatial resolution. Motivated by recently developed segmented DBS electrodes with multiple stimulation sites, we present a RR stimulation protocol that copes with the limited spatial resolution of currently available depth electrodes for DBS. Specifically, spatial randomization is realized by delivering stimuli simultaneously to L randomly selected stimulation sites out of a total of M stimulation sites, which will be called L/M-RR stimulation. We study decoupling by L/M-RR stimulation in networks of excitatory integrate-and-fire neurons with spike-timing dependent plasticity by means of theoretical and computational analysis. We find that L/M-RR stimulation yields parameter-robust decoupling and long-lasting desynchronization. Furthermore, our theory reveals that strong high-frequency stimulation is not suitable for inducing long-lasting desynchronization effects. As a consequence, low and high frequency L/M-RR stimulation affect synaptic weights in qualitatively different ways. Our simulations confirm these predictions and show that qualitative differences between low and high frequency L/M-RR stimulation are present across a wide range of stimulation parameters, rendering stimulation with intermediate frequencies most efficient. Remarkably, we find that L/M-RR stimulation does not rely on a high spatial resolution, characterized by the density of stimulation sites in a target area, corresponding to a large M. In fact, L/M-RR stimulation with low resolution performs even better at low stimulation amplitudes. Our results provide computational evidence that L/M-RR stimulation may present a way to exploit modern segmented lead electrodes for long-lasting therapeutic effects.

Treatment Tone Spacing and Acute Effects of Acoustic Coordinated Reset Stimulation in Tinnitus Patients

Acoustic coordinated reset (aCR) therapy for tinnitus aims to desynchronize neuronal populations in the auditory cortex that exhibit pathologically increased coincident firing. The original therapeutic paradigm involves fixed spacing of four low-intensity tones centered around the frequency of a tone matching the tinnitus pitch, f _T , but it is unknown whether these tones are optimally spaced for induction of desynchronization. Computational and animal studies suggest that stimulus amplitude, and relatedly, spatial stimulation profiles, of coordinated reset pulses can have a major impact on the degree of desynchronization achievable. In this study, we transform the tone spacing of aCR into a scale that takes into account the frequency selectivity of the auditory system at each therapeutic tone's center frequency via a measure called the gap index. Higher gap indices are indicative of more loosely spaced aCR tones. The gap index was found to be a significant predictor of symptomatic improvement, with larger gap indices, i.e., more loosely spaced aCR tones, resulting in reduction of tinnitus loudness and annoyance scores in the acute stimulation setting. A notable limitation of this study is the intimate relationship of hearing impairment with the gap index. Particularly, the shape of the audiogram in the vicinity of the tinnitus frequency can have a major impact on tone spacing. However, based on our findings we suggest hypotheses-based experimental protocols that may help to disentangle the impact of hearing loss and tone spacing on clinical outcome, to assess the electrophysiologic correlates of clinical improvement, and to elucidate the effects following chronic rather than acute stimulation.

Suppressing synchronous firing of epileptiform activity by high-frequency stimulation of afferent fibers in rat hippocampus

Aims

Deep brain stimulation (DBS) is a promising technology for treating epilepsy. However, the efficacy and underlying mechanisms of the high‐frequency stimulation (HFS) utilized by DBS to suppress epilepsy remain uncertain. Previous studies have shown that HFS can desynchronize the firing of neurons. In this study, we investigated whether the desynchronization effects of HFS can suppress epileptiform events.

Methods

HFS trains with seconds of duration (short) and a minute of duration (long) were applied at the afferent fibers (ie, Schaffer collaterals) of the hippocampal CA1 region in anesthetized rats in vivo. The amplitude and the rate of population spikes (PS) appeared in the downstream of stimulation were calculated to evaluate the intensity of synchronized firing of neuronal populations between short and long HFS groups. A test of paired‐pulse depression (PPD) was used to assess the alteration of inhibitory neuronal circuits.

Results

The sustained stimulation of a 60‐s long HFS suppressed the afterdischarges that were induced by a 5‐s short HFS to impair the local inhibitions. During the sustained HFS, the mean PS amplitude reduced significantly and the burst firing decreased, while the amount of neuronal firing did not change significantly. The paired‐pulse tests showed that with a similar baseline level of small PS2/PS1 ratio indicating a strong PPD, the 5‐s HFS increased the PS2/PS1 ratio to a value that was significantly greater than the corresponding ratio during sustained HFS, indicating that the PPD impaired by a short HFS may be restored by a sustained HFS.

Conclusions

The sustained HFS can desynchronize the population firing of epileptiform activity and accelerate a recovery of inhibitions to create a balance between the excitation and the inhibition of local neuronal circuits. The study provides new clues for further understanding the mechanism of DBS and for advancing the clinical application of DBS in treating epilepsy.

Transcutaneous Afferent Patterned Stimulation Therapy Reduces Hand Tremor for One Hour in Essential Tremor Patients

Essential tremor (ET) patients often experience hand tremor that impairs daily activities. Non-invasive electrical stimulation of median and radial nerves in the wrist using a recently developed therapy called transcutaneous afferent patterned stimulation (TAPS) has been shown to provide symptomatic tremor relief in ET patients and improve patients’ ability to perform functional tasks, but the duration of tremor reduction is unknown. In this single-arm, open-label study, fifteen ET patients performed four hand tremor-specific tasks (postural hold, spiral drawing, finger-to-nose reach, and pouring) from the Fahn-Tolosa-Marin Clinical Rating Scale (FTM-CRS) prior to, during, and 0, 30, and 60 min following TAPS. At each time point, tremor severity was visually rated according to the FTM-CRS and simultaneously measured by wrist-worn accelerometers. The duration of tremor reduction was assessed using (1) improvement in the mean FTM-CRS score across all four tasks relative to baseline, and (2) reduction in accelerometer-measured tremor power relative to baseline for each task. Patients were labeled as having at least 60 min of therapeutic benefit from TAPS with respect to each specified metric if all three (i.e., 0, 30, and 60 min) post-therapy measurements were better than that metric’s baseline value. The mean FTM-CRS scores improved for at least 60 min beyond the end of TAPS for 80% (12 of 15, p = 4.6e–9) of patients. Similarly, for each assessed task, tremor power improved for at least 60 min beyond the end of TAPS for over 70% of patients. The postural hold task had the largest reduction in tremor power (median 5.9-fold peak reduction in tremor power) and had at least 60 min of improvement relative to baseline beyond the end of TAPS therapy for 73% (11 of 15, p = 9.8e–8) of patients. Clinical ratings of tremor severity were correlated to simultaneously recorded accelerometer-measured tremor power (r = 0.33–0.76 across the four tasks), suggesting tremor power is a valid, objective tremor assessment metric that can be used to track tremor symptoms outside the clinic. These results suggest TAPS can provide reductions in upper limb tremor symptoms for at least 1 h post-therapy in some patients, which may improve patients’ ability to perform tasks of daily living.

Controlling collective synchrony in oscillatory ensembles by precisely timed pulses

We present an efficient technique for control of synchrony in a globally coupled ensemble by pulsatile action. We assume that we can observe the collective oscillation and can stimulate all elements of the ensemble simultaneously. We pay special attention to the minimization of intervention into the system. The key idea is to stimulate only at the most sensitive phase. To find this phase, we implement an adaptive feedback control. Estimating the instantaneous phase of the collective mode on the fly, we achieve efficient suppression using a few pulses per oscillatory cycle. We discuss the possible relevance of the results for neuroscience, namely, for the development of advanced algorithms for deep brain stimulation, a medical technique used to treat Parkinson's disease.

Impact of number of stimulation sites on long-lasting desynchronization effects of coordinated reset stimulation

Excessive neuronal synchrony is a hallmark of several neurological disorders, e.g., Parkinson's disease. An established treatment for medically refractory Parkinson's disease is high-frequency deep brain stimulation. However, it provides only acute relief, and symptoms return shortly after cessation of stimulation. A theory-based approach called coordinated reset (CR) has shown great promise in achieving long-lasting effects. During CR stimulation, phase-shifted stimuli are delivered to multiple stimulation sites to counteract neuronal synchrony. Computational studies in plastic neuronal networks reported that synaptic weights reduce during stimulation, which may cause sustained structural changes leading to stabilized desynchronized activity even after stimulation ceases. Corresponding long-lasting effects were found in recent preclinical and clinical studies. We study long-lasting desynchronization by CR stimulation in excitatory recurrent neuronal networks of integrate-and-fire neurons with spike-timing-dependent plasticity (STDP). We focus on the impact of the stimulation frequency and the number of stimulation sites on long-lasting effects. We compare theoretical predictions to simulations of plastic neuronal networks. Our results are important regarding CR calibration for two reasons. We reveal that long-lasting effects become most pronounced when stimulation parameters are adjusted to the characteristics of STDP-rather than to neuronal frequency characteristics. This is in contrast to previous studies where the CR frequency was adjusted to the dominant neuronal rhythm. In addition, we reveal a nonlinear dependence of long-lasting effects on the number of stimulation sites and the CR frequency. Intriguingly, optimal long-lasting desynchronization does not require larger numbers of stimulation sites.

Effect of interpopulation spike-timing-dependent plasticity on synchronized rhythms in neuronal networks with inhibitory and excitatory populations

We consider a two-population network consisting of both inhibitory (I) interneurons and excitatory (E) pyramidal cells. This I-E neuronal network has adaptive dynamic I to E and E to I interpopulation synaptic strengths, governed by interpopulation spike-timing-dependent plasticity (STDP). In previous works without STDPs, fast sparsely synchronized rhythms, related to diverse cognitive functions, were found to appear in a range of noise intensity D for static synaptic strengths. Here, by varying D, we investigate the effect of interpopulation STDPs on fast sparsely synchronized rhythms that emerge in both the I- and the E-populations. Depending on values of D, long-term potentiation (LTP) and long-term depression (LTD) for population-averaged values of saturated interpopulation synaptic strengths are found to occur. Then, the degree of fast sparse synchronization varies due to effects of LTP and LTD. In a broad region of intermediate D, the degree of good synchronization (with higher synchronization degree) becomes decreased, while in a region of large D, the degree of bad synchronization (with lower synchronization degree) gets increased. Consequently, in each I- or E-population, the synchronization degree becomes nearly the same in a wide range of D (including both the intermediate and the large D regions). This kind of "equalization effect" is found to occur via cooperative interplay between the average occupation and pacing degrees of spikes (i.e., the average fraction of firing neurons and the average degree of phase coherence between spikes in each synchronized stripe of spikes in the raster plot of spikes) in fast sparsely synchronized rhythms. Finally, emergences of LTP and LTD of interpopulation synaptic strengths (leading to occurrence of equalization effect) are intensively investigated via a microscopic method based on the distributions of time delays between the pre- and the post-synaptic spike times.

Reinforcement learning for suppression of collective activity in oscillatory ensembles

We present the use of modern machine learning approaches to suppress self-sustained collective oscillations typically signaled by ensembles of degenerative neurons in the brain. The proposed hybrid model relies on two major components: an environment of oscillators and a policy-based reinforcement learning block. We report a model-agnostic synchrony control based on proximal policy optimization and two artificial neural networks in an Actor-Critic configuration. A class of physically meaningful reward functions enabling the suppression of collective oscillatory mode is proposed. The synchrony suppression is demonstrated for two models of neuronal populations-for the ensembles of globally coupled limit-cycle Bonhoeffer-van der Pol oscillators and for the bursting Hindmarsh-Rose neurons using rectangular and charge-balanced stimuli.

Modeling the effects of sinusoidal stimulation and synaptic plasticity on linked neural oscillators

The brain exhibits intrinsic oscillatory behavior, which plays a vital role in communication and information processing. Abnormalities in brain rhythms have been linked to numerous disorders, including depression and schizophrenia. Rhythmic electrical stimulation (e.g., transcranial magnetic stimulation and transcranial alternating current stimulation) has been used to modulate these oscillations and produce lasting changes in neural activity. In this computational study, we investigate the combined effects of sinusoidal stimulation and synaptic plasticity on model networks comprised of simple, tunable four-neuron oscillators. While not intended to model a specific brain circuit, this idealization was created to provide some intuition on how electrical modulation can induce plastic changes in the oscillatory state. Linked pairs of oscillators were stimulated with sinusoidal current, and their behavior was measured as a function of their intrinsic frequencies, inter-oscillator synaptic strengths, and stimulus strength and frequency. Under certain stimulus conditions, sinusoidal current can disrupt the network's natural firing patterns. Synaptic plasticity can induce weight imbalances that permanently change the characteristic firing behavior of the network. Grids of 100 oscillators with random frequencies were also subjected to a wide array of stimulus conditions. The characteristics of the post-stimulus network activity depend heavily on the stimulus frequency and amplitude as well as the initial strength of inter-oscillator connections. Synchronization arises at the network level from complex patterns of activity propagation, which are enhanced or disrupted by different stimuli. The findings may prove important to the design of novel neuromodulation treatments and techniques seeking to affect oscillatory activity in the brain.

A review of computational modeling and deep brain stimulation: applications to Parkinson's disease

Biophysical computational models are complementary to experiments and theories, providing powerful tools for the study of neurological diseases. The focus of this review is the dynamic modeling and control strategies of Parkinson's disease (PD). In previous studies, the development of parkinsonian network dynamics modeling has made great progress. Modeling mainly focuses on the cortex-thalamus-basal ganglia (CTBG) circuit and its sub-circuits, which helps to explore the dynamic behavior of the parkinsonian network, such as synchronization. Deep brain stimulation (DBS) is an effective strategy for the treatment of PD. At present, many studies are based on the side effects of the DBS. However, the translation from modeling results to clinical disease mitigation therapy still faces huge challenges. Here, we introduce the progress of DBS improvement. Its specific purpose is to develop novel DBS treatment methods, optimize the treatment effect of DBS for each patient, and focus on the study in closed-loop DBS. Our goal is to review the inspiration and insights gained by combining the system theory with these computational models to analyze neurodynamics and optimize DBS treatment.

Understanding Parkinson's disease and deep brain stimulation: Role of monkey models

Parkinson's disease (PD) is a progressive neurodegenerative movement disorder affecting over 10 million people worldwide. In the 1930s and 1940s there was little understanding regarding what caused PD or how to treat it. In a desperate attempt to improve patients' lives different regions of the neuraxis were ablated. Morbidity and mortality were common, but some patients' motor signs improved with lesions involving the basal ganglia or thalamus. With the discovery of l-dopa the advent of medical therapy began and surgical approaches became less frequent. It soon became apparent, however, that medical therapy was associated with side effects in the form of drug-induced dyskinesia and motor fluctuations and surgical therapies reemerged. Fortunately, during this time studies in monkeys had begun to lay the groundwork to understand the functional organization of the basal ganglia, and with the discovery of the neurotoxin MPTP a monkey model of PD had been developed. Using this model scientists were characterizing the physiological changes that occurred in the basal ganglia in PD and models of basal ganglia function and dysfunction were proposed. This work provided the rationale for the return of pallidotomy, and subsequently deep brain stimulation procedures. In this paper we describe the evolution of these monkey studies, how they provided a greater understanding of the pathophysiology underlying the development of PD and provided the rationale for surgical procedures, the search to understand mechanisms of DBS, and how these studies have been instrumental in understanding PD and advancing the development of surgical therapies for its treatment.

Mechanism for explosive synchronization of neural networks

Here we investigate the mechanism for explosive synchronization (ES) of a complex neural network composed of nonidentical neurons and coupled by Newman-Watts small-world matrices. We find a range of nonlocal connection probabilities for which the network displays an abrupt transition to phase synchronization, characterizing ES. The mechanism behind the ES is the following: As the coupling parameter is varied in a network of distinct neurons, ES is likely to occur due to a bistable regime, namely a chaotic nonsynchronized and a regular phase-synchronized state in the phase space. In this case, even small coupling changes make possible a transition between them. The onset of ES occurs via a saddle-node bifurcation of a periodic orbit that leads the network dynamics to display a locally stable phase-synchronized state. The presence of this regime is accompanied by a hysteresis loop on the network dynamics as the coupling parameter is adiabatically increased and decreased. The end of the hysteresis loop is marked by a frontier crisis of the chaotic attractor which also determines the end of the coupling strength interval where ES is possible.

Acoustic coordinated reset therapy for tinnitus with perceptually relevant frequency spacing and levels

Acoustic coordinated reset (CR) therapy based on neuromodulation and neuroplasticity principles has been proposed for the treatment of tonal tinnitus. The original therapy involved periodic delivery of randomly ordered sequences of four low-level tones centered around the frequency of a tone that matched the tinnitus pitch, f_T, with fixed ratios relative to f_T and delivered several hours/day over several weeks. Here we transform the original CR tone selection method to a more perceptually-relevant equivalent rectangular bandwidth (ERB) frequency scale, the ERB_N-number scale. Specifically, we provide a mathematical model that enables calculation of CR tones that accounts for f_T- and hearing loss-related ERB widening and ERB overlaps and gaps of CR tone alignments. Further, the model ensures symmetric CR tone alignments based on modelling studies that indicate the effect is optimal if the CR stimuli are symmetrically spaced relative to the tinnitus-related population of abnormally synchronized cortical neurons to activate the adjacent sub-populations. We also present experimentally testable ERB-based CR tone alignment strategies and explain how to use the ERB-based model in experiments, clinical studies, other types of tinnitus sound treatment such as tailor-made notch music training and limitations of our approach.

Selective recruitment of cortical neurons by electrical stimulation

Despite its critical importance in experimental and clinical neuroscience, at present there is no systematic method to predict which neural elements will be activated by a given stimulation regime. Here we develop a novel approach to model the effect of cortical stimulation on spiking probability of neurons in a volume of tissue, by applying an analytical estimate of stimulation-induced activation of different cell types across cortical layers. We utilize the morphology and properties of axonal arborization profiles obtained from publicly available anatomical reconstructions of the twelve main categories of neocortical neurons to derive the dependence of activation probability on cell type, layer and distance from the source. We then propagate this activity through the local network incorporating connectivity, synaptic and cellular properties. Our work predicts that (a) intracranial cortical stimulation induces selective activation across cell types and layers; (b) superficial anodal stimulation is more effective than cathodal at cell activation; (c) cortical surface stimulation focally activates layer I axons, and (d) there is an optimal stimulation intensity capable of eliciting cell activation lasting beyond the end of stimulation. We conclude that selective effects of cortical electrical stimulation across cell types and cortical layers are largely driven by their different axonal arborization and myelination profiles.

Brain stimulation is widely used to probe the neural system to learn about its properties, to normalize dysfunction (e.g., deep brain stimulation for Parkinsonian patients), or to manipulate brain activity, including enhancing memory and learning. Despite its critical importance in experimental and clinical neuroscience, at present there are no systematic methods to predict which neural elements of the brain will be activated by a given stimulation regime. To address this question, we propose a novel theoretical framework that models the effect of cortical stimulation on the spiking probability of a neuron based on its location, type and morphology. Our study predicts that short-lived superficial electrical stimulation has the ability to trigger spiking in layer IV pyramidal cells, and to evoke network activity that could persist for hundreds of milliseconds. It further predicts a much higher spiking response to anodal stimulation compared to cathodal one, as the existence of an optimal stimulation intensity, capable of inducing a maximal response in a population of cortical cells. The results of our study can be directly taken into account in planning future electrical stimulation experiments.

Adaptive delivery of continuous and delayed feedback deep brain stimulation - a computational study

Adaptive deep brain stimulation (aDBS) is a closed-loop method, where high-frequency DBS is turned on and off according to a feedback signal, whereas conventional high-frequency DBS (cDBS) is delivered permanently. Using a computational model of subthalamic nucleus and external globus pallidus, we extend the concept of adaptive stimulation by adaptively controlling not only continuous, but also demand-controlled stimulation. Apart from aDBS and cDBS, we consider continuous pulsatile linear delayed feedback stimulation (cpLDF), specifically designed to induce desynchronization. Additionally, we combine adaptive on-off delivery with continuous delayed feedback modulation by introducing adaptive pulsatile linear delayed feedback stimulation (apLDF), where cpLDF is turned on and off using pre-defined amplitude thresholds. By varying the stimulation parameters of cDBS, aDBS, cpLDF, and apLDF we obtain optimal parameter ranges. We reveal a simple relation between the thresholds of the local field potential (LFP) for aDBS and apLDF, the extent of the stimulation-induced desynchronization, and the integral stimulation time required. We find that aDBS and apLDF can be more efficient in suppressing abnormal synchronization than continuous simulation. However, apLDF still remains more efficient and also causes a stronger reduction of the LFP beta burst length. Hence, adaptive on-off delivery may further improve the intrinsically demand-controlled pLDF.

Theoretical principles of deep brain stimulation induced synaptic suppression

BACKGROUND

Deep brain stimulation (DBS) is a successful clinical therapy for a wide range of neurological disorders; however, the physiological mechanisms of DBS remain unresolved. While many different hypotheses currently exist, our analyses suggest that high frequency (∼100 Hz) stimulation-induced synaptic suppression represents the most basic concept that can be directly reconciled with experimental recordings of spiking activity in neurons that are being driven by DBS inputs.

OBJECTIVE

The goal of this project was to develop a simple model system to characterize the excitatory post-synaptic currents (EPSCs) and action potential signaling generated in a neuron that is strongly connected to pre-synaptic glutamatergic inputs that are being directly activated by DBS.

METHODS

We used the Tsodyks-Markram (TM) phenomenological synapse model to represent depressing, facilitating, and pseudo-linear synapses driven by DBS over a wide range of stimulation frequencies. The EPSCs were then used as inputs to a leaky integrate-and-fire neuron model and we measured the DBS-triggered post-synaptic spiking activity.

RESULTS

Synaptic suppression was a robust feature of high frequency stimulation, independent of the synapse type. As such, the TM equations were used to define alternative DBS pulsing strategies that maximized synaptic suppression with the minimum number of stimuli.

CONCLUSIONS

Synaptic suppression provides a biophysical explanation to the intermittent, but still time-locked, post-synaptic firing characteristics commonly seen in DBS experimental recordings. Therefore, network models attempting to analyze or predict the effects of DBS on neural activity patterns should integrate synaptic suppression into their simulations.

Suppression of Phase Synchronization in Scale-Free Neural Networks Using External Pulsed Current Protocols

The synchronization of neurons is fundamental for the functioning of the brain since its lack or excess may be related to neurological disorders, such as autism, Parkinson’s and neuropathies such as epilepsy. In this way, the study of synchronization, as well as its suppression in coupled neurons systems, consists of an important multidisciplinary research field where there are still questions to be answered. Here, through mathematical modeling and numerical approach, we simulated a neural network composed of 5000 bursting neurons in a scale-free connection scheme where non-trivial synchronization phenomenon is observed. We proposed two different protocols to the suppression of phase synchronization, which is related to deep brain stimulation and delayed feedback control. Through an optimization process, it is possible to suppression the abnormal synchronization in the neural network.

Dual-Site Transcranial Magnetic Stimulation for the Treatment of Parkinson's Disease

Abnormal oscillatory activity in the subthalamic nucleus (STN) may be relevant for motor symptoms in Parkinson's disease (PD). Apart from deep brain stimulation, transcranial magnetic stimulation (TMS) may be suitable for altering these oscillations. We speculated that TMS to different cortical areas (primary motor cortex, M1, and dorsal premotor cortex, PMd) may activate neuronal subpopulations within the STN via corticofugal neurons projecting directly to the nucleus. We hypothesized that PD symptoms can be ameliorated by a lasting decoupling of STN neurons by associative dual-site repetitive TMS (rTMS). Associative dual-site rTMS (1 Hz) directed to PMd and M1 ("ADS-rTMS") was employed in 20 PD patients treated in a blinded, placebo-controlled cross-over design. Results: No adverse events were noted. We found no significant improvement in clinical outcome parameters (videography of MDS-UPDRS-III, finger tapping, spectral tremor power). Variation of the premotor stimulation site did not induce beneficial effects either. A single session of ADS-rTMS was tolerated well, but did not produce a clinically meaningful benefit on Parkinsonian motor symptoms. Successful treatment using TMS targeting subcortical nuclei may require an intervention over several days or more detailed physiological information about the individual brain state and stimulation-induced subcortical effects.

What Can Computational Models Contribute to Neuroimaging Data Analytics?

Over the past years, nonlinear dynamical models have significantly contributed to the general understanding of brain activity as well as brain disorders. Appropriately validated and optimized mathematical models can be used to mechanistically explain properties of brain structure and neuronal dynamics observed from neuroimaging data. A thorough exploration of the model parameter space and hypothesis testing with the methods of nonlinear dynamical systems and statistical physics can assist in classification and prediction of brain states. On the one hand, such a detailed investigation and systematic parameter variation are hardly feasible in experiments and data analysis. On the other hand, the model-based approach can establish a link between empirically discovered phenomena and more abstract concepts of attractors, multistability, bifurcations, synchronization, noise-induced dynamics, etc. Such a mathematical description allows to compare and differentiate brain structure and dynamics in health and disease, such that model parameters and dynamical regimes may serve as additional biomarkers of brain states and behavioral modes. In this perspective paper we first provide very brief overview of the recent progress and some open problems in neuroimaging data analytics with emphasis on the resting state brain activity. We then focus on a few recent contributions of mathematical modeling to our understanding of the brain dynamics and model-based approaches in medicine. Finally, we discuss the question stated in the title. We conclude that incorporating computational models in neuroimaging data analytics as well as in translational medicine could significantly contribute to the progress in these fields.

Dendritic and Axonal Propagation Delays May Shape Neuronal Networks With Plastic Synapses

Biological neuronal networks are highly adaptive and plastic. For instance, spike-timing-dependent plasticity (STDP) is a core mechanism which adapts the synaptic strengths based on the relative timing of pre- and postsynaptic spikes. In various fields of physiology, time delays cause a plethora of biologically relevant dynamical phenomena. However, time delays increase the complexity of model systems together with the computational and theoretical analysis burden. Accordingly, in computational neuronal network studies propagation delays were often neglected. As a downside, a classic STDP rule in oscillatory neurons without propagation delays is unable to give rise to bidirectional synaptic couplings, i.e., loops or uncoupled states. This is at variance with basic experimental results. In this mini review, we focus on recent theoretical studies focusing on how things change in the presence of propagation delays. Realistic propagation delays may lead to the emergence of neuronal activity and synaptic connectivity patterns, which cannot be captured by classic STDP models. In fact, propagation delays determine the inventory of attractor states and shape their basins of attractions. The results reviewed here enable to overcome fundamental discrepancies between theory and experiments. Furthermore, these findings are relevant for the development of therapeutic brain stimulation techniques aiming at shifting the diseased brain to more favorable attractor states.

Describing dynamics of driven multistable oscillators with phase transfer curves

Phase response curve is an important tool in the studies of stable self-sustained oscillations; it describes a phase shift under action of an external perturbation. We consider multistable oscillators with several stable limit cycles. Under a perturbation, transitions from one oscillating mode to another one may occur. We define phase transfer curves to describe the phase shifts at such transitions. This allows for a construction of one-dimensional maps that characterize periodically kicked multistable oscillators. We show that these maps are good approximations of the full dynamics for large periods of forcing.

Propagation delays determine neuronal activity and synaptic connectivity patterns emerging in plastic neuronal networks

In plastic neuronal networks, the synaptic strengths are adapted to the neuronal activity. Specifically, spike-timing-dependent plasticity (STDP) is a fundamental mechanism that modifies the synaptic strengths based on the relative timing of pre- and postsynaptic spikes, taking into account the spikes' temporal order. In many studies, propagation delays were neglected to avoid additional dynamic complexity or computational costs. So far, networks equipped with a classic STDP rule typically rule out bidirectional couplings (i.e., either loops or uncoupled states) and are, hence, not able to reproduce fundamental experimental findings. In this review paper, we consider additional features, e.g., extensions of the classic STDP rule or additional aspects like noise, in order to overcome the contradictions between theory and experiment. In addition, we review in detail recent studies showing that a classic STDP rule combined with realistic propagation patterns is able to capture relevant experimental findings. In two coupled oscillatory neurons with propagation delays, bidirectional synapses can be preserved and potentiated. This result also holds for large networks of type-II phase oscillators. In addition, not only the mean of the initial distribution of synaptic weights, but also its standard deviation crucially determines the emergent structural connectivity, i.e., the mean final synaptic weight, the number of two-neuron loops, and the symmetry of the final connectivity pattern. The latter is affected by the firing rates, where more symmetric synaptic configurations emerge at higher firing rates. Finally, we discuss these findings in the context of the computational neuroscience-based development of desynchronizing brain stimulation techniques.

Burst synchronization in a scale-free neuronal network with inhibitory spike-timing-dependent plasticity

We are concerned about burst synchronization (BS), related to neural information processes in health and disease, in the Barabási-Albert scale-free network (SFN) composed of inhibitory bursting Hindmarsh-Rose neurons. This inhibitory neuronal population has adaptive dynamic synaptic strengths governed by the inhibitory spike-timing-dependent plasticity (iSTDP). In previous works without considering iSTDP, BS was found to appear in a range of noise intensities for fixed synaptic inhibition strengths. In contrast, in our present work, we take into consideration iSTDP and investigate its effect on BS by varying the noise intensity. Our new main result is to find occurrence of a Matthew effect in inhibitory synaptic plasticity: good BS gets better via LTD, while bad BS get worse via LTP. This kind of Matthew effect in inhibitory synaptic plasticity is in contrast to that in excitatory synaptic plasticity where good (bad) synchronization gets better (worse) via LTP (LTD). We note that, due to inhibition, the roles of LTD and LTP in inhibitory synaptic plasticity are reversed in comparison with those in excitatory synaptic plasticity. Moreover, emergences of LTD and LTP of synaptic inhibition strengths are intensively investigated via a microscopic method based on the distributions of time delays between the pre- and the post-synaptic burst onset times. Finally, in the presence of iSTDP we investigate the effects of network architecture on BS by varying the symmetric attachment degree l ∗ and the asymmetry parameter Δ l in the SFN.

Temporal Pattern of Electrical Stimulation is a New Dimension of Therapeutic Innovation

Artificial activation of the nervous system requires selection of appropriate stimulation parameters including stimulation amplitude, stimulation pulse duration, and stimulation pulse repetition rate. The temporal pattern of stimulation, i.e., the timing between stimulation pulses, is a novel dimension of stimulation parameter tuning. The effects evoked by artificial activation of the nervous system are dependent on the pattern of stimulation, and different patterns of stimulation, even when delivered at the same average rate, evoke different functional effects, different changes in synaptic plasticity, and even different patterns of gene expression. Non-regular temporal patterns of stimulation offer the opportunity to improve the efficacy and efficiency of therapeutic stimulation as well as to manipulate other processes in the nervous system. The potential design space for sequences of varying interpulse intervals is exceedingly large and sound approaches to design stimulation patterns are required as an empirical approach is not practical.

Delay-Induced Multistability and Loop Formation in Neuronal Networks with Spike-Timing-Dependent Plasticity

Spike-timing-dependent plasticity (STDP) adjusts synaptic strengths according to the precise timing of pre- and postsynaptic spike pairs. Theoretical and computational studies have revealed that STDP may contribute to the emergence of a variety of structural and dynamical states in plastic neuronal populations. In this manuscript, we show that by incorporating dendritic and axonal propagation delays in recurrent networks of oscillatory neurons, the asymptotic connectivity displays multistability, where different structures emerge depending on the initial distribution of the synaptic strengths. In particular, we show that the standard deviation of the initial distribution of synaptic weights, besides its mean, determines the main properties of the emergent structural connectivity such as the mean final synaptic weight, the number of two-neuron loops and the symmetry of the final structure. We also show that the firing rates of the neurons affect the evolution of the network, and a more symmetric configuration of the synapses emerges at higher firing rates. We justify the network results based on a two-neuron framework and show how the results translate to large recurrent networks.

Effect of inhibitory spike-timing-dependent plasticity on fast sparsely synchronized rhythms in a small-world neuronal network

We consider the Watts-Strogatz small-world network (SWN) consisting of inhibitory fast spiking Izhikevich interneurons. This inhibitory neuronal population has adaptive dynamic synaptic strengths governed by the inhibitory spike-timing-dependent plasticity (iSTDP). In previous works without iSTDP, fast sparsely synchronized rhythms, associated with diverse cognitive functions, were found to appear in a range of large noise intensities for fixed strong synaptic inhibition strengths. Here, we investigate the effect of iSTDP on fast sparse synchronization (FSS) by varying the noise intensity D. We employ an asymmetric anti-Hebbian time window for the iSTDP update rule [which is in contrast to the Hebbian time window for the excitatory STDP (eSTDP)]. Depending on values of D, population-averaged values of saturated synaptic inhibition strengths are potentiated [long-term potentiation (LTP)] or depressed [long-term depression (LTD)] in comparison with the initial mean value, and dispersions from the mean values of LTP/LTD are much increased when compared with the initial dispersion, independently of D. In most cases of LTD where the effect of mean LTD is dominant in comparison with the effect of dispersion, good synchronization (with higher spiking measure) is found to get better via LTD, while bad synchronization (with lower spiking measure) is found to get worse via LTP. This kind of Matthew effect in inhibitory synaptic plasticity is in contrast to that in excitatory synaptic plasticity where good (bad) synchronization gets better (worse) via LTP (LTD). Emergences of LTD and LTP of synaptic inhibition strengths are intensively investigated via a microscopic method based on the distributions of time delays between the pre- and the post-synaptic spike times. Furthermore, we also investigate the effects of network architecture on FSS by changing the rewiring probability p of the SWN in the presence of iSTDP.