Self-organized dynamics in plastic neural networks: bistability and coherence

Spike timing-dependent plasticity induces non-trivial topology in the brain

We study the capacity of Hodgkin-Huxley neuron in a network to change temporarily or permanently their connections and behavior, the so called spike timing-dependent plasticity (STDP), as a function of their synchronous behavior. We consider STDP of excitatory and inhibitory synapses driven by Hebbian rules. We show that the final state of networks evolved by a STDP depend on the initial network configuration. Specifically, an initial all-to-all topology evolves to a complex topology. Moreover, external perturbations can induce co-existence of clusters, those whose neurons are synchronous and those whose neurons are desynchronous. This work reveals that STDP based on Hebbian rules leads to a change in the direction of the synapses between high and low frequency neurons, and therefore, Hebbian learning can be explained in terms of preferential attachment between these two diverse communities of neurons, those with low-frequency spiking neurons, and those with higher-frequency spiking neurons.

Control of abnormal synchronization in neurological disorders

In the nervous system, synchronization processes play an important role, e.g., in the context of information processing and motor control. However, pathological, excessive synchronization may strongly impair brain function and is a hallmark of several neurological disorders. This focused review addresses the question of how an abnormal neuronal synchronization can specifically be counteracted by invasive and non-invasive brain stimulation as, for instance, by deep brain stimulation for the treatment of Parkinson’s disease, or by acoustic stimulation for the treatment of tinnitus. On the example of coordinated reset (CR) neuromodulation, we illustrate how insights into the dynamics of complex systems contribute to successful model-based approaches, which use methods from synergetics, non-linear dynamics, and statistical physics, for the development of novel therapies for normalization of brain function and synaptic connectivity. Based on the intrinsic multistability of the neuronal populations induced by spike timing-dependent plasticity (STDP), CR neuromodulation utilizes the mutual interdependence between synaptic connectivity and dynamics of the neuronal networks in order to restore more physiological patterns of connectivity via desynchronization of neuronal activity. The very goal is to shift the neuronal population by stimulation from an abnormally coupled and synchronized state to a desynchronized regime with normalized synaptic connectivity, which significantly outlasts the stimulation cessation, so that long-lasting therapeutic effects can be achieved.

MULTIPLE OSCILLATORY STATES IN MODELS OF COLLECTIVE NEURONAL DYNAMICS

In our previous studies, we showed that the both realistic and analytical computational models of neural dynamics can display multiple sustained states (attractors) for the same values of model parameters. Some of these states can represent normal activity while other, of oscillatory nature, may represent epileptic types of activity. We also showed that a simplified, analytical model can mimic this type of behavior and can be used instead of the realistic model for large scale simulations. The primary objective of the present work is to further explore the phenomenon of multiple stable states, co-existing in the same operational model, or phase space, in systems consisting of large number of interconnected basic units. As a second goal, we aim to specify the optimal method for state control of the system based on inducing state transitions using appropriate external stimulus. We use here interconnected model units that represent the behavior of neuronal populations as an effective dynamic system. The model unit is an analytical model (S. Kalitzin et al., Epilepsy Behav. 22 (2011) S102–S109) and does not correspond directly to realistic neuronal processes (excitatory–inhibitory synaptic interactions, action potential generation). For certain parameter choices however it displays bistable dynamics imitating the behavior of realistic neural mass models. To analyze the collective behavior of the system we applied phase synchronization analysis (PSA), principal component analysis (PCA) and stability analysis using Lyapunov exponent (LE) estimation. We obtained a large variety of stable states with different dynamic characteristics, oscillatory modes and phase relations between the units. These states can be initiated by appropriate initial conditions; transitions between them can be induced stochastically by fluctuating variables (noise) or by specific inputs. We propose a method for optimal reactive control, allowing forced transitions from one state (attractor) into another.

Cingulate seizure-like activity reveals neuronal avalanche regulated by network excitability and thalamic inputs

BACKGROUND

Cortical neurons display network-level dynamics with unique spatiotemporal patterns that construct the backbone of processing information signals and contribute to higher functions. Recent years have seen a wealth of research on the characteristics of neuronal networks that are sufficient conditions to activate or cease network functions. Local field potentials (LFPs) exhibit a scale-free and unique event size distribution (i.e., a neuronal avalanche) that has been proven in the cortex across species, including mice, rats, and humans, and may be used as an index of cortical excitability. In the present study, we induced seizure activity in the anterior cingulate cortex (ACC) with medial thalamic inputs and evaluated the impact of cortical excitability and thalamic inputs on network-level dynamics. We measured LFPs from multi-electrode recordings in mouse cortical slices and isoflurane-anesthetized rats.

RESULTS

The ACC activity exhibited a neuronal avalanche with regard to avalanche size distribution, and the slope of the power-law distribution of the neuronal avalanche reflected network excitability in vitro and in vivo. We found that the slope of the neuronal avalanche in seizure-like activity significantly correlated with cortical excitability induced by γ-aminobutyric acid system manipulation. The thalamic inputs desynchronized cingulate seizures and affected the level of cortical excitability, the modulation of which could be determined by the slope of the avalanche size.

CONCLUSIONS

We propose that the neuronal avalanche may be a tool for analyzing cortical activity through LFPs to determine alterations in network dynamics.

REACTIVE CONTROL OF EPILEPTIFORM DISCHARGES IN REALISTIC COMPUTATIONAL NEURONAL MODELS WITH BISTABILITY

We aim to derive fully autonomous seizure suppression paradigms based on reactive control of neuronal dynamics. A previously derived computational model of seizure generation describing collective degrees of freedom and featuring bistable dynamics is used. A novel technique for real-time control of epileptogenicity is introduced. The reactive control reduces practically all seizures in the model. The study indicates which parameters provide the maximal seizure reduction with minimal intervention. An adaptive scheme is proposed that optimizes the stimulation parameters in nonstationary situations.

CONTROLLING SYNCHRONIZATION IN A NEURON-LEVEL POPULATION MODEL

We have studied coupled neural populations in an effort to understand basic mechanisms that maintain their normal synchronization level despite changes in the inter-population coupling levels. Towards this goal, we have incorporated coupling and internal feedback structures in a neuron-level population model from the literature. We study two forms of internal feedback — regulation of excitation, and compensation of excessive excitation with inhibition. We show that normal feedback actions quickly regulate/compensate an abnormally high coupling between the neural populations, whereas a pathology in these feedback actions can lead to abnormal synchronization and "seizure"-like high amplitude oscillations. We then develop an external control paradigm, termed feedback decoupling, as a robust synchronization control strategy. The external feedback decoupling controller acts to achieve the operational objective of maintaining normal-level synchronous behavior irrespective of the pathology in the internal feedback mechanisms. Results from such an analysis have an interesting physical interpretation and specific implications for the treatment of diseases such as epilepsy. The proposed remedy is consistent with a variety of recent observations in the human and animal epileptic brain, and with theories from nonlinear systems, adaptive systems, optimization, and neurophysiology.

Stimulation-based anticipation and control of state transitions in the epileptic brain

We focus on the implications that the underlying neuronal dynamics might have on the possibility of anticipating seizures and designing an effective paradigm for their control. Transitions into seizures can be caused by parameter changes in the dynamic state or by interstate transitions as occur in multi-attractor systems; in the latter case, only a weak statistical prognosis of the seizure risk can be achieved. Nevertheless, we claim that by applying a suitable perturbation to the system, such as electrical stimulation, relevant features of the system's state may be detected and the risk of an impending seizure estimated. Furthermore, if these features are detected early, transitions into seizures may be blocked. On the basis of generic and realistic computer models we explore the concept of acute seizure control through state-dependent feedback stimulation. We show that in some classes of dynamic transitions, this can be achieved with a relatively limited amount of stimulation.

State-dependent computation using coupled recurrent networks

Although conditional branching between possible behavioral states is a hallmark of intelligent behavior, very little is known about the neuronal mechanisms that support this processing. In a step toward solving this problem, we demonstrate by theoretical analysis and simulation how networks of richly interconnected neurons, such as those observed in the superficial layers of the neocortex, can embed reliable, robust finite state machines. We show how a multistable neuronal network containing a number of states can be created very simply by coupling two recurrent networks whose synaptic weights have been configured for soft winner-take-all (sWTA) performance. These two sWTAs have simple, homogeneous, locally recurrent connectivity except for a small fraction of recurrent cross-connections between them, which are used to embed the required states. This coupling between the maps allows the network to continue to express the current state even after the input that elicited that state is withdrawn. In addition, a small number of transition neurons implement the necessary input-driven transitions between the embedded states. We provide simple rules to systematically design and construct neuronal state machines of this kind. The significance of our finding is that it offers a method whereby the cortex could construct networks supporting a broad range of sophisticated processing by applying only small specializations to the same generic neuronal circuit.

Simple spontaneously active Hebbian learning model: homeostasis of activity and connectivity, and consequences for learning and epileptogenesis

A spontaneously active neural system that is capable of continual learning should also be capable of homeostasis of both firing rate and connectivity. Experimental evidence suggests that both types of homeostasis exist, and that connectivity is maintained at a state that is optimal for information transmission and storage. This state is referred to as the critical state. We present a simple stochastic computational Hebbian learning model that incorporates both firing rate and critical homeostasis, and we explore its stability and connectivity properties. We also examine the behavior of our model with a simulated seizure and with simulated acute deafferentation. We argue that a neural system that is more highly connected than the critical state (i.e., one that is "supercritical") is epileptogenic. Based on our simulations, we predict that the postseizural and postdeafferentation states should be supercritical and epileptogenic. Furthermore, interventions that boost spontaneous activity should be protective against epileptogenesis.

A model of late long-term potentiation simulates aspects of memory maintenance

Late long-term potentiation (L-LTP) denotes long-lasting strengthening of synapses between neurons. L-LTP appears essential for the formation of long-term memory, with memories at least partly encoded by patterns of strengthened synapses. How memories are preserved for months or years, despite molecular turnover, is not well understood. Ongoing recurrent neuronal activity, during memory recall or during sleep, has been hypothesized to preferentially potentiate strong synapses, preserving memories. This hypothesis has not been evaluated in the context of a mathematical model representing ongoing activity and biochemical pathways important for L-LTP. In this study, ongoing activity was incorporated into two such models – a reduced model that represents some of the essential biochemical processes, and a more detailed published model. The reduced model represents synaptic tagging and gene induction simply and intuitively, and the detailed model adds activation of essential kinases by Ca²⁺. Ongoing activity was modeled as continual brief elevations of Ca²⁺. In each model, two stable states of synaptic strength/weight resulted. Positive feedback between synaptic weight and the amplitude of ongoing Ca²⁺ transients underlies this bistability. A tetanic or theta-burst stimulus switches a model synapse from a low basal weight to a high weight that is stabilized by ongoing activity. Bistability was robust to parameter variations in both models. Simulations illustrated that prolonged periods of decreased activity reset synaptic strengths to low values, suggesting a plausible forgetting mechanism. However, episodic activity with shorter inactive intervals maintained strong synapses. Both models support experimental predictions. Tests of these predictions are expected to further understanding of how neuronal activity is coupled to maintenance of synaptic strength. Further investigations that examine the dynamics of activity and synaptic maintenance can be expected to help in understanding how memories are preserved for up to a lifetime in animals including humans.

Charting epilepsy by searching for intelligence in network space with the help of evolving autonomous agents

The problem of demarcating neural network space is formidable. A simple fully connected recurrent network of five units (binary activations, synaptic weight resolution of 10) has 3.2 *10(26) possible initial states. The problem increases drastically with scaling. Here we consider three complementary approaches to help direct the exploration to distinguish epileptic from healthy networks. [1] First, we perform a gross mapping of the space of five-unit continuous recurrent networks using randomized weights and initial activations. The majority of weight patterns (>70%) were found to result in neural assemblies exhibiting periodic limit-cycle oscillatory behavior. [2] Next we examine the activation space of non-periodic networks demonstrating that the emergence of paroxysmal activity does not require changes in connectivity. [3] The next challenge is to focus the search of network space to identify networks with more complex dynamics. Here we rely on a major available indicator critical to clinical assessment but largely ignored by epilepsy modelers, namely: behavioral states. To this end, we connected the above network layout to an external robot in which interactive states were evolved. The first random generation showed a distribution in line with approach [1]. That is, the predominate phenotypes were fixed-point or oscillatory with seizure-like motor output. As evolution progressed the profile changed markedly. Within 20 generations the entire population was able to navigate a simple environment with all individuals exhibiting multiply-stable behaviors with no cases of default locked limit-cycle oscillatory motor behavior. The resultant population may thus afford us a view of the architectural principles demarcating healthy biological networks from the pathological. The approach has an advantage over other epilepsy modeling techniques in providing a way to clarify whether observed dynamics or suggested therapies are pointing to computational viability or dead space.