Enhancing neural-network performance via assortativity

Synaptic reorganization of synchronized neuronal networks with synaptic weight and structural plasticity

Abnormally strong neural synchronization may impair brain function, as observed in several brain disorders. We computationally study how neuronal dynamics, synaptic weights, and network structure co-emerge, in particular, during (de)synchronization processes and how they are affected by external perturbation. To investigate the impact of different types of plasticity mechanisms, we combine a network of excitatory integrate-and-fire neurons with different synaptic weight and/or structural plasticity mechanisms: (i) only spike-timing-dependent plasticity (STDP), (ii) only homeostatic structural plasticity (hSP), i.e., without weight-dependent pruning and without STDP, (iii) a combination of STDP and hSP, i.e., without weight-dependent pruning, and (iv) a combination of STDP and structural plasticity (SP) that includes hSP and weight-dependent pruning. To accommodate the diverse time scales of neuronal firing, STDP, and SP, we introduce a simple stochastic SP model, enabling detailed numerical analyses. With tools from network theory, we reveal that structural reorganization may remarkably enhance the network's level of synchrony. When weaker contacts are preferentially eliminated by weight-dependent pruning, synchrony is achieved with significantly sparser connections than in randomly structured networks in the STDP-only model. In particular, the strengthening of contacts from neurons with higher natural firing rates to those with lower rates and the weakening of contacts in the opposite direction, followed by selective removal of weak contacts, allows for strong synchrony with fewer connections. This activity-led network reorganization results in the emergence of degree-frequency, degree-degree correlations, and a mixture of degree assortativity. We compare the stimulation-induced desynchronization of synchronized states in the STDP-only model (i) with the desynchronization of models (iii) and (iv). The latter require stimuli of significantly higher intensity to achieve long-term desynchronization. These findings may inform future pre-clinical and clinical studies with invasive or non-invasive stimulus modalities aiming at inducing long-lasting relief of symptoms, e.g., in Parkinson's disease.

Selecting Graph Metrics with Ecological Significance for Deepening Landscape Characterization: Review and Applications

The usual approaches to describing and understanding ecological processes in a landscape use patch-mosaic models based on traditional landscape metrics. However, they do not consider that many of these processes cannot be observed without considering the multiple interactions between different land-use patches in the landscape. The objective of this research was to provide a synthetic overview of graph metrics that characterize landscapes based on patch-mosaic models and to analyze the ecological meaning of the metrics to propose a relevant selection explaining biodiversity patterns and ecological processes. First, we conducted a literature review of graph metrics applied in ecology. Second, a case study was used to explore the behavior of a group of selected graph metrics in actual differentiated landscapes located in a long-term socioecological research site in Brittany, France. Thirteen landscape-scale metrics and 10 local-scale metrics with ecological significance were analyzed. Metrics were grouped for landscape-scale and local-scale analysis. Many of the metrics were able to identify differences between the landscapes studied. Lastly, we discuss how graph metrics offer a new perspective for landscape analysis, describe the main characteristics related to their calculation and the type of information provided, and discuss their potential applications in different ecological contexts.

Mechanisms of distributed working memory in a large-scale network of macaque neocortex

Neural activity underlying working memory is not a local phenomenon but distributed across multiple brain regions. To elucidate the circuit mechanism of such distributed activity, we developed an anatomically constrained computational model of large-scale macaque cortex. We found that mnemonic internal states may emerge from inter-areal reverberation, even in a regime where none of the isolated areas is capable of generating self-sustained activity. The mnemonic activity pattern along the cortical hierarchy indicates a transition in space, separating areas engaged in working memory and those which do not. A host of spatially distinct attractor states is found, potentially subserving various internal processes. The model yields testable predictions, including the idea of counterstream inhibitory bias, the role of prefrontal areas in controlling distributed attractors, and the resilience of distributed activity to lesions or inactivation. This work provides a theoretical framework for identifying large-scale brain mechanisms and computational principles of distributed cognitive processes.

Effects of degree distributions in random networks of type-I neurons

We consider large networks of theta neurons and use the Ott-Antonsen ansatz to derive degree-based mean-field equations governing the expected dynamics of the networks. Assuming random connectivity, we investigate the effects of varying the widths of the in- and out-degree distributions on the dynamics of excitatory or inhibitory synaptically coupled networks and gap junction coupled networks. For synaptically coupled networks, the dynamics are independent of the out-degree distribution. Broadening the in-degree distribution destroys oscillations in inhibitory networks and decreases the range of bistability in excitatory networks. For gap junction coupled neurons, broadening the degree distribution varies the values of parameters at which there is an onset of collective oscillations. Many of the results are shown to also occur in networks of more realistic neurons.

Assortativity-induced explosive synchronization in a complex neuronal network

In this study, we consider a scale-free network of nonidentical Chialvo neurons, coupled through electrical synapses. For sufficiently strong coupling, the system undergoes a transition from completely out of phase synchronized to phase synchronized state. The principal focus of this study is to investigate the effect of the degree of assortativity over the synchronization transition process. It is observed that, depending on assortativity, bistability between two asymptotically stable states allows one to develop a hysteresis loop which transforms the phase transition from second order to first order. An expansion in the area of hysteresis loop is noticeable with increasing degree-degree correlation in the network. Our study also reveals that effective frequencies of nodes simultaneously go through a continuous or sudden transition to the synchronized state with the corresponding phases. Further, we examine the robustness of the results under the effect of network size and average degree, as well as diverse frequency setup. Finally, we investigate the dynamical mechanism in the process of generating explosive synchronization. We observe a significant impact of lower degree nodes behind such phenomena: in a positive assortative network the low degree nodes delay the synchronization transition.

Dynamics of Structured Networks of Winfree Oscillators

Winfree oscillators are phase oscillator models of neurons, characterized by their phase response curve and pulsatile interaction function. We use the Ott/Antonsen ansatz to study large heterogeneous networks of Winfree oscillators, deriving low-dimensional differential equations which describe the evolution of the expected state of networks of oscillators. We consider the effects of correlations between an oscillator's in-degree and out-degree, and between the in- and out-degrees of an “upstream” and a “downstream” oscillator (degree assortativity). We also consider correlated heterogeneity, where some property of an oscillator is correlated with a structural property such as degree. We finally consider networks with parameter assortativity, coupling oscillators according to their intrinsic frequencies. The results show how different types of network structure influence its overall dynamics.

Assortative mixing in spatially-extended networks

We focus on spatially-extended networks during their transition from short-range connectivities to a scale-free structure expressed by heavy-tailed degree-distribution. In particular, a model is introduced for the generation of such graphs, which combines spatial growth and preferential attachment. In this model the transition to heterogeneous structures is always accompanied by a change in the graph's degree-degree correlation properties: while high assortativity levels characterize the dominance of short distance couplings, long-range connectivity structures are associated with small amounts of disassortativity. Our results allow to infer that a disassortative mixing is essential for establishing long-range links. We discuss also how our findings are consistent with recent experimental studies of 2-dimensional neuronal cultures.

Concurrence of form and function in developing networks and its role in synaptic pruning

A fundamental question in neuroscience is how structure and function of neural systems are related. We study this interplay by combining a familiar auto-associative neural network with an evolving mechanism for the birth and death of synapses. A feedback loop then arises leading to two qualitatively different types of behaviour. In one, the network structure becomes heterogeneous and dissasortative, and the system displays good memory performance; furthermore, the structure is optimised for the particular memory patterns stored during the process. In the other, the structure remains homogeneous and incapable of pattern retrieval. These findings provide an inspiring picture of brain structure and dynamics that is compatible with experimental results on early brain development, and may help to explain synaptic pruning. Other evolving networks—such as those of protein interactions—might share the basic ingredients for this feedback loop and other questions, and indeed many of their structural features are as predicted by our model.

How structure and function coevolve in developing brains is little understood. Here, the authors study a coupled model of network development and memory, and find that due to the feedback networks with some initial memory capacity evolve into heterogeneous structures with high memory performance.

Anti-correlations in the degree distribution increase stimulus detection performance in noisy spiking neural networks

Neuronal circuits in the rodent barrel cortex are characterized by stable low firing rates. However, recent experiments show that short spike trains elicited by electrical stimulation in single neurons can induce behavioral responses. Hence, the underlying neural networks provide stability against internal fluctuations in the firing rate, while simultaneously making the circuits sensitive to small external perturbations. Here we studied whether stability and sensitivity are affected by the connectivity structure in recurrently connected spiking networks. We found that anti-correlation between the number of afferent (in-degree) and efferent (out-degree) synaptic connections of neurons increases stability against pathological bursting, relative to networks where the degrees were either positively correlated or uncorrelated. In the stable network state, stimulation of a few cells could lead to a detectable change in the firing rate. To quantify the ability of networks to detect the stimulation, we used a receiver operating characteristic (ROC) analysis. For a given level of background noise, networks with anti-correlated degrees displayed the lowest false positive rates, and consequently had the highest stimulus detection performance. We propose that anti-correlation in the degree distribution may be a computational strategy employed by sensory cortices to increase the detectability of external stimuli. We show that networks with anti-correlated degrees can in principle be formed by applying learning rules comprised of a combination of spike-timing dependent plasticity, homeostatic plasticity and pruning to networks with uncorrelated degrees. To test our prediction we suggest a novel experimental method to estimate correlations in the degree distribution.

From neurons to epidemics: How trophic coherence affects spreading processes

Trophic coherence, a measure of the extent to which the nodes of a directed network are organised in levels, has recently been shown to be closely related to many structural and dynamical aspects of complex systems, including graph eigenspectra, the prevalence or absence of feedback cycles, and linear stability. Furthermore, non-trivial trophic structures have been observed in networks of neurons, species, genes, metabolites, cellular signalling, concatenated words, P2P users, and world trade. Here, we consider two simple yet apparently quite different dynamical models-one a susceptible-infected-susceptible epidemic model adapted to include complex contagion and the other an Amari-Hopfield neural network-and show that in both cases the related spreading processes are modulated in similar ways by the trophic coherence of the underlying networks. To do this, we propose a network assembly model which can generate structures with tunable trophic coherence, limiting in either perfectly stratified networks or random graphs. We find that trophic coherence can exert a qualitative change in spreading behaviour, determining whether a pulse of activity will percolate through the entire network or remain confined to a subset of nodes, and whether such activity will quickly die out or endure indefinitely. These results could be important for our understanding of phenomena such as epidemics, rumours, shocks to ecosystems, neuronal avalanches, and many other spreading processes.

Diversity improves performance in excitable networks

As few real systems comprise indistinguishable units, diversity is a hallmark of nature. Diversity among interacting units shapes properties of collective behavior such as synchronization and information transmission. However, the benefits of diversity on information processing at the edge of a phase transition, ordinarily assumed to emerge from identical elements, remain largely unexplored. Analyzing a general model of excitable systems with heterogeneous excitability, we find that diversity can greatly enhance optimal performance (by two orders of magnitude) when distinguishing incoming inputs. Heterogeneous systems possess a subset of specialized elements whose capability greatly exceeds that of the nonspecialized elements. We also find that diversity can yield multiple percolation, with performance optimized at tricriticality. Our results are robust in specific and more realistic neuronal systems comprising a combination of excitatory and inhibitory units, and indicate that diversity-induced amplification can be harnessed by neuronal systems for evaluating stimulus intensities.

Degree Correlations Optimize Neuronal Network Sensitivity to Sub-Threshold Stimuli

Information processing in the brain crucially depends on the topology of the neuronal connections. We investigate how the topology influences the response of a population of leaky integrate-and-fire neurons to a stimulus. We devise a method to calculate firing rates from a self-consistent system of equations taking into account the degree distribution and degree correlations in the network. We show that assortative degree correlations strongly improve the sensitivity for weak stimuli and propose that such networks possess an advantage in signal processing. We moreover find that there exists an optimum in assortativity at an intermediate level leading to a maximum in input/output mutual information.

Efficient transmission of subthreshold signals in complex networks of spiking neurons

We investigate the efficient transmission and processing of weak, subthreshold signals in a realistic neural medium in the presence of different levels of the underlying noise. Assuming Hebbian weights for maximal synaptic conductances--that naturally balances the network with excitatory and inhibitory synapses--and considering short-term synaptic plasticity affecting such conductances, we found different dynamic phases in the system. This includes a memory phase where population of neurons remain synchronized, an oscillatory phase where transitions between different synchronized populations of neurons appears and an asynchronous or noisy phase. When a weak stimulus input is applied to each neuron, increasing the level of noise in the medium we found an efficient transmission of such stimuli around the transition and critical points separating different phases for well-defined different levels of stochasticity in the system. We proved that this intriguing phenomenon is quite robust, as it occurs in different situations including several types of synaptic plasticity, different type and number of stored patterns and diverse network topologies, namely, diluted networks and complex topologies such as scale-free and small-world networks. We conclude that the robustness of the phenomenon in different realistic scenarios, including spiking neurons, short-term synaptic plasticity and complex networks topologies, make very likely that it could also occur in actual neural systems as recent psycho-physical experiments suggest.

Emergence of assortative mixing between clusters of cultured neurons

The analysis of the activity of neuronal cultures is considered to be a good proxy of the functional connectivity of in vivo neuronal tissues. Thus, the functional complex network inferred from activity patterns is a promising way to unravel the interplay between structure and functionality of neuronal systems. Here, we monitor the spontaneous self-sustained dynamics in neuronal cultures formed by interconnected aggregates of neurons (clusters). Dynamics is characterized by the fast activation of groups of clusters in sequences termed bursts. The analysis of the time delays between clusters' activations within the bursts allows the reconstruction of the directed functional connectivity of the network. We propose a method to statistically infer this connectivity and analyze the resulting properties of the associated complex networks. Surprisingly enough, in contrast to what has been reported for many biological networks, the clustered neuronal cultures present assortative mixing connectivity values, meaning that there is a preference for clusters to link to other clusters that share similar functional connectivity, as well as a rich-club core, which shapes a 'connectivity backbone' in the network. These results point out that the grouping of neurons and the assortative connectivity between clusters are intrinsic survival mechanisms of the culture.

Large-scale, high-resolution multielectrode-array recording depicts functional network differences of cortical and hippocampal cultures

Understanding the detailed circuitry of functioning neuronal networks is one of the major goals of neuroscience. Recent improvements in neuronal recording techniques have made it possible to record the spiking activity from hundreds of neurons simultaneously with sub-millisecond temporal resolution. Here we used a 512-channel multielectrode array system to record the activity from hundreds of neurons in organotypic cultures of cortico-hippocampal brain slices from mice. To probe the network structure, we employed a wavelet transform of the cross-correlogram to categorize the functional connectivity in different frequency ranges. With this method we directly compare, for the first time, in any preparation, the neuronal network structures of cortex and hippocampus, on the scale of hundreds of neurons, with sub-millisecond time resolution. Among the three frequency ranges that we investigated, the lower two frequency ranges (gamma (30–80 Hz) and beta (12–30 Hz) range) showed similar network structure between cortex and hippocampus, but there were many significant differences between these structures in the high frequency range (100–1000 Hz). The high frequency networks in cortex showed short tailed degree-distributions, shorter decay length of connectivity density, smaller clustering coefficients, and positive assortativity. Our results suggest that our method can characterize frequency dependent differences of network architecture from different brain regions. Crucially, because these differences between brain regions require millisecond temporal scales to be observed and characterized, these results underscore the importance of high temporal resolution recordings for the understanding of functional networks in neuronal systems.

Stochastic resonance crossovers in complex networks

Here we numerically study the emergence of stochastic resonance as a mild phenomenon and how this transforms into an amazing enhancement of the signal-to-noise ratio at several levels of a disturbing ambient noise. The setting is a cooperative, interacting complex system modelled as an Ising-Hopfield network in which the intensity of mutual interactions or “synapses” varies with time in such a way that it accounts for, e.g., a kind of fatigue reported to occur in the cortex. This induces nonequilibrium phase transitions whose rising comes associated to various mechanisms producing two types of resonance. The model thus clarifies the details of the signal transmission and the causes of correlation among noise and signal. We also describe short-time persistent memory states, and conclude on the limited relevance of the network wiring topology. Our results, in qualitative agreement with the observation of excellent transmission of weak signals in the brain when competing with both intrinsic and external noise, are expected to be of wide validity and may have technological application. We also present here a first contact between the model behavior and psychotechnical data.

Non-normal amplification in random balanced neuronal networks

In dynamical models of cortical networks, the recurrent connectivity can amplify the input given to the network in two distinct ways. One is induced by the presence of near-critical eigenvalues in the connectivity matrix W, producing large but slow activity fluctuations along the corresponding eigenvectors (dynamical slowing). The other relies on W not being normal, which allows the network activity to make large but fast excursions along specific directions. Here we investigate the trade-off between non-normal amplification and dynamical slowing in the spontaneous activity of large random neuronal networks composed of excitatory and inhibitory neurons. We use a Schur decomposition of W to separate the two amplification mechanisms. Assuming linear stochastic dynamics, we derive an exact expression for the expected amount of purely non-normal amplification. We find that amplification is very limited if dynamical slowing must be kept weak. We conclude that, to achieve strong transient amplification with little slowing, the connectivity must be structured. We show that unidirectional connections between neurons of the same type together with reciprocal connections between neurons of different types, allow for amplification already in the fast dynamical regime. Finally, our results also shed light on the differences between balanced networks in which inhibition exactly cancels excitation and those where inhibition dominates.