Transmission of information in active networks

Non-trivial generation and transmission of information in electronically designed logistic-map networks

In this work, we carry out a critical analysis of the information generated and transmitted in an electronic implementation of diffusively coupled logistic maps. Our implementation allows one to change the coupling configuration (i.e., the network) and fine-tune the coupling strength and map parameters, but has minimal electronic noise and parameter heterogeneity, which generates collective behaviors that differ from numerical simulations. In particular, we focus on analyzing two dynamical regimes and their dependence on the coupling configuration: one where there is a maximum of information generated and transmitted-corresponding to synchronization of chaotic orbits-and another where information is generated but (practically) not transmitted-corresponding to spatiotemporal chaos. We use Shannon entropy to quantify information generation and mutual information to quantify information transmission. To characterize the two dynamical regimes, we introduce a conditional joint entropy that uses both quantities (entropy and mutual information) and analyze its values for 60 different coupling configurations involving 6 and 12 coupled maps. We find that 90% of the configurations exhibit chaotic synchronization and 92% spatiotemporal chaos, which emerges preceding the chaotic synchronous regime that requires strong coupling strengths. Our results also highlight the coupling configurations that maximize the conditional joint entropy in these regimes without requiring a densely coupled system, which has practical implications (since introducing couplings between units can be costly). Overall, our work contributes to understand the relevance that the network structure has on the generation and transmission of information in complex systems.

Perspective on equal and cross-frequency neural coupling: Integration and segregation of the function of brain networks

We introduce a perspective that has not appeared before in the field of equal and multifrequency coupling derived from considering neuronal synchrony as a possible equivalence relation. The experimental results agree with the theoretical prediction that cross-frequency coupling results in a partition of the brain synchrony state space. We place these results in the framework of the integration and segregation of information in the processing of sensorimotor transformations by the brain cell circuits and propose that equal-frequency (1:1) connectivity favors integration of information in the brain whereas cross-frequency coupling (n:m) favors segregation. These observations may provide an outlook about how to reconcile the need for stability in the brain's operations with the requirement for diversity of activity in order to process many sensorimotor transformations simultaneously.

Testing dynamic correlations and nonlinearity in bivariate time series through information measures and surrogate data analysis

The increasing availability of time series data depicting the evolution of physical system properties has prompted the development of methods focused on extracting insights into the system behavior over time, discerning whether it stems from deterministic or stochastic dynamical systems. Surrogate data testing plays a crucial role in this process by facilitating robust statistical assessments. This ensures that the observed results are not mere occurrences by chance, but genuinely reflect the inherent characteristics of the underlying system. The initial process involves formulating a null hypothesis, which is tested using surrogate data in cases where assumptions about the underlying distributions are absent. A discriminating statistic is then computed for both the original data and each surrogate data set. Significantly deviating values between the original data and the surrogate data ensemble lead to the rejection of the null hypothesis. In this work, we present various surrogate methods designed to assess specific statistical properties in random processes. Specifically, we introduce methods for evaluating the presence of autodependencies and nonlinear dynamics within individual processes, using Information Storage as a discriminating statistic. Additionally, methods are introduced for detecting coupling and nonlinearities in bivariate processes, employing the Mutual Information Rate for this purpose. The surrogate methods introduced are first tested through simulations involving univariate and bivariate processes exhibiting both linear and nonlinear dynamics. Then, they are applied to physiological time series of Heart Period (RR intervals) and respiratory flow (RESP) variability measured during spontaneous and paced breathing. Simulations demonstrated that the proposed methods effectively identify essential dynamical features of stochastic systems. The real data application showed that paced breathing, at low breathing rate, increases the predictability of the individual dynamics of RR and RESP and dampens nonlinearity in their coupled dynamics.

Multivariate multiscale entropy (mMSE) as a tool for understanding the resting-state EEG signal dynamics: the spatial distribution and sex/gender-related differences

BACKGROUND

The study aimed to determine how the resting-state EEG (rsEEG) complexity changes both over time and space (channels). The complexity of rsEEG and its sex/gender differences were examined using the multivariate Multiscale Entropy (mMSE) in 95 healthy adults. Following the probability maps (Giacometti et al. in J Neurosci Methods 229:84-96, 2014), channel sets have been identified that correspond to the functional networks. For each channel set the area under curve (AUC), which represents the total complexity, MaxSlope-the maximum complexity change of the EEG signal at thefine scales (1:4 timescales), and AvgEnt-to the average entropy level at coarse-grained scales (9:12 timescales), respectively, were extracted. To check dynamic changes between the entropy level at the fine and coarse-grained scales, the difference in mMSE between the #9 and #4 timescale (DiffEnt) was also calculated.

RESULTS

We found the highest AUC for the channel sets corresponding to the somatomotor (SMN), dorsolateral network (DAN) and default mode (DMN) whereas the visual network (VN), limbic (LN), and frontoparietal (FPN) network showed the lowest AUC. The largest MaxSlope were in the SMN, DMN, ventral attention network (VAN), LN and FPN, and the smallest in the VN. The SMN and DAN were characterized by the highest and the LN, FPN, and VN by the lowest AvgEnt. The most stable entropy were for the DAN and VN while the LN showed the greatest drop of entropy at the coarse scales. Women, compared to men, showed higher MaxSlope and DiffEnt but lower AvgEnt in all channel sets.

CONCLUSIONS

Novel results of the present study are: (1) an identification of the mMSE features that capture entropy at the fine and coarse timescales in the channel sets corresponding to the main resting-state networks; (2) the sex/gender differences in these features.

Comparison of discretization strategies for the model-free information-theoretic assessment of short-term physiological interactions

This work presents a comparison between different approaches for the model-free estimation of information-theoretic measures of the dynamic coupling between short realizations of random processes. The measures considered are the mutual information rate (MIR) between two random processes X and Y and the terms of its decomposition evidencing either the individual entropy rates of X and Y and their joint entropy rate, or the transfer entropies from X to Y and from Y to X and the instantaneous information shared by X and Y. All measures are estimated through discretization of the random variables forming the processes, performed either via uniform quantization (binning approach) or rank ordering (permutation approach). The binning and permutation approaches are compared on simulations of two coupled non-identical Hènon systems and on three datasets, including short realizations of cardiorespiratory (CR, heart period and respiration flow), cardiovascular (CV, heart period and systolic arterial pressure), and cerebrovascular (CB, mean arterial pressure and cerebral blood flow velocity) measured in different physiological conditions, i.e., spontaneous vs paced breathing or supine vs upright positions. Our results show that, with careful selection of the estimation parameters (i.e., the embedding dimension and the number of quantization levels for the binning approach), meaningful patterns of the MIR and of its components can be achieved in the analyzed systems. On physiological time series, we found that paced breathing at slow breathing rates induces less complex and more coupled CR dynamics, while postural stress leads to unbalancing of CV interactions with prevalent baroreflex coupling and to less complex pressure dynamics with preserved CB interactions. These results are better highlighted by the permutation approach, thanks to its more parsimonious representation of the discretized dynamic patterns, which allows one to explore interactions with longer memory while limiting the curse of dimensionality.

Spatiotemporal complexity patterns of resting-state bioelectrical activity explain fluid intelligence: Sex matters

Neural complexity is thought to be associated with efficient information processing but the exact nature of this relation remains unclear. Here, the relationship of fluid intelligence (gf) with the resting-state EEG (rsEEG) complexity over different timescales and different electrodes was investigated. A 6-min rsEEG blocks of eyes open were analyzed. The results of 119 subjects (57 men, mean age = 22.85 ± 2.84 years) were examined using multivariate multiscale sample entropy (mMSE) that quantifies changes in information richness of rsEEG in multiple data channels at fine and coarse timescales. gf factor was extracted from six intelligence tests. Partial least square regression analysis revealed that mainly predictors of the rsEEG complexity at coarse timescales in the frontoparietal network (FPN) and the temporo-parietal complexities at fine timescales were relevant to higher gf. Sex differently affected the relationship between fluid intelligence and EEG complexity at rest. In men, gf was mainly positively related to the complexity at coarse timescales in the FPN. Furthermore, at fine and coarse timescales positive relations in the parietal region were revealed. In women, positive relations with gf were mostly observed for the overall and the coarse complexity in the FPN, whereas negative associations with gf were found for the complexity at fine timescales in the parietal and centro-temporal region. These outcomes indicate that two separate time pathways (corresponding to fine and coarse timescales) used to characterize rsEEG complexity (expressed by mMSE features) are beneficial for effective information processing.

Entropy and the Brain: An Overview

Entropy is a powerful tool for quantification of the brain function and its information processing capacity. This is evident in its broad domain of applications that range from functional interactivity between the brain regions to quantification of the state of consciousness. A number of previous reviews summarized the use of entropic measures in neuroscience. However, these studies either focused on the overall use of nonlinear analytical methodologies for quantification of the brain activity or their contents pertained to a particular area of neuroscientific research. The present study aims at complementing these previous reviews in two ways. First, by covering the literature that specifically makes use of entropy for studying the brain function. Second, by highlighting the three fields of research in which the use of entropy has yielded highly promising results: the (altered) state of consciousness, the ageing brain, and the quantification of the brain networks' information processing. In so doing, the present overview identifies that the use of entropic measures for the study of consciousness and its (altered) states led the field to substantially advance the previous findings. Moreover, it realizes that the use of these measures for the study of the ageing brain resulted in significant insights on various ways that the process of ageing may affect the dynamics and information processing capacity of the brain. It further reveals that their utilization for analysis of the brain regional interactivity formed a bridge between the previous two research areas, thereby providing further evidence in support of their results. It concludes by highlighting some potential considerations that may help future research to refine the use of entropic measures for the study of brain complexity and its function. The present study helps realize that (despite their seemingly differing lines of inquiry) the study of consciousness, the ageing brain, and the brain networks' information processing are highly interrelated. Specifically, it identifies that the complexity, as quantified by entropy, is a fundamental property of conscious experience, which also plays a vital role in the brain's capacity for adaptation and therefore whose loss by ageing constitutes a basis for diseases and disorders. Interestingly, these two perspectives neatly come together through the association of entropy and the brain capacity for information processing.

Entropy-based generating Markov partitions for complex systems

Finding the correct encoding for a generic dynamical system's trajectory is a complicated task: the symbolic sequence needs to preserve the invariant properties from the system's trajectory. In theory, the solution to this problem is found when a Generating Markov Partition (GMP) is obtained, which is only defined once the unstable and stable manifolds are known with infinite precision and for all times. However, these manifolds usually form highly convoluted Euclidean sets, are a priori unknown, and, as it happens in any real-world experiment, measurements are made with finite resolution and over a finite time-span. The task gets even more complicated if the system is a network composed of interacting dynamical units, namely, a high-dimensional complex system. Here, we tackle this task and solve it by defining a method to approximately construct GMPs for any complex system's finite-resolution and finite-time trajectory. We critically test our method on networks of coupled maps, encoding their trajectories into symbolic sequences. We show that these sequences are optimal because they minimise the information loss and also any spurious information added. Consequently, our method allows us to approximately calculate the invariant probability measures of complex systems from the observed data. Thus, we can efficiently define complexity measures that are applicable to a wide range of complex phenomena, such as the characterisation of brain activity from electroencephalogram signals measured at different brain regions or the characterisation of climate variability from temperature anomalies measured at different Earth regions.

Consciousness as a global property of brain dynamic activity

We seek general principles of the structure of the cellular collective activity associated with conscious awareness. Can we obtain evidence for features of the optimal brain organization that allows for adequate processing of stimuli and that may guide the emergence of cognition and consciousness? Analyzing brain recordings in conscious and unconscious states, we followed initially the classic approach in physics when it comes to understanding collective behaviours of systems composed of a myriad of units: the assessment of the number of possible configurations (microstates) that the system can adopt, for which we use a global entropic measure associated with the number of connected brain regions. Having found maximal entropy in conscious states, we then inspected the microscopic nature of the configurations of connections using an adequate complexity measure and found higher complexity in states characterized not only by conscious awareness but also by subconscious cognitive processing, such as sleep stages. Our observations indicate that conscious awareness is associated with maximal global (macroscopic) entropy and with the short time scale (microscopic) complexity of the configurations of connected brain networks in pathological unconscious states (seizures and coma), but the microscopic view captures the high complexity in physiological unconscious states (sleep) where there is information processing. As such, our results support the global nature of conscious awareness, as advocated by several theories of cognition. We thus hope that our studies represent preliminary steps to reveal aspects of the structure of cognition that leads to conscious awareness.

Weak connections form an infinite number of patterns in the brain

Recently, much attention has been paid to interpreting the mechanisms for memory formation in terms of brain connectivity and dynamics. Within the plethora of collective states a complex network can exhibit, we show that the phenomenon of Collective Almost Synchronisation (CAS), which describes a state with an infinite number of patterns emerging in complex networks for weak coupling strengths, deserves special attention. We show that a simulated neuron network with neurons weakly connected does produce CAS patterns, and additionally produces an output that optimally model experimental electroencephalograph (EEG) signals. This work provides strong evidence that the brain operates locally in a CAS regime, allowing it to have an unlimited number of dynamical patterns, a state that could explain the enormous memory capacity of the brain, and that would give support to the idea that local clusters of neurons are sufficiently decorrelated to independently process information locally.

Maintaining extensivity in evolutionary multiplex networks

In this paper, we explore the role of network topology on maintaining the extensive property of entropy. We study analytically and numerically how the topology contributes to maintaining extensivity of entropy in multiplex networks, i.e. networks of subnetworks (layers), by means of the sum of the positive Lyapunov exponents, HKS, a quantity related to entropy. We show that extensivity relies not only on the interplay between the coupling strengths of the dynamics associated to the intra (short-range) and inter (long-range) interactions, but also on the sum of the intra-degrees of the nodes of the layers. For the analytically treated networks of size N, among several other results, we show that if the sum of the intra-degrees (and the sum of inter-degrees) scales as Nθ+1, θ > 0, extensivity can be maintained if the intra-coupling (and the inter-coupling) strength scales as N-θ, when evolution is driven by the maximisation of HKS. We then verify our analytical results by performing numerical simulations in multiplex networks formed by electrically and chemically coupled neurons.

Do Brain Networks Evolve by Maximizing Their Information Flow Capacity?

We propose a working hypothesis supported by numerical simulations that brain networks evolve based on the principle of the maximization of their internal information flow capacity. We find that synchronous behavior and capacity of information flow of the evolved networks reproduce well the same behaviors observed in the brain dynamical networks of Caenorhabditis elegans and humans, networks of Hindmarsh-Rose neurons with graphs given by these brain networks. We make a strong case to verify our hypothesis by showing that the neural networks with the closest graph distance to the brain networks of Caenorhabditis elegans and humans are the Hindmarsh-Rose neural networks evolved with coupling strengths that maximize information flow capacity. Surprisingly, we find that global neural synchronization levels decrease during brain evolution, reflecting on an underlying global no Hebbian-like evolution process, which is driven by no Hebbian-like learning behaviors for some of the clusters during evolution, and Hebbian-like learning rules for clusters where neurons increase their synchronization.

Brain Dynamics of Aging: Multiscale Variability of EEG Signals at Rest and during an Auditory Oddball Task

Recently, the study of brain signal fluctuations is widely put forward as a promising entry point to characterize brain dynamics in health and disease. Although interesting results have been reported regarding how variability of brain activations can serve as an indicator of performance and adaptability in elderly, many uncertainties and controversies remain with regard to the comparability, reproducibility, and generality of the described findings, as well as the ensuing interpretations.

The present work focused on the study of fluctuations of cortical activity across time scales in young and older healthy adults. The main objective was to offer a comprehensive characterization of the changes of brain (cortical) signal variability during aging, and to make the link with known underlying structural, neurophysiological, and functional modifications, as well as aging theories. We analyzed electroencephalogram (EEG) data of young and elderly adults, which were collected at resting state and during an auditory oddball task. We used a wide battery of metrics that typically are separately applied in the literature, and we compared them with more specific ones that address their limits. Our procedure aimed to overcome some of the methodological limitations of earlier studies and verify whether previous findings can be reproduced and extended to different experimental conditions. In both rest and task conditions, our results mainly revealed that EEG signals presented systematic age-related changes that were time-scale-dependent with regard to the structure of fluctuations (complexity) but not with regard to their magnitude. Namely, compared with young adults, the cortical fluctuations of the elderly were more complex at shorter time scales, but less complex at longer scales, although always showing a lower variance. Additionally, the elderly showed signs of spatial, as well as between, experimental conditions dedifferentiation. By integrating these so far isolated findings across time scales, metrics, and conditions, the present study offers an overview of age-related changes in the fluctuation electrocortical activity while making the link with underlying brain dynamics.

Network complexity as a measure of information processing across resting-state networks: evidence from the Human Connectome Project

An emerging field of research focused on fluctuations in brain signals has provided evidence that the complexity of those signals, as measured by entropy, conveys important information about network dynamics (e.g., local and distributed processing). While much research has focused on how neural complexity differs in populations with different age groups or clinical disorders, substantially less research has focused on the basic understanding of neural complexity in populations with young and healthy brain states. The present study used resting-state fMRI data from the Human Connectome Project (Van Essen et al., 2013) to test the extent that neural complexity in the BOLD signal, as measured by multiscale entropy (1) would differ from random noise, (2) would differ between four major resting-state networks previously associated with higher-order cognition, and (3) would be associated with the strength and extent of functional connectivity—a complementary method of estimating information processing. We found that complexity in the BOLD signal exhibited different patterns of complexity from white, pink, and red noise and that neural complexity was differentially expressed between resting-state networks, including the default mode, cingulo-opercular, left and right frontoparietal networks. Lastly, neural complexity across all networks was negatively associated with functional connectivity at fine scales, but was positively associated with functional connectivity at coarse scales. The present study is the first to characterize neural complexity in BOLD signals at a high temporal resolution and across different networks and might help clarify the inconsistencies between neural complexity and functional connectivity, thus informing the mechanisms underlying neural complexity.

Production and transfer of energy and information in Hamiltonian systems

We present novel results that relate energy and information transfer with sensitivity to initial conditions in chaotic multi-dimensional Hamiltonian systems. We show the relation among Kolmogorov-Sinai entropy, Lyapunov exponents, and upper bounds for the Mutual Information Rate calculated in the Hamiltonian phase space and on bi-dimensional subspaces. Our main result is that the net amount of transfer from kinetic to potential energy per unit of time is a power-law of the upper bound for the Mutual Information Rate between kinetic and potential energies, and also a power-law of the Kolmogorov-Sinai entropy. Therefore, transfer of energy is related with both transfer and production of information. However, the power-law nature of this relation means that a small increment of energy transferred leads to a relatively much larger increase of the information exchanged. Then, we propose an “experimental” implementation of a 1-dimensional communication channel based on a Hamiltonian system, and calculate the actual rate with which information is exchanged between the first and last particle of the channel. Finally, a relation between our results and important quantities of thermodynamics is presented.

Wireless communication with chaos

The modern world fully relies on wireless communication. Because of intrinsic physical constraints of the wireless physical media (multipath, damping, and filtering), signals carrying information are strongly modified, preventing information from being transmitted with a high bit rate. We show that, though a chaotic signal is strongly modified by the wireless physical media, its Lyapunov exponents remain unaltered, suggesting that the information transmitted is not modified by the channel. For some particular chaotic signals, we have indeed proved that the dynamic description of both the transmitted and the received signals is identical and shown that the capacity of the chaos-based wireless channel is unaffected by the multipath propagation of the physical media. These physical properties of chaotic signals warrant an effective chaos-based wireless communication system.

Mutual information rate and bounds for it

The amount of information exchanged per unit of time between two nodes in a dynamical network or between two data sets is a powerful concept for analysing complex systems. This quantity, known as the mutual information rate (MIR), is calculated from the mutual information, which is rigorously defined only for random systems. Moreover, the definition of mutual information is based on probabilities of significant events. This work offers a simple alternative way to calculate the MIR in dynamical (deterministic) networks or between two time series (not fully deterministic), and to calculate its upper and lower bounds without having to calculate probabilities, but rather in terms of well known and well defined quantities in dynamical systems. As possible applications of our bounds, we study the relationship between synchronisation and the exchange of information in a system of two coupled maps and in experimental networks of coupled oscillators.

Chaotic phase synchronization in bursting-neuron models driven by a weak periodic force

We investigate the entrainment of a neuron model exhibiting a chaotic spiking-bursting behavior in response to a weak periodic force. This model exhibits two types of oscillations with different characteristic time scales, namely, long and short time scales. Several types of phase synchronization are observed, such as 1:1 phase locking between a single spike and one period of the force and 1:l phase locking between the period of slow oscillation underlying bursts and l periods of the force. Moreover, spiking-bursting oscillations with chaotic firing patterns can be synchronized with the periodic force. Such a type of phase synchronization is detected from the position of a set of points on a unit circle, which is determined by the phase of the periodic force at each spiking time. We show that this detection method is effective for a system with multiple time scales. Owing to the existence of both the short and the long time scales, two characteristic phenomena are found around the transition point to chaotic phase synchronization. One phenomenon shows that the average time interval between successive phase slips exhibits a power-law scaling against the driving force strength and that the scaling exponent has an unsmooth dependence on the changes in the driving force strength. The other phenomenon shows that Kuramoto's order parameter before the transition exhibits stepwise behavior as a function of the driving force strength, contrary to the smooth transition in a model with a single time scale.

Excitatory and inhibitory coupling in a one-dimensional array of Belousov-Zhabotinsky micro-oscillators: theory

We study numerically the behavior of one-dimensional arrays of aqueous droplets containing the oscillatory Belousov-Zhabotinsky reaction. Droplets are separated by an oil phase that allows coupling between neighboring droplets via two species: an inhibitor, Br(2), and an activator, HBrO(2). Excitatory coupling alone (through the activator) generates in-phase oscillations and/or "waves," while inhibitory coupling alone (through Br(2)) gives rise to antiphase oscillations, Turing patterns, and their combinations. The simultaneous presence of excitatory and inhibitory coupling leads to a large number of new spatiotemporal patterns, including some that exhibit very complex behavior. Analysis of a simple model allows us to simulate patterns resembling those observed experimentally under similar conditions and to elucidate the contributions of droplet and gap sizes, activator and inhibitor partition coefficients, and malonic acid concentration to the coupling strengths.

Species mobility induces synchronization in chaotic population dynamics

A prototype population dynamics model with cyclic domination of four species and empty sites is proposed for studying transition to synchronization. At the mean-field level the dynamics shows quasiperiodicity and chaos depending on the parameter values. The realization of the model on a square lattice shows that spatial restrictions and intrinsic stochasticity change the whole picture. The mean-field dynamics qualitatively remains only under global reactions, while local reactions drive the lattice to poisoning, where only some of the species survive. Nontrivial oscillatory steady states are developed if long-distance exchange is introduced due to gradual mixing with a certain probability. The mixing probability is shown to control the transition to synchronization which emerges abruptly following a phase slip scenario. Near the transition a typical intermittency crisis takes place, with phase slips becoming more infrequent as the transition is approached.

Variability of brain signals processed locally transforms into higher connectivity with brain development

A number of studies have characterized the changes in variability of brain signals with brain maturation from the perspective of considering the human brain as a complex system. Specifically, it has been shown that complexity of brain signals increases in development. On one hand, such an increase in complexity can be attributed to more specialized and differentiated brain regions able to express a higher repertoire of mental microstates. On the other hand, it can be explained by increased integration between widely distributed neuronal populations and establishment of new connections. The goal of this study was to see which of these two mechanisms is dominant, accounting for the previously observed increase in signal complexity. Using information-theoretic tools based on scalp-recorded EEG measurements, we examined the trade-off between local and distributed variability of brain signals in infants and children separated into age groups of 1-2, 2-8, 9-24, and 24-66 months old. We found that developmental changes were characterized by a decrease in the amount of information processed locally, with a peak in alpha frequency range. This effect was accompanied by an increase in the variability of brain signals processed as a distributed network. Complementary analysis of phase locking revealed an age-related pattern of increased synchronization in the lower part of the spectrum, up to the alpha rhythms. At the same time, we observed the desynchronization effects associated with brain development in the higher beta to lower gamma range.

Combined effect of chemical and electrical synapses in Hindmarsh-Rose neural networks on synchronization and the rate of information

In this work we studied the combined action of chemical and electrical synapses in small networks of Hindmarsh-Rose (HR) neurons on the synchronous behavior and on the rate of information produced (per time unit) by the networks. We show that if the chemical synapse is excitatory, the larger the chemical synapse strength used the smaller the electrical synapse strength needed to achieve complete synchronization, and for moderate synaptic strengths one should expect to find desynchronous behavior. Otherwise, if the chemical synapse is inhibitory, the larger the chemical synapse strength used the larger the electrical synapse strength needed to achieve complete synchronization, and for moderate synaptic strengths one should expect to find synchronous behaviors. Finally, we show how to calculate semianalytically an upper bound for the rate of information produced per time unit (Kolmogorov-Sinai entropy) in larger networks. As an application, we show that this upper bound is linearly proportional to the number of neurons in a network whose neurons are highly connected.

Finding quasi-optimal network topologies for information transmission in active networks

This work clarifies the relation between network circuit (topology) and behaviour (information transmission and synchronization) in active networks, e.g. neural networks. As an application, we show how one can find network topologies that are able to transmit a large amount of information, possess a large number of communication channels, and are robust under large variations of the network coupling configuration. This theoretical approach is general and does not depend on the particular dynamic of the elements forming the network, since the network topology can be determined by finding a Laplacian matrix (the matrix that describes the connections and the coupling strengths among the elements) whose eigenvalues satisfy some special conditions. To illustrate our ideas and theoretical approaches, we use neural networks of electrically connected chaotic Hindmarsh-Rose neurons.