Neural complexity and structural connectivity

Advances in the Research of Mesenchymal Stromal Cells in the Treatment of Maxillofacial Neurological Disorders and the Promotion of Facial Nerve Regeneration

Maxillofacial neurological disorders include a range of disorders affecting the cranial nerves, which can be caused by a variety of reasons, including infection, trauma, tumor, and surgical complications, resulting in severe dysfunction, and the study of new approaches for the treatment of these disorders is crucial for the restoration of sensory and motor functions of the face. In recent years, due to the excellent tissue regenerative ability of mesenchymal stromal cells (MSCs), research on MSCs and MSC-derived exosomes has been progressively deepened, bringing many new perspectives to the therapeutic strategies for many diseases. Facial nerve regeneration is a complex process involving various pathophysiological mechanisms and therapeutic strategies to restore nerve function after injury. And the rapid development of stem cell tissue engineering has greatly facilitated the research process of facial nerve regeneration. In this paper, we review the characteristics of MSCs and neural stem cells (NSCs), the roles they play in the neural microenvironment and the mechanisms that promote nerve regeneration, summarize the research progress of MSCs in the treatment of maxillofacial neurological disorders, and highlight the promising directions for future development.

Detecting Directional Coupling in Network Dynamical Systems via Kalman's Observability

Detecting coupling in network dynamical systems from time series is an open problem in the physics of complex systems. In this Letter, we tackle this issue from a control-theoretic perspective. Drawing inspiration from Kalman's notion of observability, we argue the presence of directional coupling between two units, X→Y, when X is detected as an internal state from the measurement of Y. We illustrate this approach on a series of analytically tractable systems, showcasing how it overcomes limitations of state-of-the-art methods for network inference.

Entropy and Complexity Tools Across Scales in Neuroscience: A Review

Understanding the brain's intricate dynamics across multiple scales-from cellular interactions to large-scale brain behavior-remains one of the most significant challenges in modern neuroscience. Two key concepts, entropy and complexity, have been increasingly employed by neuroscientists as powerful tools for characterizing the interplay between structure and function in the brain across scales. The flexibility of these two concepts enables researchers to explore quantitatively how the brain processes information, adapts to changing environments, and maintains a delicate balance between order and disorder. This review illustrates the main tools and ideas to study neural phenomena using these concepts. This review does not delve into the specific methods or analyses of each study. Instead, it aims to offer a broad overview of how these tools are applied within the neuroscientific community and how they are transforming our understanding of the brain. We focus on their applications across scales, discuss the strengths and limitations of different metrics, and examine their practical applications and theoretical significance.

ADHD symptoms map onto noise-driven structure-function decoupling between hub and peripheral brain regions

Adults with childhood-onset attention-deficit hyperactivity disorder (ADHD) show altered whole-brain connectivity. However, the relationship between structural and functional brain abnormalities, the implications for the development of life-long debilitating symptoms, and the underlying mechanisms remain uncharted. We recruited a unique sample of 80 medication-naive adults with a clinical diagnosis of childhood-onset ADHD without psychiatric comorbidities, and 123 age-, sex-, and intelligence-matched healthy controls. Structural and functional connectivity matrices were derived from diffusion spectrum imaging and multi-echo resting-state functional MRI data. Hub, feeder, and local connections were defined using diffusion data. Individual-level measures of structural connectivity and structure-function coupling were used to contrast groups and link behavior to brain abnormalities. Computational modeling was used to test possible neural mechanisms underpinning observed group differences in the structure-function coupling. Structural connectivity did not significantly differ between groups but, relative to controls, ADHD showed a reduction in structure-function coupling in feeder connections linking hubs with peripheral regions. This abnormality involved connections linking fronto-parietal control systems with sensory networks. Crucially, lower structure-function coupling was associated with higher ADHD symptoms. Results from our computational model further suggest that the observed structure-function decoupling in ADHD is driven by heterogeneity in neural noise variability across brain regions. By highlighting a neural cause of a clinically meaningful breakdown in the structure-function relationship, our work provides novel information on the nature of chronic ADHD. The current results encourage future work assessing the genetic and neurobiological underpinnings of neural noise in ADHD, particularly in brain regions encompassed by fronto-parietal systems.

Deriving pairwise transfer entropy from network structure and motifs

Transfer entropy (TE) is an established method for quantifying directed statistical dependencies in neuroimaging and complex systems datasets. The pairwise (or bivariate) TE from a source to a target node in a network does not depend solely on the local source-target link weight, but on the wider network structure that the link is embedded in. This relationship is studied using a discrete-time linearly coupled Gaussian model, which allows us to derive the TE for each link from the network topology. It is shown analytically that the dependence on the directed link weight is only a first approximation, valid for weak coupling. More generally, the TE increases with the in-degree of the source and decreases with the in-degree of the target, indicating an asymmetry of information transfer between hubs and low-degree nodes. In addition, the TE is directly proportional to weighted motif counts involving common parents or multiple walks from the source to the target, which are more abundant in networks with a high clustering coefficient than in random networks. Our findings also apply to Granger causality, which is equivalent to TE for Gaussian variables. Moreover, similar empirical results on random Boolean networks suggest that the dependence of the TE on the in-degree extends to nonlinear dynamics.

Model-based whole-brain effective connectivity to study distributed cognition in health and disease

Neuroimaging techniques are now widely used to study human cognition. The functional associations between brain areas have become a standard proxy to describe how cognitive processes are distributed across the brain network. Among the many analysis tools available, dynamic models of brain activity have been developed to overcome the limitations of original connectivity measures such as functional connectivity. This goes in line with the many efforts devoted to the assessment of directional interactions between brain areas from the observed neuroimaging activity. This opinion article provides an overview of our model-based whole-brain effective connectivity to analyze fMRI data, while discussing the pros and cons of our approach with respect to other established approaches. Our framework relies on the multivariate Ornstein-Uhlenbeck (MOU) process and is thus referred to as MOU-EC. Once tuned, the model provides a directed connectivity estimate that reflects the dynamical state of BOLD activity, which can be used to explore cognition. We illustrate this approach using two applications on task-evoked fMRI data. First, as a connectivity measure, MOU-EC can be used to extract biomarkers for task-specific brain coordination, understood as the patterns of areas exchanging information. The multivariate nature of connectivity measures raises several challenges for whole-brain analysis, for which machine-learning tools present some advantages over statistical testing. Second, we show how to interpret changes in MOU-EC connections in a collective and model-based manner, bridging with network analysis. Our framework provides a comprehensive set of tools that open exciting perspectives to study distributed cognition, as well as neuropathologies.

Restricted information in a two-step cascade

A cell must sense extracellular and intracellular fluctuations and respond appropriately to survive for optimal cellular functioning. Accordingly, a cell builds up biochemical networks which can transduce information of extracellular and intracellular fluctuations accurately. We consider a generic two-step cascade as a model gene regulatory network containing three regulatory proteins S, X, and Y connected as S→X→Y. The intermediate node X is a stochastic variable, acts as an obstacle, and impedes the information flow from S to Y. We quantify the information that is restricted by X using the tools of information theory and term this as restricted information. In this context, we further propose two measurable quantities, restricted efficiency and information transfer efficiency. The former determines how efficiently X restricts the upstream information coming from S, while the latter computes the efficiency of X to pass the upstream information toward Y. We also quantify the information that is being uniquely transferred from X to Y, which determines the extent of the ability of X to act as a source of information. Our analysis shows that when the signal strength (or mean population of S, 〈s〉) is low, the intermediate X can carry forward the upstream information reliably as well, as it acts as a better source of information, thereby increasing the fidelity of the network. But at the high signal strength, X restricts most of the upstream information, and its ability to act as a source of information gets reduced. This leads to a loss of fidelity of the network.

Network analysis of whole-brain fMRI dynamics: A new framework based on dynamic communicability

Neuroimaging techniques such as MRI have been widely used to explore the associations between brain areas. Structural connectivity (SC) captures the anatomical pathways across the brain and functional connectivity (FC) measures the correlation between the activity of brain regions. These connectivity measures have been much studied using network theory in order to uncover the distributed organization of brain structures, in particular FC for task-specific brain communication. However, the application of network theory to study FC matrices is often "static" despite the dynamic nature of time series obtained from fMRI. The present study aims to overcome this limitation by introducing a network-oriented analysis applied to whole-brain effective connectivity (EC) useful to interpret the brain dynamics. Technically, we tune a multivariate Ornstein-Uhlenbeck (MOU) process to reproduce the statistics of the whole-brain resting-state fMRI signals, which provides estimates for MOU-EC as well as input properties (similar to local excitabilities). The network analysis is then based on the Green function (or network impulse response) that describes the interactions between nodes across time for the estimated dynamics. This model-based approach provides time-dependent graph-like descriptor, named communicability, that characterize the roles that either nodes or connections play in the propagation of activity within the network. They can be used at both global and local levels, and also enables the comparison of estimates from real data with surrogates (e.g. random network or ring lattice). In contrast to classical graph approaches to study SC or FC, our framework stresses the importance of taking the temporal aspect of fMRI signals into account. Our results show a merging of functional communities over time, moving from segregated to global integration of the network activity. Our formalism sets a solid ground for the analysis and interpretation of fMRI data, including task-evoked activity.

Framework based on communicability and flow to analyze complex network dynamics

Graph theory constitutes a widely used and established field providing powerful tools for the characterization of complex networks. The intricate topology of networks can also be investigated by means of the collective dynamics observed in the interactions of self-sustained oscillations (synchronization patterns) or propagationlike processes such as random walks. However, networks are often inferred from real-data-forming dynamic systems, which are different from those employed to reveal their topological characteristics. This stresses the necessity for a theoretical framework dedicated to the mutual relationship between the structure and dynamics in complex networks, as the two sides of the same coin. Here we propose a rigorous framework based on the network response over time (i.e., Green function) to study interactions between nodes across time. For this purpose we define the flow that describes the interplay between the network connectivity and external inputs. This multivariate measure relates to the concepts of graph communicability and the map equation. We illustrate our theory using the multivariate Ornstein-Uhlenbeck process, which describes stable and non-conservative dynamics, but the formalism can be adapted to other local dynamics for which the Green function is known. We provide applications to classical network examples, such as small-world ring and hierarchical networks. Our theory defines a comprehensive framework that is canonically related to directed and weighted networks, thus paving a way to revise the standards for network analysis, from the pairwise interactions between nodes to the global properties of networks including community detection.

Multiple Kernel Learning Model for Relating Structural and Functional Connectivity in the Brain

A challenging problem in cognitive neuroscience is to relate the structural connectivity (SC) to the functional connectivity (FC) to better understand how large-scale network dynamics underlying human cognition emerges from the relatively fixed SC architecture. Recent modeling attempts point to the possibility of a single diffusion kernel giving a good estimate of the FC. We highlight the shortcomings of the single-diffusion-kernel model (SDK) and propose a multi-scale diffusion scheme. Our multi-scale model is formulated as a reaction-diffusion system giving rise to spatio-temporal patterns on a fixed topology. We hypothesize the presence of inter-regional co-activations (latent parameters) that combine diffusion kernels at multiple scales to characterize how FC could arise from SC. We formulated a multiple kernel learning (MKL) scheme to estimate the latent parameters from training data. Our model is analytically tractable and complex enough to capture the details of the underlying biological phenomena. The parameters learned by the MKL model lead to highly accurate predictions of subject-specific FCs from test datasets at a rate of 71%, surpassing the performance of the existing linear and non-linear models. We provide an example of how these latent parameters could be used to characterize age-specific reorganization in the brain structure and function.

Analytical Operations Relate Structural and Functional Connectivity in the Brain

Resting-state large-scale brain models vary in the amount of biological elements they incorporate and in the way they are being tested. One might expect that the more realistic the model is, the closer it should reproduce real functional data. It has been shown, instead, that when linear correlation across long BOLD fMRI time-series is used as a measure for functional connectivity (FC) to compare simulated and real data, a simple model performs just as well, or even better, than more sophisticated ones. The model in question is a simple linear model, which considers the physiological noise that is pervasively present in our brain while it diffuses across the white-matter connections, that is structural connectivity (SC). We deeply investigate this linear model, providing an analytical solution to straightforwardly compute FC from SC without the need of computationally costly simulations of time-series. We provide a few examples how this analytical solution could be used to perform a fast and detailed parameter exploration or to investigate resting-state non-stationarities. Most importantly, by inverting the analytical solution, we propose a method to retrieve information on the anatomical structure directly from functional data. This simple method can be used to complement or guide DTI/DSI and tractography results, especially for a better assessment of inter-hemispheric connections, or to provide an estimate of SC when only functional data are available.

Modeling of Large-Scale Functional Brain Networks Based on Structural Connectivity from DTI: Comparison with EEG Derived Phase Coupling Networks and Evaluation of Alternative Methods along the Modeling Path

In this study, we investigate if phase-locking of fast oscillatory activity relies on the anatomical skeleton and if simple computational models informed by structural connectivity can help further to explain missing links in the structure-function relationship. We use diffusion tensor imaging data and alpha band-limited EEG signal recorded in a group of healthy individuals. Our results show that about 23.4% of the variance in empirical networks of resting-state functional connectivity is explained by the underlying white matter architecture. Simulating functional connectivity using a simple computational model based on the structural connectivity can increase the match to 45.4%. In a second step, we use our modeling framework to explore several technical alternatives along the modeling path. First, we find that an augmentation of homotopic connections in the structural connectivity matrix improves the link to functional connectivity while a correction for fiber distance slightly decreases the performance of the model. Second, a more complex computational model based on Kuramoto oscillators leads to a slight improvement of the model fit. Third, we show that the comparison of modeled and empirical functional connectivity at source level is much more specific for the underlying structural connectivity. However, different source reconstruction algorithms gave comparable results. Of note, as the fourth finding, the model fit was much better if zero-phase lag components were preserved in the empirical functional connectome, indicating a considerable amount of functionally relevant synchrony taking place with near zero or zero-phase lag. The combination of the best performing alternatives at each stage in the pipeline results in a model that explains 54.4% of the variance in the empirical EEG functional connectivity. Our study shows that large-scale brain circuits of fast neural network synchrony strongly rely upon the structural connectome and simple computational models of neural activity can explain missing links in the structure-function relationship.

Brain imaging techniques are broadly divided into the two categories of structural and functional imaging. Structural imaging provides information about the static physical connectivity within the brain, while functional imaging provides data about the dynamic ongoing activation of brain areas. Computational models allow to bridge the gap between these two modalities and allow to gain new insights. Specifically, in this study, we use structural data from diffusion tractography recordings to model functional brain connectivity obtained from fast EEG dynamics occurring at the alpha frequency. First, we present a simple reference procedure which consists of several steps to link the structural to the functional empirical data. Second, we systematically compare several alternative methods along the modeling path in order to assess their impact on the overall fit between simulations and empirical data. We explore preprocessing steps of the structural connectivity and different levels of complexity of the computational model. We highlight the importance of source reconstruction and compare commonly used source reconstruction algorithms and metrics to assess functional connectivity. Our results serve as an important orienting frame for the emerging field of brain network modeling.

Extensions to a manifold learning framework for time-series analysis on dynamic manifolds in bioelectric signals

This paper addresses the challenge of extracting meaningful information from measured bioelectric signals generated by complex, large scale physiological systems such as the brain or the heart. We focus on a combination of the well-known Laplacian eigenmaps machine learning approach with dynamical systems ideas to analyze emergent dynamic behaviors. The method reconstructs the abstract dynamical system phase-space geometry of the embedded measurements and tracks changes in physiological conditions or activities through changes in that geometry. It is geared to extract information from the joint behavior of time traces obtained from large sensor arrays, such as those used in multiple-electrode ECG and EEG, and explore the geometrical structure of the low dimensional embedding of moving time windows of those joint snapshots. Our main contribution is a method for mapping vectors from the phase space to the data domain. We present cases to evaluate the methods, including a synthetic example using the chaotic Lorenz system, several sets of cardiac measurements from both canine and human hearts, and measurements from a human brain.

Conditional Self-Entropy and Conditional Joint Transfer Entropy in Heart Period Variability during Graded Postural Challenge

Self-entropy (SE) and transfer entropy (TE) are widely utilized in biomedical signal processing to assess the information stored into a system and transferred from a source to a destination respectively. The study proposes a more specific definition of the SE, namely the conditional SE (CSE), and a more flexible definition of the TE based on joint TE (JTE), namely the conditional JTE (CJTE), for the analysis of information dynamics in multivariate time series. In a protocol evoking a gradual sympathetic activation and vagal withdrawal proportional to the magnitude of the orthostatic stimulus, such as the graded head-up tilt, we extracted the beat-to-beat spontaneous variability of heart period (HP), systolic arterial pressure (SAP) and respiratory activity (R) in 19 healthy subjects and we computed SE of HP, CSE of HP given SAP and R, JTE from SAP and R to HP, CJTE from SAP and R to HP given SAP and CJTE from SAP and R to HP given R. CSE of HP given SAP and R was significantly smaller than SE of HP and increased progressively with the amplitude of the stimulus, thus suggesting that dynamics internal to HP and unrelated to SAP and R, possibly linked to sympathetic activation evoked by head-up tilt, might play a role during the orthostatic challenge. While JTE from SAP and R to HP was independent of tilt table angle, CJTE from SAP and R to HP given R and from SAP and R to HP given SAP showed opposite trends with tilt table inclination, thus suggesting that the importance of the cardiac baroreflex increases and the relevance of the cardiopulmonary pathway decreases during head-up tilt. The study demonstrates the high specificity of CSE and the high flexibility of CJTE over real data and proves that they are particularly helpful in disentangling physiological mechanisms and in assessing their different contributions to the overall cardiovascular regulation.

Using Pareto optimality to explore the topology and dynamics of the human connectome

Graph theory has provided a key mathematical framework to analyse the architecture of human brain networks. This architecture embodies an inherently complex relationship between connection topology, the spatial arrangement of network elements, and the resulting network cost and functional performance. An exploration of these interacting factors and driving forces may reveal salient network features that are critically important for shaping and constraining the brain's topological organization and its evolvability. Several studies have pointed to an economic balance between network cost and network efficiency with networks organized in an ‘economical’ small-world favouring high communication efficiency at a low wiring cost. In this study, we define and explore a network morphospace in order to characterize different aspects of communication efficiency in human brain networks. Using a multi-objective evolutionary approach that approximates a Pareto-optimal set within the morphospace, we investigate the capacity of anatomical brain networks to evolve towards topologies that exhibit optimal information processing features while preserving network cost. This approach allows us to investigate network topologies that emerge under specific selection pressures, thus providing some insight into the selectional forces that may have shaped the network architecture of existing human brains.

Cortical spatiotemporal dimensionality reduction for visual grouping

The visual systems of many mammals, including humans, are able to integrate the geometric information of visual stimuli and perform cognitive tasks at the first stages of the cortical processing. This is thought to be the result of a combination of mechanisms, which include feature extraction at the single cell level and geometric processing by means of cell connectivity. We present a geometric model of such connectivities in the space of detected features associated with spatiotemporal visual stimuli and show how they can be used to obtain low-level object segmentation. The main idea is to define a spectral clustering procedure with anisotropic affinities over data sets consisting of embeddings of the visual stimuli into higher-dimensional spaces. Neural plausibility of the proposed arguments will be discussed.

Predicting functional connectivity from structural connectivity via computational models using MRI: an extensive comparison study

The relationship between structural connectivity (SC) and functional connectivity (FC) in the human brain can be studied using magnetic resonance imaging (MRI). However many of the underlying physiological mechanisms and parameters cannot be directly observed with MRI. This limitation has motivated the recent use of various computational models meant to bridge the gap. However their absolute and relative explanatory power and the properties that actually drive that power remain insufficiently characterized. We performed an extensive comparison of seven mainstream computational models predicting FC from SC. We investigated the extent to which simulated FC could predict empirical FC. We also applied graph theory to the entire set of simulated and empirical FCs in order to further characterize the relationships between the models and the MRI data. The comparison was performed at three different spatial scales. We found that (i) there were significant effects of scale and model on predictive power; (ii) among all models, the simplest model, the simultaneous autoregressive (SAR) model, was found to consistently perform better than the other models; (iii) the SAR also appeared more 'central' from a graph theory perspective; and (iv) empirical FC only appeared weakly correlated with simulated FCs, and was featured as 'peripheral' in the graph analysis. We conclude that the substantial differences existing between these computational models have little impact on their predictive power for FC and that their capacity to predict FC from SC appears to be both moderate and essentially underlined by a simple core linear process embodied by the SAR model.

Relating structural and functional connectivity in MRI: a simple model for a complex brain

Advances in magnetic resonance imaging (MRI) allow to gain critical insight into the structure of neural networks and their functional dynamics. To relate structural connectivity [as quantified by diffusion-weighted imaging (DWI) tractography] and functional connectivity [as obtained from functional MRI (fMRI)], increasing emphasis has been put on computational models of brain activity. In the present study, we use structural equation modeling (SEM) with structural connectivity to predict functional connectivity. The resulting model takes the simple form of a spatial simultaneous autoregressive model (sSAR), whose parameters can be estimated in a Bayesian framework. On synthetic data, results showed very good accuracy and reliability of the inference process. On real data, we found that the sSAR performed significantly better than two other reference models as well as than structural connectivity alone, but that the Bayesian procedure did not bring significant improvement in fit compared to two simpler approaches. Nonetheless, we also found that the values of the region-specific parameters inferred using Bayesian inference differed significantly across resting-state networks. These results demonstrate 1) that a simple abstract model is able to perform better that more complex models based on more realistic assumptions, 2) that the parameters of the sSAR can be estimated and can potentially be used as biomarkers, but also 3) that the sSAR, while being the best-performing model, is at best still a very crude model of the relationship between structure and function in MRI.

Information gain in the brain's resting state: A new perspective on autism

Along with the study of brain activity evoked by external stimuli, an increased interest in the research of background, “noisy” brain activity is fast developing in current neuroscience. It is becoming apparent that this “resting-state” activity is a major factor determining other, more particular, responses to stimuli and hence it can be argued that background activity carries important information used by the nervous systems for adaptive behaviors. In this context, we investigated the generation of information in ongoing brain activity recorded with magnetoencephalography (MEG) in children with autism spectrum disorder (ASD) and non-autistic children. Using a stochastic dynamical model of brain dynamics, we were able to resolve not only the deterministic interactions between brain regions, i.e., the brain's functional connectivity, but also the stochastic inputs to the brain in the resting state; an important component of large-scale neural dynamics that no other method can resolve to date. We then computed the Kullback-Leibler (KLD) divergence, also known as information gain or relative entropy, between the stochastic inputs and the brain activity at different locations (outputs) in children with ASD compared to controls. The divergence between the input noise and the brain's ongoing activity extracted from our stochastic model was significantly higher in autistic relative to non-autistic children. This suggests that brains of subjects with autism create more information at rest. We propose that the excessive production of information in the absence of relevant sensory stimuli or attention to external cues underlies the cognitive differences between individuals with and without autism. We conclude that the information gain in the brain's resting state provides quantitative evidence for perhaps the most typical characteristic in autism: withdrawal into one's inner world.

A model of functional brain connectivity and background noise as a biomarker for cognitive phenotypes: application to autism

We present an efficient approach to discriminate between typical and atypical brains from macroscopic neural dynamics recorded as magnetoencephalograms (MEG). Our approach is based on the fact that spontaneous brain activity can be accurately described with stochastic dynamics, as a multivariate Ornstein-Uhlenbeck process (mOUP). By fitting the data to a mOUP we obtain: 1) the functional connectivity matrix, corresponding to the drift operator, and 2) the traces of background stochastic activity (noise) driving the brain. We applied this method to investigate functional connectivity and background noise in juvenile patients (n = 9) with Asperger's syndrome, a form of autism spectrum disorder (ASD), and compared them to age-matched juvenile control subjects (n = 10). Our analysis reveals significant alterations in both functional brain connectivity and background noise in ASD patients. The dominant connectivity change in ASD relative to control shows enhanced functional excitation from occipital to frontal areas along a parasagittal axis. Background noise in ASD patients is spatially correlated over wide areas, as opposed to control, where areas driven by correlated noise form smaller patches. An analysis of the spatial complexity reveals that it is significantly lower in ASD subjects. Although the detailed physiological mechanisms underlying these alterations cannot be determined from macroscopic brain recordings, we speculate that enhanced occipital-frontal excitation may result from changes in white matter density in ASD, as suggested in previous studies. We also venture that long-range spatial correlations in the background noise may result from less specificity (or more promiscuity) of thalamo-cortical projections. All the calculations involved in our analysis are highly efficient and outperform other algorithms to discriminate typical and atypical brains with a comparable level of accuracy. Altogether our results demonstrate a promising potential of our approach as an efficient biomarker for altered brain dynamics associated with a cognitive phenotype.

Information and phase transitions in socio-economic systems

We examine the role of information-based measures in detecting and analysing phase transitions. We contend that phase transitions have a general character, visible in transitions in systems as diverse as classical flocking models, human expertise, and social networks. Information-based measures such as mutual information and transfer entropy are particularly suited to detecting the change in scale and range of coupling in systems that herald a phase transition in progress, but their use is not necessarily straightforward, possessing difficulties in accurate estimation due to limited sample sizes and the complexities of analysing non-stationary time series. These difficulties are surmountable with careful experimental choices. Their effectiveness in revealing unexpected connections between diverse systems makes them a promising tool for future research.

Information storage, loop motifs, and clustered structure in complex networks

We use a standard discrete-time linear Gaussian model to analyze the information storage capability of individual nodes in complex networks, given the network structure and link weights. In particular, we investigate the role of two- and three-node motifs in contributing to local information storage. We show analytically that directed feedback and feedforward loop motifs are the dominant contributors to information storage capability, with their weighted motif counts locally positively correlated to storage capability. We also reveal the direct local relationship between clustering coefficient(s) and information storage. These results explain the dynamical importance of clustered structure and offer an explanation for the prevalence of these motifs in biological and artificial networks.

A new measure based on degree distribution that links information theory and network graph analysis

Background

Detailed connection maps of human and nonhuman brains are being generated with new technologies, and graph metrics have been instrumental in understanding the general organizational features of these structures. Neural networks appear to have small world properties: they have clustered regions, while maintaining integrative features such as short average pathlengths.

Results

We captured the structural characteristics of clustered networks with short average pathlengths through our own variable, System Difference (SD), which is computationally simple and calculable for larger graph systems. SD is a Jaccardian measure generated by averaging all of the differences in the connection patterns between any two nodes of a system. We calculated SD over large random samples of matrices and found that high SD matrices have a low average pathlength and a larger number of clustered structures. SD is a measure of degree distribution with high SD matrices maximizing entropic properties. Phi (Φ), an information theory metric that assesses a system’s capacity to integrate information, correlated well with SD - with SD explaining over 90% of the variance in systems above 11 nodes (tested for 4 to 13 nodes). However, newer versions of Φ do not correlate well with the SD metric.

Conclusions

The new network measure, SD, provides a link between high entropic structures and degree distributions as related to small world properties.

Causal density and integrated information as measures of conscious level

An outstanding challenge in neuroscience is to develop theoretically grounded and practically applicable quantitative measures that are sensitive to conscious level. Such measures should be high for vivid alert conscious wakefulness, and low for unconscious states such as dreamless sleep, coma and general anaesthesia. Here, we describe recent progress in the development of measures of dynamical complexity, in particular causal density and integrated information. These and similar measures capture in different ways the extent to which a system's dynamics are simultaneously differentiated and integrated. Because conscious scenes are distinguished by the same dynamical features, these measures are therefore good candidates for reflecting conscious level. After reviewing the theoretical background, we present new simulation results demonstrating similarities and differences between the measures, and we discuss remaining challenges in the practical application of the measures to empirically obtained data.

Brain rhythms reveal a hierarchical network organization

Recordings of ongoing neural activity with EEG and MEG exhibit oscillations of specific frequencies over a non-oscillatory background. The oscillations appear in the power spectrum as a collection of frequency bands that are evenly spaced on a logarithmic scale, thereby preventing mutual entrainment and cross-talk. Over the last few years, experimental, computational and theoretical studies have made substantial progress on our understanding of the biophysical mechanisms underlying the generation of network oscillations and their interactions, with emphasis on the role of neuronal synchronization. In this paper we ask a very different question. Rather than investigating how brain rhythms emerge, or whether they are necessary for neural function, we focus on what they tell us about functional brain connectivity. We hypothesized that if we were able to construct abstract networks, or "virtual brains", whose dynamics were similar to EEG/MEG recordings, those networks would share structural features among themselves, and also with real brains. Applying mathematical techniques for inverse problems, we have reverse-engineered network architectures that generate characteristic dynamics of actual brains, including spindles and sharp waves, which appear in the power spectrum as frequency bands superimposed on a non-oscillatory background dominated by low frequencies. We show that all reconstructed networks display similar topological features (e.g. structural motifs) and dynamics. We have also reverse-engineered putative diseased brains (epileptic and schizophrenic), in which the oscillatory activity is altered in different ways, as reported in clinical studies. These reconstructed networks show consistent alterations of functional connectivity and dynamics. In particular, we show that the complexity of the network, quantified as proposed by Tononi, Sporns and Edelman, is a good indicator of brain fitness, since virtual brains modeling diseased states display lower complexity than virtual brains modeling normal neural function. We finally discuss the implications of our results for the neurobiology of health and disease.

Neural complexity: a graph theoretic interpretation

One of the central challenges facing modern neuroscience is to explain the ability of the nervous system to coherently integrate information across distinct functional modules in the absence of a central executive. To this end, Tononi et al. [Proc. Natl. Acad. Sci. USA. 91, 5033 (1994)] proposed a measure of neural complexity that purports to capture this property based on mutual information between complementary subsets of a system. Neural complexity, so defined, is one of a family of information theoretic metrics developed to measure the balance between the segregation and integration of a system's dynamics. One key question arising for such measures involves understanding how they are influenced by network topology. Sporns et al. [Cereb. Cortex 10, 127 (2000)] employed numerical models in order to determine the dependence of neural complexity on the topological features of a network. However, a complete picture has yet to be established. While De Lucia et al. [Phys. Rev. E 71, 016114 (2005)] made the first attempts at an analytical account of this relationship, their work utilized a formulation of neural complexity that, we argue, did not reflect the intuitions of the original work. In this paper we start by describing weighted connection matrices formed by applying a random continuous weight distribution to binary adjacency matrices. This allows us to derive an approximation for neural complexity in terms of the moments of the weight distribution and elementary graph motifs. In particular, we explicitly establish a dependency of neural complexity on cyclic graph motifs.

Quantifying the complexity of the delayed logistic map

Statistical complexity measures are used to quantify the degree of complexity of the delayed logistic map, with linear and nonlinear feedback. We employ two methods for calculating the complexity measures, one with the 'histogram-based' probability distribution function and the other one with ordinal patterns. We show that these methods provide complementary information about the complexity of the delay-induced dynamics: there are parameter regions where the histogram-based complexity is zero while the ordinal pattern complexity is not, and vice versa. We also show that the time series generated from the nonlinear delayed logistic map can present zero missing or forbidden patterns, i.e. all possible ordinal patterns are realized into orbits.

Practical measures of integrated information for time-series data

A recent measure of 'integrated information', Φ(DM), quantifies the extent to which a system generates more information than the sum of its parts as it transitions between states, possibly reflecting levels of consciousness generated by neural systems. However, Φ(DM) is defined only for discrete Markov systems, which are unusual in biology; as a result, Φ(DM) can rarely be measured in practice. Here, we describe two new measures, Φ(E) and Φ(AR), that overcome these limitations and are easy to apply to time-series data. We use simulations to demonstrate the in-practice applicability of our measures, and to explore their properties. Our results provide new opportunities for examining information integration in real and model systems and carry implications for relations between integrated information, consciousness, and other neurocognitive processes. However, our findings pose challenges for theories that ascribe physical meaning to the measured quantities.