Griffiths phases and localization in hierarchical modular networks

Does the brain behave like a (complex) network? I. Dynamics

Graph theory is now becoming a standard tool in system-level neuroscience. However, endowing observed brain anatomy and dynamics with a complex network structure does not entail that the brain actually works as a network. Asking whether the brain behaves as a network means asking whether network properties count. From the viewpoint of neurophysiology and, possibly, of brain physics, the most substantial issues a network structure may be instrumental in addressing relate to the influence of network properties on brain dynamics and to whether these properties ultimately explain some aspects of brain function. Here, we address the dynamical implications of complex network, examining which aspects and scales of brain activity may be understood to genuinely behave as a network. To do so, we first define the meaning of networkness, and analyse some of its implications. We then examine ways in which brain anatomy and dynamics can be endowed with a network structure and discuss possible ways in which network structure may be shown to represent a genuine organisational principle of brain activity, rather than just a convenient description of its anatomy and dynamics.

Scaling laws of failure dynamics on complex networks

The topology of the network of load transmitting connections plays an essential role in the cascading failure dynamics of complex systems driven by the redistribution of load after local breakdown events. In particular, as the network structure is gradually tuned from regular to completely random a transition occurs from the localized to mean field behavior of failure spreading. Based on finite size scaling in the fiber bundle model of failure phenomena, here we demonstrate that outside the localized regime, the load bearing capacity and damage tolerance on the macro-scale, and the statistics of clusters of failed nodes on the micro-scale obey scaling laws with exponents which depend on the topology of the load transmission network and on the degree of disorder of the strength of nodes. Most notably, we show that the spatial structure of damage governs the emergence of the localized to mean field transition: as the network gets gradually randomized failed clusters formed on locally regular patches merge through long range links generating a percolation like transition which reduces the load concentration on the network. The results may help to design network structures with an improved robustness against cascading failure.

Global excitability and network structure in the human brain

We utilize a model of Wilson-Cowan oscillators to investigate structure-function relationships in the human brain by means of simulations of the spontaneous dynamics of brain networks generated through human connectome data. This allows us to establish relationships between the global excitability of such networks and global structural network quantities for connectomes of two different sizes for a number of individual subjects. We compare the qualitative behavior of such correlations between biological networks and shuffled networks, the latter generated by shuffling the pairwise connectivities of the former while preserving their distribution. Our results point towards a remarkable propensity of the brain to achieve a trade-off between low network wiring cost and strong functionality, and highlight the unique capacity of brain network topologies to exhibit a strong transition from an inactive state to a globally excited one.

Criticality and Griffiths phases in random games with quenched disorder

The perceived risk and reward for a given situation can vary depending on resource availability, accumulated wealth, and other extrinsic factors such as individual backgrounds. Based on this general aspect of everyday life, here we use evolutionary game theory to model a scenario with randomly perturbed payoffs in a prisoner's dilemma game. The perception diversity is modeled by adding a zero-average random noise in the payoff entries and a Monte Carlo simulation is used to obtain the population dynamics. This payoff heterogeneity can promote and maintain cooperation in a competitive scenario where only defectors would survive otherwise. In this work, we give a step further, understanding the role of heterogeneity by investigating the effects of quenched disorder in the critical properties of random games. We observe that payoff fluctuations induce a very slow dynamic, making the cooperation decay behave as power laws with varying exponents, instead of the usual exponential decay after the critical point, showing the emergence of a Griffiths phase. We also find a symmetric Griffiths phase near the defector's extinction point when fluctuations are present, indicating that Griffiths phases may be frequent in evolutionary game dynamics and play a role in the coexistence of different strategies.

Nonuniversal power-law dynamics of susceptible infected recovered models on hierarchical modular networks

Power-law (PL) time-dependent infection growth has been reported in many COVID-19 statistics. In simple susceptible infected recovered (SIR) models, the number of infections grows at the outbreak as I(t)∝t^{d-1} on d-dimensional Euclidean lattices in the endemic phase, or it follows a slower universal PL at the critical point, until finite sizes cause immunity and a crossover to an exponential decay. Heterogeneity may alter the dynamics of spreading models, and spatially inhomogeneous infection rates can cause slower decays, posing a threat of a long recovery from a pandemic. COVID-19 statistics have also provided epidemic size distributions with PL tails in several countries. Here I investigate SIR-like models on hierarchical modular networks, embedded in 2d lattices with the addition of long-range links. I show that if the topological dimension of the network is finite, average degree-dependent PL growth of prevalence emerges. Supercritically, the same exponents as those of regular graphs occur, but the topological disorder alters the critical behavior. This is also true for the epidemic size distributions. Mobility of individuals does not affect the form of the scaling behavior, except for the d=2 lattice, but it increases the magnitude of the epidemic. The addition of a superspreader hot spot also does not change the growth exponent and the exponential decay in the herd immunity regime.

Master equation analysis of mesoscopic localization in contagion dynamics on higher-order networks

Simple models of infectious diseases tend to assume random mixing of individuals, but real interactions are not random pairwise encounters: they occur within various types of gatherings such as workplaces, households, schools, and concerts, best described by a higher-order network structure. We model contagions on higher-order networks using group-based approximate master equations, in which we track all states and interactions within a group of nodes and assume a mean-field coupling between them. Using the susceptible-infected-susceptible dynamics, our approach reveals the existence of a mesoscopic localization regime, where a disease can concentrate and self-sustain only around large groups in the network overall organization. In this regime, the phase transition is smeared, characterized by an inhomogeneous activation of the groups. At the mesoscopic level, we observe that the distribution of infected nodes within groups of the same size can be very dispersed, even bimodal. When considering heterogeneous networks, both at the level of nodes and at the level of groups, we characterize analytically the region associated with mesoscopic localization in the structural parameter space. We put in perspective this phenomenon with eigenvector localization and discuss how a focus on higher-order structures is needed to discern the more subtle localization at the mesoscopic level. Finally, we discuss how mesoscopic localization affects the response to structural interventions and how this framework could provide important insights for a broad range of dynamics.

Criticality, Connectivity, and Neural Disorder: A Multifaceted Approach to Neural Computation

It has been hypothesized that the brain optimizes its capacity for computation by self-organizing to a critical point. The dynamical state of criticality is achieved by striking a balance such that activity can effectively spread through the network without overwhelming it and is commonly identified in neuronal networks by observing the behavior of cascades of network activity termed "neuronal avalanches." The dynamic activity that occurs in neuronal networks is closely intertwined with how the elements of the network are connected and how they influence each other's functional activity. In this review, we highlight how studying criticality with a broad perspective that integrates concepts from physics, experimental and theoretical neuroscience, and computer science can provide a greater understanding of the mechanisms that drive networks to criticality and how their disruption may manifest in different disorders. First, integrating graph theory into experimental studies on criticality, as is becoming more common in theoretical and modeling studies, would provide insight into the kinds of network structures that support criticality in networks of biological neurons. Furthermore, plasticity mechanisms play a crucial role in shaping these neural structures, both in terms of homeostatic maintenance and learning. Both network structures and plasticity have been studied fairly extensively in theoretical models, but much work remains to bridge the gap between theoretical and experimental findings. Finally, information theoretical approaches can tie in more concrete evidence of a network's computational capabilities. Approaching neural dynamics with all these facets in mind has the potential to provide a greater understanding of what goes wrong in neural disorders. Criticality analysis therefore holds potential to identify disruptions to healthy dynamics, granted that robust methods and approaches are considered.

An Integrated World Modeling Theory (IWMT) of Consciousness: Combining Integrated Information and Global Neuronal Workspace Theories With the Free Energy Principle and Active Inference Framework; Toward Solving the Hard Problem and Characterizing Agentic Causation

The Free Energy Principle and Active Inference Framework (FEP-AI) begins with the understanding that persisting systems must regulate environmental exchanges and prevent entropic accumulation. In FEP-AI, minds and brains are predictive controllers for autonomous systems, where action-driven perception is realized as probabilistic inference. Integrated Information Theory (IIT) begins with considering the preconditions for a system to intrinsically exist, as well as axioms regarding the nature of consciousness. IIT has produced controversy because of its surprising entailments: quasi-panpsychism; subjectivity without referents or dynamics; and the possibility of fully-intelligent-yet-unconscious brain simulations. Here, I describe how these controversies might be resolved by integrating IIT with FEP-AI, where integrated information only entails consciousness for systems with perspectival reference frames capable of generating models with spatial, temporal, and causal coherence for self and world. Without that connection with external reality, systems could have arbitrarily high amounts of integrated information, but nonetheless would not entail subjective experience. I further describe how an integration of these frameworks may contribute to their evolution as unified systems theories and models of emergent causation. Then, inspired by both Global Neuronal Workspace Theory (GNWT) and the Harmonic Brain Modes framework, I describe how streams of consciousness may emerge as an evolving generation of sensorimotor predictions, with the precise composition of experiences depending on the integration abilities of synchronous complexes as self-organizing harmonic modes (SOHMs). These integrating dynamics may be particularly likely to occur via richly connected subnetworks affording body-centric sources of phenomenal binding and executive control. Along these connectivity backbones, SOHMs are proposed to implement turbo coding via loopy message-passing over predictive (autoencoding) networks, thus generating maximum a posteriori estimates as coherent vectors governing neural evolution, with alpha frequencies generating basic awareness, and cross-frequency phase-coupling within theta frequencies for access consciousness and volitional control. These dynamic cores of integrated information also function as global workspaces, centered on posterior cortices, but capable of being entrained with frontal cortices and interoceptive hierarchies, thus affording agentic causation. Integrated World Modeling Theory (IWMT) represents a synthetic approach to understanding minds that reveals compatibility between leading theories of consciousness, thus enabling inferential synergy.

Impact of the distribution of recovery rates on disease spreading in complex networks

We study a general epidemic model with arbitrary recovery rate distributions. This simple deviation from the standard setup is sufficient to prove that heterogeneity in the dynamical parameters can be as important as the more studied structural heterogeneity. Our analytical solution is able to predict the shift in the critical properties induced by heterogeneous recovery rates. We find that the critical value of infectivity tends to be smaller than the one predicted by quenched mean-field approaches in the homogeneous case and that it can be linked to the variance of the recovery rates. Our findings also illustrate the role of dynamical-structural correlations, where we allow a power-law network to dynamically behave as a homogeneous structure by an appropriate tuning of its recovery rates. Overall, our results demonstrate that heterogeneity in the recovery rates, eventually in all dynamical parameters, is as important as the structural heterogeneity.

Critical synchronization dynamics of the Kuramoto model on connectome and small world graphs

The hypothesis, that cortical dynamics operates near criticality also suggests, that it exhibits universal critical exponents which marks the Kuramoto equation, a fundamental model for synchronization, as a prime candidate for an underlying universal model. Here, we determined the synchronization behavior of this model by solving it numerically on a large, weighted human connectome network, containing 836733 nodes, in an assumed homeostatic state. Since this graph has a topological dimension d < 4, a real synchronization phase transition is not possible in the thermodynamic limit, still we could locate a transition between partially synchronized and desynchronized states. At this crossover point we observe power-law–tailed synchronization durations, with τ_t ≃ 1.2(1), away from experimental values for the brain. For comparison, on a large two-dimensional lattice, having additional random, long-range links, we obtain a mean-field value: τ_t ≃ 1.6(1). However, below the transition of the connectome we found global coupling control-parameter dependent exponents 1 < τ_t ≤ 2, overlapping with the range of human brain experiments. We also studied the effects of random flipping of a small portion of link weights, mimicking a network with inhibitory interactions, and found similar results. The control-parameter dependent exponent suggests extended dynamical criticality below the transition point.

Spike-Timing-Dependent Plasticity With Axonal Delay Tunes Networks of Izhikevich Neurons to the Edge of Synchronization Transition With Scale-Free Avalanches

Critical brain hypothesis has been intensively studied both in experimental and theoretical neuroscience over the past two decades. However, some important questions still remain: (i) What is the critical point the brain operates at? (ii) What is the regulatory mechanism that brings about and maintains such a critical state? (iii) The critical state is characterized by scale-invariant behavior which is seemingly at odds with definitive brain oscillations? In this work we consider a biologically motivated model of Izhikevich neuronal network with chemical synapses interacting via spike-timing-dependent plasticity (STDP) as well as axonal time delay. Under generic and physiologically relevant conditions we show that the system is organized and maintained around a synchronization transition point as opposed to an activity transition point associated with an absorbing state phase transition. However, such a state exhibits experimentally relevant signs of critical dynamics including scale-free avalanches with finite-size scaling as well as critical branching ratios. While the system displays stochastic oscillations with highly correlated fluctuations, it also displays dominant frequency modes seen as sharp peaks in the power spectrum. The role of STDP as well as time delay is crucial in achieving and maintaining such critical dynamics, while the role of inhibition is not as crucial. In this way we provide possible answers to all three questions posed above. We also show that one can achieve supercritical or subcritical dynamics if one changes the average time delay associated with axonal conduction.

Robustness of Griffiths effects in homeostatic connectome models

I provide numerical evidence for the robustness of the Griffiths phase (GP) reported previously in dynamical threshold model simulations on a large human brain network with N=836733 connected nodes. The model, with equalized network sensitivity, is extended in two ways: introduction of refractory states or by randomized time-dependent thresholds. The nonuniversal power-law dynamics in an extended control parameter region survives these modifications for a short refractory state and weak disorder. In case of temporal disorder the GP shrinks and for stronger heterogeneity disappears, leaving behind a mean-field type of critical transition. Activity avalanche size distributions below the critical point decay faster than in the original model, but the addition of inhibitory interactions sets it back to the range of experimental values.

Avalanche precursors of failure in hierarchical fuse networks

We study precursors of failure in hierarchical random fuse network models which can be considered as idealizations of hierarchical (bio)materials where fibrous assemblies are held together by multi-level (hierarchical) cross-links. When such structures are loaded towards failure, the patterns of precursory avalanche activity exhibit generic scale invariance: irrespective of load, precursor activity is characterized by power-law avalanche size distributions without apparent cut-off, with power-law exponents that decrease continuously with increasing load. This failure behavior and the ensuing super-rough crack morphology differ significantly from the findings in non-hierarchical structures.

Griffiths phases in infinite-dimensional, non-hierarchical modular networks

Griffiths phases (GPs), generated by the heterogeneities on modular networks, have recently been suggested to provide a mechanism, rid of fine parameter tuning, to explain the critical behavior of complex systems. One conjectured requirement for systems with modular structures was that the network of modules must be hierarchically organized and possess finite dimension. We investigate the dynamical behavior of an activity spreading model, evolving on heterogeneous random networks with highly modular structure and organized non-hierarchically. We observe that loosely coupled modules act as effective rare-regions, slowing down the extinction of activation. As a consequence, we find extended control parameter regions with continuously changing dynamical exponents for single network realizations, preserved after finite size analyses, as in a real GP. The avalanche size distributions of spreading events exhibit robust power-law tails. Our findings relax the requirement of hierarchical organization of the modular structure, which can help to rationalize the criticality of modular systems in the framework of GPs.

Spontaneous cortical activity is transiently poised close to criticality

Brain activity displays a large repertoire of dynamics across the sleep-wake cycle and even during anesthesia. It was suggested that criticality could serve as a unifying principle underlying the diversity of dynamics. This view has been supported by the observation of spontaneous bursts of cortical activity with scale-invariant sizes and durations, known as neuronal avalanches, in recordings of mesoscopic cortical signals. However, the existence of neuronal avalanches in spiking activity has been equivocal with studies reporting both its presence and absence. Here, we show that signs of criticality in spiking activity can change between synchronized and desynchronized cortical states. We analyzed the spontaneous activity in the primary visual cortex of the anesthetized cat and the awake monkey, and found that neuronal avalanches and thermodynamic indicators of criticality strongly depend on collective synchrony among neurons, LFP fluctuations, and behavioral state. We found that synchronized states are associated to criticality, large dynamical repertoire and prolonged epochs of eye closure, while desynchronized states are associated to sub-criticality, reduced dynamical repertoire, and eyes open conditions. Our results show that criticality in cortical dynamics is not stationary, but fluctuates during anesthesia and between different vigilance states.

Griffiths phase on hierarchical modular networks with small-world edges

The Griffiths phase has been proposed to induce a stretched critical regime that facilitates self-organizing of brain networks for optimal function. This phase stems from the intrinsic structural heterogeneity of brain networks, i.e., the hierarchical modular structure. In this work, the Griffiths phase is studied in modified hierarchical networks with small-world connections based on the 3-regular Hanoi network. Through extensive simulations, the hierarchical level-dependent inter-module wiring probabilities are identified to determine the emergence of the Griffiths phase. Numerical results and the complementary spectral analysis of the relevant networks can be helpful for a deeper understanding of the essential structural characteristics of finite-dimensional networks to support the Griffiths phase.

The exact Laplacian spectrum for the Dyson hierarchical network

We consider the Dyson hierarchical graph , that is a weighted fully-connected graph, where the pattern of weights is ruled by the parameter σ ∈ (1/2, 1]. Exploiting the deterministic recursivity through which is built, we are able to derive explicitly the whole set of the eigenvalues and the eigenvectors for its Laplacian matrix. Given that the Laplacian operator is intrinsically implied in the analysis of dynamic processes (e.g., random walks) occurring on the graph, as well as in the investigation of the dynamical properties of connected structures themselves (e.g., vibrational structures and relaxation modes), this result allows addressing analytically a large class of problems. In particular, as examples of applications, we study the random walk and the continuous-time quantum walk embedded in , the relaxation times of a polymer whose structure is described by , and the community structure of in terms of modularity measures.

Critical dynamics on a large human Open Connectome network

Extended numerical simulations of threshold models have been performed on a human brain network with N=836733 connected nodes available from the Open Connectome Project. While in the case of simple threshold models a sharp discontinuous phase transition without any critical dynamics arises, variable threshold models exhibit extended power-law scaling regions. This is attributed to fact that Griffiths effects, stemming from the topological or interaction heterogeneity of the network, can become relevant if the input sensitivity of nodes is equalized. I have studied the effects of link directness, as well as the consequence of inhibitory connections. Nonuniversal power-law avalanche size and time distributions have been found with exponents agreeing with the values obtained in electrode experiments of the human brain. The dynamical critical region occurs in an extended control parameter space without the assumption of self-organized criticality.

The topology of large Open Connectome networks for the human brain

The structural human connectome (i.e. the network of fiber connections in the brain) can be analyzed at ever finer spatial resolution thanks to advances in neuroimaging. Here we analyze several large data sets for the human brain network made available by the Open Connectome Project. We apply statistical model selection to characterize the degree distributions of graphs containing up to nodes and edges. A three-parameter generalized Weibull (also known as a stretched exponential) distribution is a good fit to most of the observed degree distributions. For almost all networks, simple power laws cannot fit the data, but in some cases there is statistical support for power laws with an exponential cutoff. We also calculate the topological (graph) dimension D and the small-world coefficient σ of these networks. While σ suggests a small-world topology, we found that D < 4 showing that long-distance connections provide only a small correction to the topology of the embedding three-dimensional space.

Majority-vote model on spatially embedded networks: Crossover from mean-field to Ising universality classes

We study through Monte Carlo simulations and finite-size scaling analysis the nonequilibrium phase transitions of the majority-vote model taking place on spatially embedded networks. These structures are built from an underlying regular lattice over which directed long-range connections are randomly added according to the probability P_{ij}∼r^{-α}, where r_{ij} is the Manhattan distance between nodes i and j, and the exponent α is a controlling parameter [J. M. Kleinberg, Nature (London) 406, 845 (2000)NATUAS0028-083610.1038/35022643]. Our results show that the collective behavior of this system exhibits a continuous order-disorder phase transition at a critical parameter, which is a decreasing function of the exponent α. Precisely, considering the scaling functions and the critical exponents calculated, we conclude that the system undergoes a crossover among distinct universality classes. For α≤3 the critical behavior is described by mean-field exponents, while for α≥4 it belongs to the Ising universality class. Finally, in the region where the crossover occurs, 3<α<4, the critical exponents are dependent on α.

Griffiths effects of the susceptible-infected-susceptible epidemic model on random power-law networks

We provide numerical evidence for slow dynamics of the susceptible-infected-susceptible model evolving on finite-size random networks with power-law degree distributions. Extensive simulations were done by averaging the activity density over many realizations of networks. We investigated the effects of outliers in both highly fluctuating (natural cutoff) and nonfluctuating (hard cutoff) most connected vertices. Logarithmic and power-law decays in time were found for natural and hard cutoffs, respectively. This happens in extended regions of the control parameter space λ(1)<λ<λ(2), suggesting Griffiths effects, induced by the topological inhomogeneities. Optimal fluctuation theory considering sample-to-sample fluctuations of the pseudothresholds is presented to explain the observed slow dynamics. A quasistationary analysis shows that response functions remain bounded at λ(2). We argue these to be signals of a smeared transition. However, in the thermodynamic limit the Griffiths effects loose their relevancy and have a conventional critical point at λ(c)=0. Since many real networks are composed by heterogeneous and weakly connected modules, the slow dynamics found in our analysis of independent and finite networks can play an important role for the deeper understanding of such systems.