Rich-club connectivity, diverse population coupling, and dynamical activity patterns emerging from local cortical circuits

Localist neural plasticity identified by mutual information

We present a model of pattern memory and retrieval with novel, technically useful and biologically realistic properties. Specifically, we enter n variations of k pattern classes (n*k patterns) onto a cortex-like balanced inhibitory-excitatory network with heterogeneous neurons, and let the pattern spread within the recurrent network. We show that we can identify high mutual-information (MI) neurons as major information-bearing elements within each pattern representation. We employ a simple one-shot adaptive (learning) process focusing on high MI neurons and inhibition. Such 'localist plasticity' has high efficiency, because it requires only few adaptations for each pattern. Specifically, we store k=10 patterns of size s=400 in a 1000/1200 neuron network. We stimulate high MI neurons and in this way recall patterns, such that the whole network represents this pattern. We assess the quality of the representation (a) before learning, when entering the pattern into a naive network, (b) after learning, on the adapted network, and (c) after recall by stimulation. The recalled patterns could be easily recognized by a trained classifier. The recalled pattern 'unfolds' over the recurrent network with high similarity to the original input pattern. We discuss the distribution of neuron properties in the network, and find that an initial Gaussian distribution changes into a more heavy-tailed, lognormal distribution during the adaptation process. The remarkable result is that we are able to achieve reliable pattern recall by stimulating only high information neurons. This work provides a biologically-inspired model of cortical memory and may have interesting technical applications.

Excitation-Inhibition Balance, Neural Criticality, and Activities in Neuronal Circuits

Neural activities in local circuits exhibit complex and multilevel dynamic features. Individual neurons spike irregularly, which is believed to originate from receiving balanced amounts of excitatory and inhibitory inputs, known as the excitation-inhibition balance. The spatial-temporal cascades of clustered neuronal spikes occur in variable sizes and durations, manifested as neural avalanches with scale-free features. These may be explained by the neural criticality hypothesis, which posits that neural systems operate around the transition between distinct dynamic states. Here, we summarize the experimental evidence for and the underlying theory of excitation-inhibition balance and neural criticality. Furthermore, we review recent studies of excitatory-inhibitory networks with synaptic kinetics as a simple solution to reconcile these two apparently distinct theories in a single circuit model. This provides a more unified understanding of multilevel neural activities in local circuits, from spontaneous to stimulus-response dynamics.

Moment neural network and an efficient numerical method for modeling irregular spiking activity

Continuous rate-based neural networks have been widely applied to modeling the dynamics of cortical circuits. However, cortical neurons in the brain exhibit irregular spiking activity with complex correlation structures that cannot be captured by mean firing rate alone. To close this gap, we consider a framework for modeling irregular spiking activity, called the moment neural network, which naturally generalizes rate models to second-order moments and can accurately capture the firing statistics of spiking neural networks. We propose an efficient numerical method that allows for rapid evaluation of moment mappings for neuronal activations without solving the underlying Fokker-Planck equation. This allows simulation of coupled interactions of mean firing rate and firing variability of large-scale neural circuits while retaining the advantage of analytical tractability of continuous rate models. We demonstrate how the moment neural network can explain a range of phenomena including diverse Fano factor in networks with quenched disorder and the emergence of irregular oscillatory dynamics in excitation-inhibition networks with delay.

Response inhibition in premotor cortex corresponds to a complex reshuffle of the mesoscopic information network

Recent studies have explored functional and effective neural networks in animal models; however, the dynamics of information propagation among functional modules under cognitive control remain largely unknown. Here, we addressed the issue using transfer entropy and graph theory methods on mesoscopic neural activities recorded in the dorsal premotor cortex of rhesus monkeys. We focused our study on the decision time of a Stop-signal task, looking for patterns in the network configuration that could influence motor plan maturation when the Stop signal is provided. When comparing trials with successful inhibition to those with generated movement, the nodes of the network resulted organized into four clusters, hierarchically arranged, and distinctly involved in information transfer. Interestingly, the hierarchies and the strength of information transmission between clusters varied throughout the task, distinguishing between generated movements and canceled ones and corresponding to measurable levels of network complexity. Our results suggest a putative mechanism for motor inhibition in premotor cortex: a topological reshuffle of the information exchanged among ensembles of neurons.

Distributed and dynamical communication: a mechanism for flexible cortico-cortical interactions and its functional roles in visual attention

Perceptual and cognitive processing relies on flexible communication among cortical areas; however, the underlying neural mechanism remains unclear. Here we report a mechanism based on the realistic spatiotemporal dynamics of propagating wave patterns in neural population activity. Using a biophysically plausible, multiarea spiking neural circuit model, we demonstrate that these wave patterns, characterized by their rich and complex dynamics, can account for a wide variety of empirically observed neural processes. The coordinated interactions of these wave patterns give rise to distributed and dynamic communication (DDC) that enables flexible and rapid routing of neural activity across cortical areas. We elucidate how DDC unifies the previously proposed oscillation synchronization-based and subspace-based views of interareal communication, offering experimentally testable predictions that we validate through the analysis of Allen Institute Neuropixels data. Furthermore, we demonstrate that DDC can be effectively modulated during attention tasks through the interplay of neuromodulators and cortical feedback loops. This modulation process explains many neural effects of attention, underscoring the fundamental functional role of DDC in cognition.

Sensory temporal sampling in time: an integrated model of the TSF and neural noise hypothesis as an etiological pathway for dyslexia

Much progress has been made in research on the causal mechanisms of developmental dyslexia. In recent years, the "temporal sampling" account of dyslexia has evolved considerably, with contributions from neurogenetics and novel imaging methods resulting in a much more complex etiological view of the disorder. The original temporal sampling framework implicates disrupted neural entrainment to speech as a causal factor for atypical phonological representations. Yet, empirical findings have not provided clear evidence of a low-level etiology for this endophenotype. In contrast, the neural noise hypothesis presents a theoretical view of the manifestation of dyslexia from the level of genes to behavior. However, its relative novelty (published in 2017) means that empirical research focused on specific predictions is sparse. The current paper reviews dyslexia research using a dual framework from the temporal sampling and neural noise hypotheses and discusses the complementary nature of these two views of dyslexia. We present an argument for an integrated model of sensory temporal sampling as an etiological pathway for dyslexia. Finally, we conclude with a brief discussion of outstanding questions.

Mutual generation in neuronal activity across the brain via deep neural approach, and its network interpretation

In the brain, many regions work in a network-like association, yet it is not known how durable these associations are in terms of activity and could survive without structural connections. To assess the association or similarity between brain regions with a generating approach, this study evaluated the similarity of activities of neurons within each region after disconnecting between regions. The "generation" approach here refers to using a multi-layer LSTM (Long Short-Term Memory) model to learn the rules of activity generation in one region and then apply that knowledge to generate activity in other regions. Surprisingly, the results revealed that activity generation from one region to disconnected regions was possible with similar accuracy to generation between the same regions in many cases. Notably, firing rates and synchronization of firing between neuron pairs, often used as neuronal representations, could be reproduced with precision. Additionally, accuracies were associated with the relative angle between brain regions and the strength of the structural connections that initially connected them. This outcome enables us to look into trends governing non-uniformity of the cortex based on the potential to generate informative data and reduces the need for animal experiments.

Fractional neural sampling as a theory of spatiotemporal probabilistic computations in neural circuits

A range of perceptual and cognitive processes have been characterized from the perspective of probabilistic representations and inference. To understand the neural circuit mechanism underlying these probabilistic computations, we develop a theory based on complex spatiotemporal dynamics of neural population activity. We first implement and explore this theory in a biophysically realistic, spiking neural circuit. Population activity patterns emerging from the circuit capture realistic variability or fluctuations of neural dynamics both in time and in space. These activity patterns implement a type of probabilistic computations that we name fractional neural sampling (FNS). We further develop a mathematical model to reveal the algorithmic nature of FNS and its computational advantages for representing multimodal distributions, a major challenge faced by existing theories. We demonstrate that FNS provides a unified account of a diversity of experimental observations of neural spatiotemporal dynamics and perceptual processes such as visual perception inference, and that FNS makes experimentally testable predictions.

Extended Anderson Criticality in Heavy-Tailed Neural Networks

We investigate the emergence of complex dynamics in networks with heavy-tailed connectivity by developing a non-Hermitian random matrix theory. We uncover the existence of an extended critical regime of spatially multifractal fluctuations between the quiescent and active phases. This multifractal critical phase combines features of localization and delocalization and differs from the edge of chaos in classical networks by the appearance of universal hallmarks of Anderson criticality over an extended region in phase space. We show that the rich nonlinear response properties of the extended critical regime can account for a variety of neural dynamics such as the diversity of timescales, providing a computational advantage for persistent classification in a reservoir setting.

A spatiotemporal mechanism of visual attention: Superdiffusive motion and theta oscillations of neural population activity patterns

Recent evidence has demonstrated that during visual spatial attention sampling, neural activity and behavioral performance exhibit large fluctuations. To understand the origin of these fluctuations and their functional role, here, we introduce a mechanism based on the dynamical activity pattern (attention spotlight) emerging from neural circuit models in the transition regime between different dynamical states. This attention activity pattern with rich spatiotemporal dynamics flexibly samples from different stimulus locations, explaining many key aspects of temporal fluctuations such as variable theta oscillations of visual spatial attention. Moreover, the mechanism expands our understanding of how visual attention exploits spatially complex fluctuations characterized by superdiffusive motion in space and makes experimentally testable predictions. We further illustrate that attention sampling based on such spatiotemporal fluctuations provides profound functional advantages such as adaptive switching between exploitation and exploration activities and is particularly efficient at sampling natural scenes with multiple salient objects.

Criticality enhances the multilevel reliability of stimulus responses in cortical neural networks

Cortical neural networks exhibit high internal variability in spontaneous dynamic activities and they can robustly and reliably respond to external stimuli with multilevel features–from microscopic irregular spiking of neurons to macroscopic oscillatory local field potential. A comprehensive study integrating these multilevel features in spontaneous and stimulus–evoked dynamics with seemingly distinct mechanisms is still lacking. Here, we study the stimulus–response dynamics of biologically plausible excitation–inhibition (E–I) balanced networks. We confirm that networks around critical synchronous transition states can maintain strong internal variability but are sensitive to external stimuli. In this dynamical region, applying a stimulus to the network can reduce the trial-to-trial variability and shift the network oscillatory frequency while preserving the dynamical criticality. These multilevel features widely observed in different experiments cannot simultaneously occur in non-critical dynamical states. Furthermore, the dynamical mechanisms underlying these multilevel features are revealed using a semi-analytical mean-field theory that derives the macroscopic network field equations from the microscopic neuronal networks, enabling the analysis by nonlinear dynamics theory and linear noise approximation. The generic dynamical principle revealed here contributes to a more integrative understanding of neural systems and brain functions and incorporates multimodal and multilevel experimental observations. The E–I balanced neural network in combination with the effective mean-field theory can serve as a mechanistic modeling framework to study the multilevel neural dynamics underlying neural information and cognitive processes.

The complexity and variability of brain dynamical activity range from neuronal spiking and neural avalanches to oscillatory local field potentials of local neural circuits in both spontaneous and stimulus-evoked states. Such multilevel variable brain dynamics are functionally and behaviorally relevant and are principal components of the underlying circuit organization. To more comprehensively clarify their neural mechanisms, we use a bottom-up approach to study the stimulus–response dynamics of neural circuits. Our model assumes the following key biologically plausible components: excitation–inhibition (E–I) neuronal interaction and chemical synaptic coupling. We show that the circuits with E–I balance have a special dynamic sub-region, the critical region. Circuits around this region could account for the emergence of multilevel brain response patterns, both ongoing and stimulus-induced, observed in different experiments, including the reduction of trial-to-trial variability, effective modulation of gamma frequency, and preservation of criticality in the presence of a stimulus. We further analyze the corresponding nonlinear dynamical principles using a novel and highly generalizable semi-analytical mean-field theory. Our computational and theoretical studies explain the cross-level brain dynamical organization of spontaneous and evoked states in a more integrative manner.

Lévy walk dynamics explain gamma burst patterns in primate cerebral cortex

Lévy walks describe patterns of intermittent motion with variable step sizes. In complex biological systems, Lévy walks (non-Brownian, superdiffusive random walks) are associated with behaviors such as search patterns of animals foraging for food. Here we show that Lévy walks also describe patterns of oscillatory activity in primate cerebral cortex. We used a combination of empirical observation and modeling to investigate high-frequency (gamma band) local field potential activity in visual motion-processing cortical area MT of marmoset monkeys. We found that gamma activity is organized as localized burst patterns that propagate across the cortical surface with Lévy walk dynamics. Lévy walks are fundamentally different from either global synchronization, or regular propagating waves, because they include large steps that enable activity patterns to move rapidly over cortical modules. The presence of Lévy walk dynamics therefore represents a previously undiscovered mode of brain activity, and implies a novel way for the cortex to compute. We apply a biophysically realistic circuit model to explain that the Lévy walk dynamics arise from critical-state transitions between asynchronous and localized propagating wave states, and that these dynamics yield optimal spatial sampling of the cortical sheet. We hypothesise that Lévy walk dynamics could help the cortex to efficiently process variable inputs, and to find links in patterns of activity among sparsely spiking populations of neurons.

Propagating wave activity in a tangential cortical slice

Propagating neural waves in the cerebral cortex influence the integration of incoming sensory information with ongoing cortical activity. However, the neural circuit elements that support these cortical waves remain to be fully defined. Here, a novel tangential slice preparation was developed that exhibited propagating wave activity across the dorsal cortical sheet, as assessed using autofluorescence imaging following focal electrical stimulation. Analysis of functional connectivity in the slice preparation with laser-scanning photostimulation via glutamate uncaging revealed a lack of short-latency, presumed monosynaptic, long-range connections (>300 μm) in the slice preparation. These results establish a novel slice preparation for assessing cortical dynamics and support the proposition that interactions among local cortical elements are sufficient to enable widespread propagating wave activity.

Hopf Bifurcation in Mean Field Explains Critical Avalanches in Excitation-Inhibition Balanced Neuronal Networks: A Mechanism for Multiscale Variability

Cortical neural circuits display highly irregular spiking in individual neurons but variably sized collective firing, oscillations and critical avalanches at the population level, all of which have functional importance for information processing. Theoretically, the balance of excitation and inhibition inputs is thought to account for spiking irregularity and critical avalanches may originate from an underlying phase transition. However, the theoretical reconciliation of these multilevel dynamic aspects in neural circuits remains an open question. Herein, we study excitation-inhibition (E-I) balanced neuronal network with biologically realistic synaptic kinetics. It can maintain irregular spiking dynamics with different levels of synchrony and critical avalanches emerge near the synchronous transition point. We propose a novel semi-analytical mean-field theory to derive the field equations governing the network macroscopic dynamics. It reveals that the E-I balanced state of the network manifesting irregular individual spiking is characterized by a macroscopic stable state, which can be either a fixed point or a periodic motion and the transition is predicted by a Hopf bifurcation in the macroscopic field. Furthermore, by analyzing public data, we find the coexistence of irregular spiking and critical avalanches in the spontaneous spiking activities of mouse cortical slice in vitro, indicating the universality of the observed phenomena. Our theory unveils the mechanism that permits complex neural activities in different spatiotemporal scales to coexist and elucidates a possible origin of the criticality of neural systems. It also provides a novel tool for analyzing the macroscopic dynamics of E-I balanced networks and its relationship to the microscopic counterparts, which can be useful for large-scale modeling and computation of cortical dynamics.