Time-series thresholding and the definition of avalanche size

Thresholding Computing with Heterogeneous Integration of Memristive Kernel with Metal-Oxide-Semiconductor Capacitor for Temporal Data Analysis

Precise event detection within time-series data is increasingly critical, particularly in noisy environments. Reservoir computing, a robust computing method widely utilized with memristive devices, is efficient in processing temporal signals. However, it typically lacks intrinsic thresholding mechanisms essential for precise event detection. This study introduces a new approach by integrating two Pt/HfO2/TiN (PHT) memristors and one Ni/HfO2/n-Si (NHS) metal-oxide-semiconductor capacitor (2M1MOS) to implement a tunable thresholding function. The current-voltage nonlinearity of memristors combined with the capacitance-voltage nonlinearity of the capacitor forms the basis of the 2M1MOS kernel system. The proposed kernel hardware effectively records feature-specified information of the input signal onto the memristors through capacitive thresholding. In electrocardiogram analysis, the memristive response exhibited a more than ten-fold difference between arrhythmia and normal beats. In isolated spoken digit classification, the kernel achieved an error rate of only 0.7% by tuning thresholds for various time-specific conditions. The kernel is also applied to biometric authentication by extracting personal features using various threshold times, presenting more complex and multifaceted uses of heartbeats and voice data as bio-indicators. These demonstrations highlight the potential of thresholding computing in a memristive framework with heterogeneous integration.

Threshold crossing time theory for quasicycles with application to brain rhythms

The amplitude of a two-dimensional Ornstein-Uhlenbeck colored noise process evolves according to the one-dimensional Rayleigh process. This is a general model for the random amplitude fluctuations of a quasicycle, i.e., of a noise-induced oscillation around an equilibrium with complex eigenvalues in physical and biological systems. We consider the probability density of time intervals during which the amplitude is either below or above a fixed threshold. The statistics of such first return times (FRTs) are of particular interest in neuroscience to characterize brain rhythm power excursions known as bursts, as well as avalanches and other branching processes. In contrast with the density of first passage times computed using Fokker-Planck theory between a start point and a different endpoint, the density of FRTs is non-normalizable. A recently proposed technique reframes the problem using an expansion of the Fokker-Planck eigenfunctions along with a correction to the normalization. Analytical expressions for the FRT density for the Rayleigh process are shown to be in good agreement with those computed from numerical realizations over a wide range of parameters, both for trajectories above and below threshold. Special care is required to evaluate the theory above threshold due to the crowded roots of the Tricomi confluent hypergeometric function. The results provide insight into the statistics of threshold crossing times in quasicycles generally, and in the stochastic Wilson-Cowan neural equations in particular. Surprisingly, FRTs are governed by a single meta-parameter Δ given by the ratio of the noise strength and the linear stability coefficient. We find the universal property that the mean FRT is invariant to the ratio of threshold to sqrt[Δ]. The FRT density further exhibits exponential behavior over medium to long timescales, and mixtures of exponentials at shorter FRTs, thereby establishing the absence of strict power-law scaling in these threshold-crossing statistics.

The recovery of parabolic avalanches in spatially subsampled neuronal networks at criticality

Scaling relationships are key in characterizing complex systems at criticality. In the brain, they are evident in neuronal avalanches-scale-invariant cascades of neuronal activity quantified by power laws. Avalanches manifest at the cellular level as cascades of neuronal groups that fire action potentials simultaneously. Such spatiotemporal synchronization is vital to theories on brain function yet avalanche synchronization is often underestimated when only a fraction of neurons is observed. Here, we investigate biases from fractional sampling within a balanced network of excitatory and inhibitory neurons with all-to-all connectivity and critical branching process dynamics. We focus on how mean avalanche size scales with avalanche duration. For parabolic avalanches, this scaling is quadratic, quantified by the scaling exponent, χ = 2, reflecting rapid spatial expansion of simultaneous neuronal firing over short durations. However, in networks sampled fractionally, χ is significantly lower. We demonstrate that applying temporal coarse-graining and increasing a minimum threshold for coincident firing restores χ = 2, even when as few as 0.1% of neurons are sampled. This correction crucially depends on the network being critical and fails for near sub- and supercritical branching dynamics. Using cellular 2-photon imaging, our approach robustly identifies χ = 2 over a wide parameter regime in ongoing neuronal activity from frontal cortex of awake mice. In contrast, the common 'crackling noise' approach fails to determine χ under similar sampling conditions at criticality. Our findings overcome scaling bias from fractional sampling and demonstrate rapid, spatiotemporal synchronization of neuronal assemblies consistent with scale-invariant, parabolic avalanches at criticality.

The recovery of parabolic avalanches in spatially subsampled neuronal networks at criticality

Scaling relationships are key in characterizing complex systems at criticality. In the brain, they are evident in neuronal avalanches-scale-invariant cascades of neuronal activity quantified by power laws. Avalanches manifest at the cellular level as cascades of neuronal groups that fire action potentials simultaneously. Such spatiotemporal synchronization is vital to theories on brain function yet avalanche synchronization is often underestimated when only a fraction of neurons is observed. Here, we investigate biases from fractional sampling within a balanced network of excitatory and inhibitory neurons with all-to-all connectivity and critical branching process dynamics. We focus on how mean avalanche size scales with avalanche duration. For parabolic avalanches, this scaling is quadratic, quantified by the scaling exponent, χ = 2 , reflecting rapid spatial expansion of simultaneous neuronal firing over short durations. However, in networks sampled fractionally, χ is significantly lower. We demonstrate that applying temporal coarse-graining and increasing a minimum threshold for coincident firing restores χ = 2 , even when as few as 0.1% of neurons are sampled. This correction crucially depends on the network being critical and fails for near sub- and supercritical branching dynamics. Using cellular 2-photon imaging, our approach robustly identifies χ = 2 over a wide parameter regime in ongoing neuronal activity from frontal cortex of awake mice. In contrast, the common 'crackling noise' approach fails to determine χ under similar sampling conditions at criticality. Our findings overcome scaling bias from fractional sampling and demonstrate rapid, spatiotemporal synchronization of neuronal assemblies consistent with scale-invariant, parabolic avalanches at criticality.

Neuronal avalanche dynamics regulated by spike-timing-dependent plasticity under different topologies and heterogeneities

Neuronal avalanches, a critical state of network self-organization, have been widely observed in electrophysiological records at different signal levels and spatial scales of the brain, which has significant influence on information transmission and processing in the brain. In this paper, the collective behavior of neuron firing is studied based on Leaky Integrate-and-Fire model and we induce spike-timing-dependent plasticity (STDP) to update the connection weight through competition between adjacent neurons in different network topologies. The result shows that STDP can facilitate the synchronization of the network and increase the probability of large-scale neuron avalanche obviously. Moreover, both the structure of STDP and network connection density can affect the generation of avalanche critical states, specifically, learning rate has positive correlation effect on the slope of power-law distribution and time constant has negative correction on it. However, when we the increase of heterogeneity in network, STDP can only has obvious promotion in synchrony under suitable level of heterogeneity. And we find that the process of long-term potentiation is sensitive to the adjustment of time constant and learning rate, unlike long-term depression, which is only sensitive to learning rate in heterogeneity network. It is suggested that presented results could facilitate our understanding on synchronization in various neural networks under the effect of STDP learning rules.

Spatial-Temporal Analysis of Neural Desynchronization in Sleeplike States Reveals Critical Dynamics

Sleep is characterized by nonrapid eye movement sleep, originating from widespread neuronal synchrony, and rapid eye movement sleep, with neuronal desynchronization akin to waking behavior. While these were thought to be global brain states, recent research suggests otherwise. Using time-frequency analysis of mesoscopic voltage-sensitive dye recordings of mice in a urethane-anesthetized model of sleep, we find transient neural desynchronization occurring heterogeneously across the cortex within a background of synchronized neural activity, in a manner reminiscent of a critical spreading process and indicative of an "edge-of-synchronization" phase transition.

Low-dimensional criticality embedded in high-dimensional awake brain dynamics

Whether cortical neurons operate in a strongly or weakly correlated dynamical regime determines fundamental information processing capabilities and has fueled decades of debate. We offer a resolution of this debate; we show that two important dynamical regimes, typically considered incompatible, can coexist in the same local cortical circuit by separating them into two different subspaces. In awake mouse motor cortex, we find a low-dimensional subspace with large fluctuations consistent with criticality-a dynamical regime with moderate correlations and multi-scale information capacity and transmission. Orthogonal to this critical subspace, we find a high-dimensional subspace containing a desynchronized dynamical regime, which may optimize input discrimination. The critical subspace is apparent only at long timescales, which explains discrepancies among some previous studies. Using a computational model, we show that the emergence of a low-dimensional critical subspace at large timescales agrees with established theory of critical dynamics. Our results suggest that the cortex leverages its high dimensionality to multiplex dynamical regimes across different subspaces.

Parabolic avalanche scaling in the synchronization of cortical cell assemblies

Neurons in the cerebral cortex fire coincident action potentials during ongoing activity and in response to sensory inputs. These synchronized cell assemblies are fundamental to cortex function, yet basic dynamical aspects of their size and duration are largely unknown. Using 2-photon imaging of neurons in the superficial cortex of awake mice, we show that synchronized cell assemblies organize as scale-invariant avalanches that quadratically grow with duration. The quadratic avalanche scaling was only found for correlated neurons, required temporal coarse-graining to compensate for spatial subsampling of the imaged cortex, and suggested cortical dynamics to be critical as demonstrated in simulations of balanced E/I-networks. The corresponding time course of an inverted parabola with exponent of χ = 2 described cortical avalanches of coincident firing for up to 5 s duration over an area of 1 mm². These parabolic avalanches maximized temporal complexity in the ongoing activity of prefrontal and somatosensory cortex and in visual responses of primary visual cortex. Our results identify a scale-invariant temporal order in the synchronization of highly diverse cortical cell assemblies in the form of parabolic avalanches.

Sampling effects and measurement overlap can bias the inference of neuronal avalanches

To date, it is still impossible to sample the entire mammalian brain with single-neuron precision. This forces one to either use spikes (focusing on few neurons) or to use coarse-sampled activity (averaging over many neurons, e.g. LFP). Naturally, the sampling technique impacts inference about collective properties. Here, we emulate both sampling techniques on a simple spiking model to quantify how they alter observed correlations and signatures of criticality. We describe a general effect: when the inter-electrode distance is small, electrodes sample overlapping regions in space, which increases the correlation between the signals. For coarse-sampled activity, this can produce power-law distributions even for non-critical systems. In contrast, spike recordings do not suffer this particular bias and underlying dynamics can be identified. This may resolve why coarse measures and spikes have produced contradicting results in the past.

Finite-size correlation behavior near a critical point: A simple metric for monitoring the state of a neural network

In this article, a correlation metric κ_{c} is proposed for the inference of the dynamical state of neuronal networks. κ_{C} is computed from the scaling of the correlation length with the size of the observation region, which shows qualitatively different behavior near and away from the critical point of a continuous phase transition. The implementation is first studied on a neuronal network model, where the results of this new metric coincide with those obtained from neuronal avalanche analysis, thus well characterizing the critical state of the network. The approach is further tested with brain optogenetic recordings in behaving mice from a publicly available database. Potential applications and limitations for its use with currently available optical imaging techniques are discussed.

Theoretical foundations of studying criticality in the brain

Criticality is hypothesized as a physical mechanism underlying efficient transitions between cortical states and remarkable information-processing capacities in the brain. While considerable evidence generally supports this hypothesis, nonnegligible controversies persist regarding the ubiquity of criticality in neural dynamics and its role in information processing. Validity issues frequently arise during identifying potential brain criticality from empirical data. Moreover, the functional benefits implied by brain criticality are frequently misconceived or unduly generalized. These problems stem from the nontriviality and immaturity of the physical theories that analytically derive brain criticality and the statistic techniques that estimate brain criticality from empirical data. To help solve these problems, we present a systematic review and reformulate the foundations of studying brain criticality, that is, ordinary criticality (OC), quasi-criticality (qC), self-organized criticality (SOC), and self-organized quasi-criticality (SOqC), using the terminology of neuroscience. We offer accessible explanations of the physical theories and statistical techniques of brain criticality, providing step-by-step derivations to characterize neural dynamics as a physical system with avalanches. We summarize error-prone details and existing limitations in brain criticality analysis and suggest possible solutions. Moreover, we present a forward-looking perspective on how optimizing the foundations of studying brain criticality can deepen our understanding of various neuroscience questions.

Addressing skepticism of the critical brain hypothesis

The hypothesis that living neural networks operate near a critical phase transition point has received substantial discussion. This “criticality hypothesis” is potentially important because experiments and theory show that optimal information processing and health are associated with operating near the critical point. Despite the promise of this idea, there have been several objections to it. While earlier objections have been addressed already, the more recent critiques of Touboul and Destexhe have not yet been fully met. The purpose of this paper is to describe their objections and offer responses. Their first objection is that the well-known Brunel model for cortical networks does not display a peak in mutual information near its phase transition, in apparent contradiction to the criticality hypothesis. In response I show that it does have such a peak near the phase transition point, provided it is not strongly driven by random inputs. Their second objection is that even simple models like a coin flip can satisfy multiple criteria of criticality. This suggests that the emergent criticality claimed to exist in cortical networks is just the consequence of a random walk put through a threshold. In response I show that while such processes can produce many signatures criticality, these signatures (1) do not emerge from collective interactions, (2) do not support information processing, and (3) do not have long-range temporal correlations. Because experiments show these three features are consistently present in living neural networks, such random walk models are inadequate. Nevertheless, I conclude that these objections have been valuable for refining research questions and should always be welcomed as a part of the scientific process.

Effect of thresholding on avalanches and their clustering for interfaces with long-range elasticity

Avalanches are often defined as signals higher than some detection level in bursty systems. The choice of the detection threshold affects the number of avalanches, but it can also affect their temporal correlations. We simulated the depinning of a long-range elastic interface and applied different thresholds including a zero one on the data to see how the sizes and durations of events change and how this affects temporal avalanche clustering. Higher thresholds result in steeper size and duration distributions and cause the avalanches to cluster temporally. Using methods from seismology, the frequency of the events in the clusters was found to decrease as a power-law of time, and the size of an event in a cluster was found to help predict how many events it is followed by. The results bring closer theoretical studies of this class of models to real experiments, but also highlight how different phenomena can be obtained from the same set of data.

Neuronal Population Transitions Across a Quiescent-to-Active Frontier and Bifurcation

The mechanistic understanding of why neuronal population activity hovers on criticality remains unresolved despite the availability of experimental results. Without a coherent mathematical framework, the presence of power-law scaling is not straightforward to reconcile with findings implying epileptiform activity. Although multiple pictures have been proposed to relate the power-law scaling of avalanche statistics to phase transitions, the existence of a phase boundary in parameter space is until now an assumption. Herein, a framework based on differential inclusions, which departs from approaches constructed from differential equations, is shown to offer an adequate consolidation of evidences apparently connected to criticality and those linked to hyperexcitability. Through this framework, the phase boundary is elucidated in a parameter space spanned by variables representing levels of excitation and inhibition in a neuronal network. The interpretation of neuronal populations based on this approach offers insights on the role of pharmacological and endocrinal signaling in the homeostatic regulation of neuronal population activity.

Critical behaviour of the stochastic Wilson-Cowan model

Spontaneous brain activity is characterized by bursts and avalanche-like dynamics, with scale-free features typical of critical behaviour. The stochastic version of the celebrated Wilson-Cowan model has been widely studied as a system of spiking neurons reproducing non-trivial features of the neural activity, from avalanche dynamics to oscillatory behaviours. However, to what extent such phenomena are related to the presence of a genuine critical point remains elusive. Here we address this central issue, providing analytical results in the linear approximation and extensive numerical analysis. In particular, we present results supporting the existence of a bona fide critical point, where a second-order-like phase transition occurs, characterized by scale-free avalanche dynamics, scaling with the system size and a diverging relaxation time-scale. Moreover, our study shows that the observed critical behaviour falls within the universality class of the mean-field branching process, where the exponents of the avalanche size and duration distributions are, respectively, 3/2 and 2. We also provide an accurate analysis of the system behaviour as a function of the total number of neurons, focusing on the time correlation functions of the firing rate in a wide range of the parameter space.

Neuronal Avalanches Across the Rat Somatosensory Barrel Cortex and the Effect of Single Whisker Stimulation

Since its first experimental signatures, the so called "critical brain hypothesis" has been extensively studied. Yet, its actual foundations remain elusive. According to a widely accepted teleological reasoning, the brain would be poised to a critical state to optimize the mapping of the noisy and ever changing real-world inputs, thus suggesting that primary sensory cortical areas should be critical. We investigated whether a single barrel column of the somatosensory cortex of the anesthetized rat displays a critical behavior. Neuronal avalanches were recorded across all cortical layers in terms of both multi-unit activities and population local field potentials, and their behavior during spontaneous activity compared to the one evoked by a controlled single whisker deflection. By applying a maximum likelihood statistical method based on timeseries undersampling to fit the avalanches distributions, we show that neuronal avalanches are power law distributed for both multi-unit activities and local field potentials during spontaneous activity, with exponents that are spread along a scaling line. Instead, after the tactile stimulus, activity switches to a transient across-layers synchronization mode that appears to dominate the cortical representation of the single sensory input.

Long-term stability of avalanche scaling and integrative network organization in prefrontal and premotor cortex

Ongoing neuronal activity in the brain establishes functional networks that reflect normal and pathological brain function. Most estimates of these functional networks suffer from low spatiotemporal resolution and indirect measures of neuronal population activity, limiting the accuracy and reliability in their reconstruction over time. Here, we studied the stability of neuronal avalanche dynamics and corresponding reconstructed functional networks in the adult brain. Using chronically implanted high-density microelectrode arrays, the local field potential (LFP) of resting-state activity was recorded in prefrontal and premotor cortex of awake nonhuman primates. Avalanche dynamics revealed stable scaling exhibiting an inverted parabolic profile and collapse exponent of 2 in line with a critical branching process over many days and weeks. Functional networks were based on a Bayesian-derived estimator and demonstrated stable integrative properties characterized by nontrivial high neighborhood overlap between strongly connected nodes and robustness to weak-link pruning. Entropy-based mixing analysis revealed significant changes in strong link weights over weeks. The long-term stability in avalanche scaling and integrative network organization in the face of individual link weight changes should support the development of noninvasive biomarkers to characterize normal and abnormal brain states in the adult brain.

The brain is spontaneously active even in the absence of specific sensations or movements. This ongoing activity arises from the interactions among hundreds of thousands of neurons, which has been captured by a variety of distinct functional networks predictive of healthy and pathological brain functions. The global dynamical states and overarching network principles that underlie such ongoing brain activity are not well understood. Here we identify avalanche dynamics and “friendship” networks as two major features of ongoing activity in the frontal cortex of nonhuman primates. We demonstrate their stability over weeks in the face of local network changes. Deviation from avalanche dynamics and “friendship” organization might provide robust biomarkers to identify normal and pathological brain states.

Robust cortical criticality and diverse dynamics resulting from functional specification

Despite the recognition of the layered structure and evident criticality in the cortex, how the specification of input, output, and computational layers affects the self-organized criticality has not been much explored. By constructing heterogeneous structures with a well-accepted model of leaky neurons, we find that the specification can lead to robust criticality rather insensitive to the strength of external stimuli. This naturally unifies the adaptation to strong inputs without extra synaptic plasticity mechanisms. Low degree of recurrence constitutes an alternative explanation to subcriticality other than the high-frequency inputs. Unlike fully recurrent networks where external stimuli always render subcriticality, the dynamics of networks with sufficient feedforward connections can be driven to criticality and supercriticality. These findings indicate that functional and structural specification and their interplay with external stimuli are of crucial importance for the network dynamics. The robust criticality puts forward networks of the leaky neurons as promising platforms for realizing artificial neural networks that work in the vicinity of critical points.

Percolation theory of self-exciting temporal processes

We investigate how the properties of inhomogeneous patterns of activity, appearing in many natural and social phenomena, depend on the temporal resolution used to define individual bursts of activity. To this end, we consider time series of microscopic events produced by a self-exciting Hawkes process, and leverage a percolation framework to study the formation of macroscopic bursts of activity as a function of the resolution parameter. We find that the very same process may result in different distributions of avalanche size and duration, which are understood in terms of the competition between the 1D percolation and the branching process universality class. Pure regimes for the individual classes are observed at specific values of the resolution parameter corresponding to the critical points of the percolation diagram. A regime of crossover characterized by a mixture of the two universal behaviors is observed in a wide region of the diagram. The hybrid scaling appears to be a likely outcome for an analysis of the time series based on a reasonably chosen, but not precisely adjusted, value of the resolution parameter.

Fractional re-distribution among cell motility states during ageing

Ageing in humans is associated with the decreased capacity to regulate cell physiology. Cellular properties, such as cell morphology and mechanics, encode ageing information, and can therefore be used as robust biomarkers of ageing. Using a panel of dermal fibroblasts derived from healthy donors spanning a wide age range, we observe an age-associated decrease in cell motility. By taking advantage of the single-cell nature of our motility data, we classified cells based on spatial and activity patterns to define age-dependent motility states. We show that the age-dependent decrease in cell motility is not due to the reduced motility of all cells, but results from the fractional re-distribution among motility states. These findings highlight an important feature of ageing cells characterized by a reduction of cellular heterogeneity in older adults relative to post-adolescent/adults. Furthermore, these results point to a mechanistic framework of ageing, with potential applications in deciphering emergent ageing phenotypes and biomarker development.