Cortical computations via metastable activity

Development of brain metastable dynamics during the equivalent of the third gestational trimester

Metastability, a concept from dynamical systems theory, provides a framework for understanding how the brain shifts between various functional states and underpins essential cognitive, behavioural, and social function. While studied in adults, metastability in early brain development has only received recent attention. As the brain undergoes dramatic functional and structural changes over the third gestational trimester, here we review how these are reflected in changes in brain metastable dynamics in preterm, preterm at term-equivalent and full-term neonates. We synthesize findings from EEG, fMRI, fUS, and computational models, focusing on the spatial distribution and temporal dynamics of metastable states, which include functional integration and segregation, signal predictability and complexity. Despite fragmented evidence, studies suggest that neonatal metastability develops over the equivalent of the third gestational trimester, with increasing ability for integration-segregation, broader range of metastable states, faster metastable state transitions and greater signal complexity. Preterms at term-equivalent age exhibit immature metastability features compared to full-terms. We explain and interpret these changes in terms of maturation of the brain in a free energy landscape and establishment of cognitive functions.

Metastability in the wild: A scoping review of empirical neuroimaging studies in humans

Metastability is proposed as the mechanism supporting our adaptive responses to the environment. While extensive research has characterized brain metastability during rest and task performance, prior studies have mainly focused on understanding underlying mechanisms, with limited exploration of its application in mental processes and behaviors. This scoping review offers an overview of the existing empirical literature in this area. Through a systematic search that included 36 articles, our results reveal a predominance of resting-state fMRI studies, variability in how metastability is defined, and a lack of consideration for common confounds in neuroimaging data. The review concludes with suggestions for future research directions to address crucial unresolved issues in the field.

Deciphering neuronal variability across states reveals dynamic sensory encoding

Influenced by non-stationary factors such as brain states and behavior, neurons exhibit substantial response variability even to identical stimuli. However, it remains unclear how their relative impact on neuronal variability evolves over time. To address this question, we designed an encoding model conditioned on latent states to partition variability in the mouse visual cortex across internal brain dynamics, behavior, and external visual stimulus. Applying a hidden Markov model to local field potentials, we consistently identified three distinct oscillation states, each with a unique variability profile. Regression models within each state revealed a dynamic composition of factors influencing spiking variability, with the dominant factor switching within seconds. The state-conditioned regression model uncovered extensive diversity in source contributions across units, varying in accordance with anatomical hierarchy and internal state. This heterogeneity in encoding underscores the importance of partitioning variability over time, particularly when considering the influence of non-stationary factors on sensory processing.

Dynamical properties and mechanisms of metastability: A perspective in neuroscience

Metastability, characterized by a variability of regimes in time, is a ubiquitous type of neural dynamics. It has been formulated in many different ways in the neuroscience literature, however, which may cause some confusion. In this Perspective, we discuss metastability from the point of view of dynamical systems theory. We extract from the literature a very simple but general definition through the concept of metastable regimes as long-lived but transient epochs of activity with unique dynamical properties. This definition serves as an umbrella term that encompasses formulations from other works, and readily connects to concepts from dynamical systems theory. This allows us to examine general dynamical properties of metastable regimes, propose in a didactic manner several dynamics-based mechanisms that generate them, and discuss a theoretical tool to characterize them quantitatively. This Perspective leads to insights that help to address issues debated in the literature and also suggests pathways for future research.

Metastability demystified - the foundational past, the pragmatic present and the promising future

Healthy brain function depends on balancing stable integration between brain areas for effective coordinated functioning, with coexisting segregation that allows subsystems to express their functional specialization. Metastability, a concept from the dynamical systems literature, has been proposed as a key signature that characterizes this balance. Building on this principle, the neuroscience literature has leveraged the phenomenon of metastability to investigate various aspects of brain function in health and disease. However, this body of work often uses the notion of metastability heuristically, and sometimes inaccurately, making it difficult to navigate the vast literature, interpret findings and foster further development of theoretical and experimental methodologies. Here, we provide a comprehensive review of metastability and its applications in neuroscience, covering its scientific and historical foundations and the practical measures used to assess it in empirical data. We also provide a critical analysis of recent theoretical developments, clarifying common misconceptions and paving the road for future developments.

A sticky Poisson Hidden Markov Model for solving the problem of over-segmentation and rapid state switching in cortical datasets

The application of hidden Markov models (HMMs) to neural data has uncovered hidden states and signatures of neural dynamics that are relevant for sensory and cognitive processes. However, training an HMM on cortical data requires a careful handling of model selection, since models with more numerous hidden states generally have a higher likelihood on new (unseen) data. A potentially related problem is the occurrence of very rapid state switching after decoding the data with an HMM. The first problem can lead to overfitting and over-segmentation of the data. The second problem is due to intermediate-to-low self-transition probabilities and is at odds with many reports that hidden states in cortex tend to last from hundred of milliseconds to seconds. Here, we show that we can alleviate both problems by regularizing a Poisson-HMM during training so as to enforce large self-transition probabilities. We call this algorithm the 'sticky Poisson-HMM' (sPHMM). When used together with the Bayesian Information Criterion for model selection, the sPHMM successfully eliminates rapid state switching, outperforming an alternative strategy based on an HMM with a large prior on the self-transition probabilities. The sPHMM also captures the ground truth in surrogate datasets built to resemble the statistical properties of the experimental data.

Metastability in networks of nonlinear stochastic integrate-and-fire neurons

Neurons in the brain continuously process the barrage of sensory inputs they receive from the environment. A wide array of experimental work has shown that the collective activity of neural populations encodes and processes this constant bombardment of information. How these collective patterns of activity depend on single-neuron properties is often unclear. Single-neuron recordings have shown that individual neurons' responses to inputs are nonlinear, which prevents a straight-forward extrapolation from single neuron features to emergent collective states. Here, we use a field-theoretic formulation of a stochastic leaky integrate-and-fire model to study the impact of single-neuron nonlinearities on macroscopic network activity. In this model, a neuron integrates spiking output from other neurons in its membrane voltage and emits spikes stochastically with an intensity depending on the membrane voltage, after which the voltage resets. We show that the interplay between nonlinear spike intensity functions and membrane potential resets can i) give rise to metastable active firing rate states in recurrent networks, and ii) can enhance or suppress mean firing rates and membrane potentials in the same or paradoxically opposite directions.

Multiple-timescale dynamics, mixed mode oscillations and mixed affective states in a model of bipolar disorder

Mixed affective states in bipolar disorder (BD) is a common psychiatric condition that occurs when symptoms of the two opposite poles coexist during an episode of mania or depression. A four-dimensional model by Goldbeter (Progr Biophys Mol Biol 105:119-127, 2011; Pharmacopsychiatry 46:S44-S52, 2013) rests upon the notion that manic and depressive symptoms are produced by two competing and auto-inhibited neural networks. Some of the rich dynamics that this model can produce, include complex rhythms formed by both small-amplitude (subthreshold) and large-amplitude (suprathreshold) oscillations and could correspond to mixed bipolar states. These rhythms are commonly referred to as mixed mode oscillations (MMOs) and they have already been studied in many different contexts by Bertram (Mathematical analysis of complex cellular activity, Springer, Cham, 2015), (Petrov et al. in J Chem Phys 97:6191-6198, 1992). In order to accurately explain these dynamics one has to apply a mathematical apparatus that makes full use of the timescale separation between variables. Here we apply the framework of multiple-timescale dynamics to the model of BD in order to understand the mathematical mechanisms underpinning the observed dynamics of changing mood. We show that the observed complex oscillations can be understood as MMOs due to a so-called folded-node singularity. Moreover, we explore the bifurcation structure of the system and we provide possible biological interpretations of our findings. Finally, we show the robustness of the MMOs regime to stochastic noise and we propose a minimal three-dimensional model which, with the addition of noise, exhibits similar yet purely noise-driven dynamics. The broader significance of this work is to introduce mathematical tools that could be used to analyse and potentially control future, more biologically grounded models of BD.

Robustly encoding certainty in a metastable neural circuit model

Localized persistent neural activity can encode delayed estimates of continuous variables. Common experiments require that subjects store and report the feature value (e.g., orientation) of a particular cue (e.g., oriented bar on a screen) after a delay. Visualizing recorded activity of neurons along their feature tuning reveals activity bumps whose centers wander stochastically, degrading the estimate over time. Bump position therefore represents the remembered estimate. Recent work suggests bump amplitude may represent estimate certainty reflecting a probabilistic population code for a Bayesian posterior. Idealized models of this type are fragile due to the fine tuning common to constructed continuum attractors in dynamical systems. Here we propose an alternative metastable model for robustly supporting multiple bump amplitudes by extending neural circuit models to include quantized nonlinearities. Asymptotic projections of circuit activity produce low-dimensional evolution equations for the amplitude and position of bump solutions in response to external stimuli and noise perturbations. Analysis of reduced equations accurately characterizes phase variance and the dynamics of amplitude transitions between stable discrete values. More salient cues generate bumps of higher amplitude which wander less, consistent with experiments showing certainty correlates with more accurate memories.

Spiking attractor model of motor cortex explains modulation of neural and behavioral variability by prior target information

When preparing a movement, we often rely on partial or incomplete information, which can decrement task performance. In behaving monkeys we show that the degree of cued target information is reflected in both, neural variability in motor cortex and behavioral reaction times. We study the underlying mechanisms in a spiking motor-cortical attractor model. By introducing a biologically realistic network topology where excitatory neuron clusters are locally balanced with inhibitory neuron clusters we robustly achieve metastable network activity across a wide range of network parameters. In application to the monkey task, the model performs target-specific action selection and accurately reproduces the task-epoch dependent reduction of trial-to-trial variability in vivo where the degree of reduction directly reflects the amount of processed target information, while spiking irregularity remained constant throughout the task. In the context of incomplete cue information, the increased target selection time of the model can explain increased behavioral reaction times. We conclude that context-dependent neural and behavioral variability is a signum of attractor computation in the motor cortex.

Co-existence of synaptic plasticity and metastable dynamics in a spiking model of cortical circuits

Evidence for metastable dynamics and its role in brain function is emerging at a fast pace and is changing our understanding of neural coding by putting an emphasis on hidden states of transient activity. Clustered networks of spiking neurons have enhanced synaptic connections among groups of neurons forming structures called cell assemblies; such networks are capable of producing metastable dynamics that is in agreement with many experimental results. However, it is unclear how a clustered network structure producing metastable dynamics may emerge from a fully local plasticity rule, i.e., a plasticity rule where each synapse has only access to the activity of the neurons it connects (as opposed to the activity of other neurons or other synapses). Here, we propose a local plasticity rule producing ongoing metastable dynamics in a deterministic, recurrent network of spiking neurons. The metastable dynamics co-exists with ongoing plasticity and is the consequence of a self-tuning mechanism that keeps the synaptic weights close to the instability line where memories are spontaneously reactivated. In turn, the synaptic structure is stable to ongoing dynamics and random perturbations, yet it remains sufficiently plastic to remap sensory representations to encode new sets of stimuli. Both the plasticity rule and the metastable dynamics scale well with network size, with synaptic stability increasing with the number of neurons. Overall, our results show that it is possible to generate metastable dynamics over meaningful hidden states using a simple but biologically plausible plasticity rule which co-exists with ongoing neural dynamics.

Nondifferentiable activity in the brain

Spike raster plots of numerous neurons show vertical stripes, indicating that neurons exhibit synchronous activity in the brain. We seek to determine whether these coherent dynamics are caused by smooth brainwave activity or by something else. By analyzing biological data, we find that their cross-correlograms exhibit not only slow undulation but also a cusp at the origin, in addition to possible signs of monosynaptic connectivity. Here we show that undulation emerges if neurons are subject to smooth brainwave oscillations while a cusp results from nondifferentiable fluctuations. While modern analysis methods have achieved good connectivity estimation by adapting the models to slow undulation, they still make false inferences due to the cusp. We devise a new analysis method that may solve both problems. We also demonstrate that oscillations and nondifferentiable fluctuations may emerge in simulations of large-scale neural networks.

Co-existence of synaptic plasticity and metastable dynamics in a spiking model of cortical circuits

Evidence for metastable dynamics and its role in brain function is emerging at a fast pace and is changing our understanding of neural coding by putting an emphasis on hidden states of transient activity. Clustered networks of spiking neurons have enhanced synaptic connections among groups of neurons forming structures called cell assemblies; such networks are capable of producing metastable dynamics that is in agreement with many experimental results. However, it is unclear how a clustered network structure producing metastable dynamics may emerge from a fully local plasticity rule, i.e., a plasticity rule where each synapse has only access to the activity of the neurons it connects (as opposed to the activity of other neurons or other synapses). Here, we propose a local plasticity rule producing ongoing metastable dynamics in a deterministic, recurrent network of spiking neurons. The metastable dynamics co-exists with ongoing plasticity and is the consequence of a self-tuning mechanism that keeps the synaptic weights close to the instability line where memories are spontaneously reactivated. In turn, the synaptic structure is stable to ongoing dynamics and random perturbations, yet it remains sufficiently plastic to remap sensory representations to encode new sets of stimuli. Both the plasticity rule and the metastable dynamics scale well with network size, with synaptic stability increasing with the number of neurons. Overall, our results show that it is possible to generate metastable dynamics over meaningful hidden states using a simple but biologically plausible plasticity rule which co-exists with ongoing neural dynamics.

Neural correlates of rapid familiarization to novel taste

The gustatory cortex (GC) plays a pivotal role in taste perception, with neural ensemble responses reflecting taste quality and influencing behavior. Recent work, however, has shown that GC taste responses change across sessions of novel taste exposure in taste-naïve rats. Here, we use single-trial analyses to explore changes in the cortical taste-code on the scale of individual trials. Contrary to the traditional view of taste perception as innate, our findings suggest rapid, experience-dependent changes in GC responses during initial taste exposure trials. Specifically, we find that early responses to novel taste are less "stereotyped" and encode taste identity less reliably compared to later responses. These changes underscore the dynamic nature of sensory processing and provides novel insights into the real-time dynamics of sensory processing across novel-taste familiarization.

Learning enhances representations of taste-guided decisions in the mouse gustatory insular cortex

Learning to discriminate overlapping gustatory stimuli that predict distinct outcomes-a feat known as discrimination learning-can mean the difference between ingesting a poison or a nutritive meal. Despite the obvious importance of this process, very little is known about the neural basis of taste discrimination learning. In other sensory modalities, this form of learning can be mediated by either the sharpening of sensory representations or the enhanced ability of "decision-making" circuits to interpret sensory information. Given the dual role of the gustatory insular cortex (GC) in encoding both sensory and decision-related variables, this region represents an ideal site for investigating how neural activity changes as animals learn a novel taste discrimination. Here, we present results from experiments relying on two-photon calcium imaging of GC neural activity in mice performing a taste-guided mixture discrimination task. The task allows for the recording of neural activity before and after learning induced by training mice to discriminate increasingly similar pairs of taste mixtures. Single-neuron and population analyses show a time-varying pattern of activity, with early sensory responses emerging after taste delivery and binary, choice-encoding responses emerging later in the delay before a decision is made. Our results demonstrate that, while both sensory and decision-related information is encoded by GC in the context of a taste mixture discrimination task, learning and improved performance are associated with a specific enhancement of decision-related responses.

Modulation of metastable ensemble dynamics explains optimal coding at moderate arousal in auditory cortex

Performance during perceptual decision-making exhibits an inverted-U relationship with arousal, but the underlying network mechanisms remain unclear. Here, we recorded from auditory cortex (A1) of behaving mice during passive tone presentation, while tracking arousal via pupillometry. We found that tone discriminability in A1 ensembles was optimal at intermediate arousal, revealing a population-level neural correlate of the inverted-U relationship. We explained this arousal-dependent coding using a spiking network model with a clustered architecture. Specifically, we show that optimal stimulus discriminability is achieved near a transition between a multi-attractor phase with metastable cluster dynamics (low arousal) and a single-attractor phase (high arousal). Additional signatures of this transition include arousal-induced reductions of overall neural variability and the extent of stimulus-induced variability quenching, which we observed in the empirical data. Altogether, this study elucidates computational principles underlying interactions between pupil-linked arousal, sensory processing, and neural variability, and suggests a role for phase transitions in explaining nonlinear modulations of cortical computations.

Multistability in neural systems with random cross-connections

Neural circuits with multiple discrete attractor states could support a variety of cognitive tasks according to both empirical data and model simulations. We assess the conditions for such multistability in neural systems using a firing rate model framework, in which clusters of similarly responsive neurons are represented as single units, which interact with each other through independent random connections. We explore the range of conditions in which multistability arises via recurrent input from other units while individual units, typically with some degree of self-excitation, lack sufficient self-excitation to become bistable on their own. We find many cases of multistability-defined as the system possessing more than one stable fixed point-in which stable states arise via a network effect, allowing subsets of units to maintain each others' activity because their net input to each other when active is sufficiently positive. In terms of the strength of within-unit self-excitation and standard deviation of random cross-connections, the region of multistability depends on the response function of units. Indeed, multistability can arise with zero self-excitation, purely through zero-mean random cross-connections, if the response function rises supralinearly at low inputs from a value near zero at zero input. We simulate and analyze finite systems, showing that the probability of multistability can peak at intermediate system size, and connect with other literature analyzing similar systems in the infinite-size limit. We find regions of multistability with a bimodal distribution for the number of active units in a stable state. Finally, we find evidence for a log-normal distribution of sizes of attractor basins, which produces Zipf's Law when enumerating the proportion of trials within which random initial conditions lead to a particular stable state of the system.

Learning enhances representations of taste-guided decisions in the mouse gustatory insular cortex

Learning to discriminate overlapping gustatory stimuli that predict distinct outcomes - a feat known as discrimination learning - can mean the difference between ingesting a poison or a nutritive meal. Despite the obvious importance of this process, very little is known on the neural basis of taste discrimination learning. In other sensory modalities, this form of learning can be mediated by either sharpening of sensory representations, or enhanced ability of "decision-making" circuits to interpret sensory information. Given the dual role of the gustatory insular cortex (GC) in encoding both sensory and decision-related variables, this region represents an ideal site for investigating how neural activity changes as animals learn a novel taste discrimination. Here we present results from experiments relying on two photon calcium imaging of GC neural activity in mice performing a taste-guided mixture discrimination task. The task allows for recording of neural activity before and after learning induced by training mice to discriminate increasingly similar pairs of taste mixtures. Single neuron and population analyses show a time-varying pattern of activity, with early sensory responses emerging after taste delivery and binary, choice encoding responses emerging later in the delay before a decision is made. Our results demonstrate that while both sensory and decision-related information is encoded by GC in the context of a taste mixture discrimination task, learning and improved performance are associated with a specific enhancement of decision-related responses.

Computational modeling allows unsupervised classification of epileptic brain states across species

Current advances in epilepsy treatment aim to personalize and responsively adjust treatment parameters to overcome patient heterogeneity in treatment efficiency. For tailoring treatment to the individual and the current brain state, tools are required that help to identify the patient- and time-point-specific parameters of epilepsy. Computational modeling has long proven its utility in gaining mechanistic insight. Recently, the technique has been introduced as a diagnostic tool to predict individual treatment outcomes. In this article, the Wendling model, an established computational model of epilepsy dynamics, is used to automatically classify epileptic brain states in intracranial EEG from patients (n = 4) and local field potential recordings from in vitro rat data (high-potassium model of epilepsy, n = 3). Five-second signal segments are classified to four types of brain state in epilepsy (interictal, preonset, onset, ictal) by comparing a vector of signal features for each data segment to four prototypical feature vectors obtained by Wendling model simulations. The classification result is validated against expert visual assessment. Model-driven brain state classification achieved a classification performance significantly above chance level (mean sensitivity 0.99 on model data, 0.77 on rat data, 0.56 on human data in a four-way classification task). Model-driven prototypes showed similarity with data-driven prototypes, which we obtained from real data for rats and humans. Our results indicate similar electrophysiological patterns of epileptic states in the human brain and the animal model that are well-reproduced by the computational model, and captured by a key set of signal features, enabling fully automated and unsupervised brain state classification in epilepsy.

Multistability in neural systems with random cross-connections

Neural circuits with multiple discrete attractor states could support a variety of cognitive tasks according to both empirical data and model simulations. We assess the conditions for such multistability in neural systems, using a firing-rate model framework, in which clusters of neurons with net self-excitation are represented as units, which interact with each other through random connections. We focus on conditions in which individual units lack sufficient self-excitation to become bistable on their own. Rather, multistability can arise via recurrent input from other units as a network effect for subsets of units, whose net input to each other when active is sufficiently positive to maintain such activity. In terms of the strength of within-unit self-excitation and standard-deviation of random cross-connections, the region of multistability depends on the firing-rate curve of units. Indeed, bistability can arise with zero self-excitation, purely through zero-mean random cross-connections, if the firing-rate curve rises supralinearly at low inputs from a value near zero at zero input. We simulate and analyze finite systems, showing that the probability of multistability can peak at intermediate system size, and connect with other literature analyzing similar systems in the infinite-size limit. We find regions of multistability with a bimodal distribution for the number of active units in a stable state. Finally, we find evidence for a log-normal distribution of sizes of attractor basins, which can appear as Zipf's Law when sampled as the proportion of trials within which random initial conditions lead to a particular stable state of the system.

Temporal progression along discrete coding states during decision-making in the mouse gustatory cortex

The mouse gustatory cortex (GC) is involved in taste-guided decision-making in addition to sensory processing. Rodent GC exhibits metastable neural dynamics during ongoing and stimulus-evoked activity, but how these dynamics evolve in the context of a taste-based decision-making task remains unclear. Here we employ analytical and modeling approaches to i) extract metastable dynamics in ensemble spiking activity recorded from the GC of mice performing a perceptual decision-making task; ii) investigate the computational mechanisms underlying GC metastability in this task; and iii) establish a relationship between GC dynamics and behavioral performance. Our results show that activity in GC during perceptual decision-making is metastable and that this metastability may serve as a substrate for sequentially encoding sensory, abstract cue, and decision information over time. Perturbations of the model's metastable dynamics indicate that boosting inhibition in different coding epochs differentially impacts network performance, explaining a counterintuitive effect of GC optogenetic silencing on mouse behavior.

Coupled Dynamics of Stimulus-Evoked Gustatory Cortical and Basolateral Amygdalar Activity

Gustatory cortical (GC) single-neuron taste responses reflect taste quality and palatability in successive epochs. Ensemble analyses reveal epoch-to-epoch firing-rate changes in these responses to be sudden, coherent transitions. Such nonlinear dynamics suggest that GC is part of a recurrent network, producing these dynamics in concert with other structures. Basolateral amygdala (BLA), which is reciprocally connected to GC and central to hedonic processing, is a strong candidate partner for GC, in that BLA taste responses evolve on the same general clock as GC and because inhibition of activity in the BLA→GC pathway degrades the sharpness of GC transitions. These facts motivate, but do not test, our overarching hypothesis that BLA and GC act as a single, comodulated network during taste processing. Here, we provide just this test of simultaneous (BLA and GC) extracellular taste responses in female rats, probing the multiregional dynamics of activity to directly test whether BLA and GC responses contain coupled dynamics. We show that BLA and GC response magnitudes covary across trials and within single responses, and that changes in BLA-GC local field potential phase coherence are epoch specific. Such classic coherence analyses, however, obscure the most salient facet of BLA-GC coupling: sudden transitions in and out of the epoch known to be involved in driving gaping behavior happen near simultaneously in the two regions, despite huge trial-to-trial variability in transition latencies. This novel form of inter-regional coupling, which we show is easily replicated in model networks, suggests collective processing in a distributed neural network.SIGNIFICANCE STATEMENT There has been little investigation into real-time communication between brain regions during taste processing, a fact reflecting the dominant belief that taste circuitry is largely feedforward. Here, we perform an in-depth analysis of real-time interactions between GC and BLA in response to passive taste deliveries, using both conventional coherence metrics and a novel methodology that explicitly considers trial-to-trial variability and fast single-trial dynamics in evoked responses. Our results demonstrate that BLA-GC coherence changes as the taste response unfolds, and that BLA and GC specifically couple for the sudden transition into (and out of) the behaviorally relevant neural response epoch, suggesting (although not proving) that: (1) recurrent interactions subserve the function of the dyad as (2) a putative attractor network.

Adaptive control of synaptic plasticity integrates micro- and macroscopic network function

Synaptic plasticity configures interactions between neurons and is therefore likely to be a primary driver of behavioral learning and development. How this microscopic-macroscopic interaction occurs is poorly understood, as researchers frequently examine models within particular ranges of abstraction and scale. Computational neuroscience and machine learning models offer theoretically powerful analyses of plasticity in neural networks, but results are often siloed and only coarsely linked to biology. In this review, we examine connections between these areas, asking how network computations change as a function of diverse features of plasticity and vice versa. We review how plasticity can be controlled at synapses by calcium dynamics and neuromodulatory signals, the manifestation of these changes in networks, and their impacts in specialized circuits. We conclude that metaplasticity-defined broadly as the adaptive control of plasticity-forges connections across scales by governing what groups of synapses can and can't learn about, when, and to what ends. The metaplasticity we discuss acts by co-opting Hebbian mechanisms, shifting network properties, and routing activity within and across brain systems. Asking how these operations can go awry should also be useful for understanding pathology, which we address in the context of autism, schizophrenia and Parkinson's disease.

Neurodynamical Computing at the Information Boundaries of Intelligent Systems

Artificial intelligence has not achieved defining features of biological intelligence despite models boasting more parameters than neurons in the human brain. In this perspective article, we synthesize historical approaches to understanding intelligent systems and argue that methodological and epistemic biases in these fields can be resolved by shifting away from cognitivist brain-as-computer theories and recognizing that brains exist within large, interdependent living systems. Integrating the dynamical systems view of cognition with the massive distributed feedback of perceptual control theory highlights a theoretical gap in our understanding of nonreductive neural mechanisms. Cell assemblies-properly conceived as reentrant dynamical flows and not merely as identified groups of neurons-may fill that gap by providing a minimal supraneuronal level of organization that establishes a neurodynamical base layer for computation. By considering information streams from physical embodiment and situational embedding, we discuss this computational base layer in terms of conserved oscillatory and structural properties of cortical-hippocampal networks. Our synthesis of embodied cognition, based in dynamical systems and perceptual control, aims to bypass the neurosymbolic stalemates that have arisen in artificial intelligence, cognitive science, and computational neuroscience.

Mesoscopic description of hippocampal replay and metastability in spiking neural networks with short-term plasticity

Bottom-up models of functionally relevant patterns of neural activity provide an explicit link between neuronal dynamics and computation. A prime example of functional activity patterns are propagating bursts of place-cell activities called hippocampal replay, which is critical for memory consolidation. The sudden and repeated occurrences of these burst states during ongoing neural activity suggest metastable neural circuit dynamics. As metastability has been attributed to noise and/or slow fatigue mechanisms, we propose a concise mesoscopic model which accounts for both. Crucially, our model is bottom-up: it is analytically derived from the dynamics of finite-size networks of Linear-Nonlinear Poisson neurons with short-term synaptic depression. As such, noise is explicitly linked to stochastic spiking and network size, and fatigue is explicitly linked to synaptic dynamics. To derive the mesoscopic model, we first consider a homogeneous spiking neural network and follow the temporal coarse-graining approach of Gillespie to obtain a "chemical Langevin equation", which can be naturally interpreted as a stochastic neural mass model. The Langevin equation is computationally inexpensive to simulate and enables a thorough study of metastable dynamics in classical setups (population spikes and Up-Down-states dynamics) by means of phase-plane analysis. An extension of the Langevin equation for small network sizes is also presented. The stochastic neural mass model constitutes the basic component of our mesoscopic model for replay. We show that the mesoscopic model faithfully captures the statistical structure of individual replayed trajectories in microscopic simulations and in previously reported experimental data. Moreover, compared to the deterministic Romani-Tsodyks model of place-cell dynamics, it exhibits a higher level of variability regarding order, direction and timing of replayed trajectories, which seems biologically more plausible and could be functionally desirable. This variability is the product of a new dynamical regime where metastability emerges from a complex interplay between finite-size fluctuations and local fatigue.

Formation and computational implications of assemblies in neural circuits

In the brain, patterns of neural activity represent sensory information and store it in non-random synaptic connectivity. A prominent theoretical hypothesis states that assemblies, groups of neurons that are strongly connected to each other, are the key computational units underlying perception and memory formation. Compatible with these hypothesised assemblies, experiments have revealed groups of neurons that display synchronous activity, either spontaneously or upon stimulus presentation, and exhibit behavioural relevance. While it remains unclear how assemblies form in the brain, theoretical work has vastly contributed to the understanding of various interacting mechanisms in this process. Here, we review the recent theoretical literature on assembly formation by categorising the involved mechanisms into four components: synaptic plasticity, symmetry breaking, competition and stability. We highlight different approaches and assumptions behind assembly formation and discuss recent ideas of assemblies as the key computational unit in the brain. Abstract figure legend Assembly Formation. Assemblies are groups of strongly connected neurons formed by the interaction of multiple mechanisms and with vast computational implications. Four interacting components are thought to drive assembly formation: synaptic plasticity, symmetry breaking, competition and stability. This article is protected by copyright. All rights reserved.

Neural mechanisms underlying the temporal organization of naturalistic animal behavior

Naturalistic animal behavior exhibits a strikingly complex organization in the temporal domain, with variability arising from at least three sources: hierarchical, contextual, and stochastic. What neural mechanisms and computational principles underlie such intricate temporal features? In this review, we provide a critical assessment of the existing behavioral and neurophysiological evidence for these sources of temporal variability in naturalistic behavior. Recent research converges on an emergent mechanistic theory of temporal variability based on attractor neural networks and metastable dynamics, arising via coordinated interactions between mesoscopic neural circuits. We highlight the crucial role played by structural heterogeneities as well as noise from mesoscopic feedback loops in regulating flexible behavior. We assess the shortcomings and missing links in the current theoretical and experimental literature and propose new directions of investigation to fill these gaps.

Inhibitory control of frontal metastability sets the temporal signature of cognition

Cortical dynamics are organized over multiple anatomical and temporal scales. The mechanistic origin of the temporal organization and its contribution to cognition remain unknown. Here we demonstrate the cause of this organization by studying a specific temporal signature (time constant and latency) of neural activity. In monkey frontal areas, recorded during flexible decisions, temporal signatures display specific area-dependent ranges, as well as anatomical and cell-type distributions. Moreover, temporal signatures are functionally adapted to behaviorally relevant timescales. Fine-grained biophysical network models, constrained to account for experimentally observed temporal signatures, reveal that after-hyperpolarization potassium and inhibitory GABA-B conductances critically determine areas' specificity. They mechanistically account for temporal signatures by organizing activity into metastable states, with inhibition controlling state stability and transitions. As predicted by models, state durations non-linearly scale with temporal signatures in monkey, matching behavioral timescales. Thus, local inhibitory-controlled metastability constitutes the dynamical core specifying the temporal organization of cognitive functions in frontal areas.

The rodent medial prefrontal cortex and associated circuits in orchestrating adaptive behavior under variable demands

Emerging evidence implicates rodent medial prefrontal cortex (mPFC) in tasks requiring adaptation of behavior to changing information from external and internal sources. However, the computations within mPFC and subsequent outputs that determine behavior are incompletely understood. We review the involvement of mPFC subregions, and their projections to the striatum and amygdala in two broad types of tasks in rodents: 1) appetitive and aversive Pavlovian and operant conditioning tasks that engage mPFC-striatum and mPFC-amygdala circuits, and 2) foraging-based tasks that require decision making to optimize reward. We find support for region-specific function of the mPFC, with dorsal mPFC and its projections to the dorsomedial striatum supporting action control with higher cognitive demands, and ventral mPFC engagement in translating affective signals into behavior via discrete projections to the ventral striatum and amygdala. However, we also propose that defined mPFC subdivisions operate as a functional continuum rather than segregated functional units, with crosstalk that allows distinct subregion-specific inputs (e.g., internal, affective) to influence adaptive behavior supported by other subregions.

Metastable dynamics of neural circuits and networks

Cortical neurons emit seemingly erratic trains of action potentials or "spikes," and neural network dynamics emerge from the coordinated spiking activity within neural circuits. These rich dynamics manifest themselves in a variety of patterns, which emerge spontaneously or in response to incoming activity produced by sensory inputs. In this Review, we focus on neural dynamics that is best understood as a sequence of repeated activations of a number of discrete hidden states. These transiently occupied states are termed "metastable" and have been linked to important sensory and cognitive functions. In the rodent gustatory cortex, for instance, metastable dynamics have been associated with stimulus coding, with states of expectation, and with decision making. In frontal, parietal, and motor areas of macaques, metastable activity has been related to behavioral performance, choice behavior, task difficulty, and attention. In this article, we review the experimental evidence for neural metastable dynamics together with theoretical approaches to the study of metastable activity in neural circuits. These approaches include (i) a theoretical framework based on non-equilibrium statistical physics for network dynamics; (ii) statistical approaches to extract information about metastable states from a variety of neural signals; and (iii) recent neural network approaches, informed by experimental results, to model the emergence of metastable dynamics. By discussing these topics, we aim to provide a cohesive view of how transitions between different states of activity may provide the neural underpinnings for essential functions such as perception, memory, expectation, or decision making, and more generally, how the study of metastable neural activity may advance our understanding of neural circuit function in health and disease.

Metastable attractors explain the variable timing of stable behavioral action sequences

The timing of self-initiated actions shows large variability even when they are executed in stable, well-learned sequences. Could this mix of reliability and stochasticity arise within the same neural circuit? We trained rats to perform a stereotyped sequence of self-initiated actions and recorded neural ensemble activity in secondary motor cortex (M2), which is known to reflect trial-by-trial action-timing fluctuations. Using hidden Markov models, we established a dictionary between activity patterns and actions. We then showed that metastable attractors, representing activity patterns with a reliable sequential structure and large transition timing variability, could be produced by reciprocally coupling a high-dimensional recurrent network and a low-dimensional feedforward one. Transitions between attractors relied on correlated variability in this mesoscale feedback loop, predicting a specific structure of low-dimensional correlations that were empirically verified in M2 recordings. Our results suggest a novel mesoscale network motif based on correlated variability supporting naturalistic animal behavior.

The Mean Field Approach for Populations of Spiking Neurons

Mean field theory is a device to analyze the collective behavior of a dynamical system comprising many interacting particles. The theory allows to reduce the behavior of the system to the properties of a handful of parameters. In neural circuits, these parameters are typically the firing rates of distinct, homogeneous subgroups of neurons. Knowledge of the firing rates under conditions of interest can reveal essential information on both the dynamics of neural circuits and the way they can subserve brain function. The goal of this chapter is to provide an elementary introduction to the mean field approach for populations of spiking neurons. We introduce the general idea in networks of binary neurons, starting from the most basic results and then generalizing to more relevant situations. This allows to derive the mean field equations in a simplified setting. We then derive the mean field equations for populations of integrate-and-fire neurons. An effort is made to derive the main equations of the theory using only elementary methods from calculus and probability theory. The chapter ends with a discussion of the assumptions of the theory and some of the consequences of violating those assumptions. This discussion includes an introduction to balanced and metastable networks and a brief catalogue of successful applications of the mean field approach to the study of neural circuits.

Modulation of the dynamical state in cortical network models

Cortical neural responses can be modulated by various factors, such as stimulus inputs and the behavior state of the animal. Understanding the circuit mechanisms underlying modulations of network dynamics is important to understand the flexibility of circuit computations. Identifying the dynamical state of a network is an important first step to predict network responses to external stimulus and top-down modulatory inputs. Models in stable or unstable dynamical regimes require different analytic tools to estimate the network responses to inputs and the structure of neural variability. In this article, I review recent cortical models of state-dependent responses and their predictions about the underlying modulatory mechanisms.

Binocular rivalry reveals an out-of-equilibrium neural dynamics suited for decision-making

In ambiguous or conflicting sensory situations, perception is often 'multistable' in that it perpetually changes at irregular intervals, shifting abruptly between distinct alternatives. The interval statistics of these alternations exhibits quasi-universal characteristics, suggesting a general mechanism. Using binocular rivalry, we show that many aspects of this perceptual dynamics are reproduced by a hierarchical model operating out of equilibrium. The constitutive elements of this model idealize the metastability of cortical networks. Independent elements accumulate visual evidence at one level, while groups of coupled elements compete for dominance at another level. As soon as one group dominates perception, feedback inhibition suppresses supporting evidence. Previously unreported features in the serial dependencies of perceptual alternations compellingly corroborate this mechanism. Moreover, the proposed out-of-equilibrium dynamics satisfies normative constraints of continuous decision-making. Thus, multistable perception may reflect decision-making in a volatile world: integrating evidence over space and time, choosing categorically between hypotheses, while concurrently evaluating alternatives.

Online Learning and Memory of Neural Trajectory Replays for Prefrontal Persistent and Dynamic Representations in the Irregular Asynchronous State

In the prefrontal cortex (PFC), higher-order cognitive functions and adaptive flexible behaviors rely on continuous dynamical sequences of spiking activity that constitute neural trajectories in the state space of activity. Neural trajectories subserve diverse representations, from explicit mappings in physical spaces to generalized mappings in the task space, and up to complex abstract transformations such as working memory, decision-making and behavioral planning. Computational models have separately assessed learning and replay of neural trajectories, often using unrealistic learning rules or decoupling simulations for learning from replay. Hence, the question remains open of how neural trajectories are learned, memorized and replayed online, with permanently acting biological plasticity rules. The asynchronous irregular regime characterizing cortical dynamics in awake conditions exerts a major source of disorder that may jeopardize plasticity and replay of locally ordered activity. Here, we show that a recurrent model of local PFC circuitry endowed with realistic synaptic spike timing-dependent plasticity and scaling processes can learn, memorize and replay large-size neural trajectories online under asynchronous irregular dynamics, at regular or fast (sped-up) timescale. Presented trajectories are quickly learned (within seconds) as synaptic engrams in the network, and the model is able to chunk overlapping trajectories presented separately. These trajectory engrams last long-term (dozen hours) and trajectory replays can be triggered over an hour. In turn, we show the conditions under which trajectory engrams and replays preserve asynchronous irregular dynamics in the network. Functionally, spiking activity during trajectory replays at regular timescale accounts for both dynamical coding with temporal tuning in individual neurons, persistent activity at the population level, and large levels of variability consistent with observed cognitive-related PFC dynamics. Together, these results offer a consistent theoretical framework accounting for how neural trajectories can be learned, memorized and replayed in PFC networks circuits to subserve flexible dynamic representations and adaptive behaviors.

Perturbation of amygdala-cortical projections reduces ensemble coherence of palatability coding in gustatory cortex

Taste palatability is centrally involved in consumption decisions-we ingest foods that taste good and reject those that don't. Gustatory cortex (GC) and basolateral amygdala (BLA) almost certainly work together to mediate palatability-driven behavior, but the precise nature of their interplay during taste decision-making is still unknown. To probe this issue, we discretely perturbed (with optogenetics) activity in rats' BLA→GC axons during taste deliveries. This perturbation strongly altered GC taste responses, but while the perturbation itself was tonic (2.5 s), the alterations were not-changes preferentially aligned with the onset times of previously-described taste response epochs, and reduced evidence of palatability-related activity in the 'late-epoch' of the responses without reducing the amount of taste identity information available in the 'middle epoch.' Finally, BLA→GC perturbations changed behavior-linked taste response dynamics themselves, distinctively diminishing the abruptness of ensemble transitions into the late epoch. These results suggest that BLA 'organizes' behavior-related GC taste dynamics.

Slower prefrontal metastable dynamics during deliberation predicts error trials in a distance discrimination task

Cortical activity related to erroneous behavior in discrimination or decision-making tasks is rarely analyzed, yet it can help clarify which computations are essential during a specific task. Here, we use a hidden Markov model (HMM) to perform a trial-by-trial analysis of the ensemble activity of dorsolateral prefrontal cortex (PFdl) neurons of rhesus monkeys performing a distance discrimination task. By segmenting the neural activity into sequences of metastable states, HMM allows us to uncover modulations of the neural dynamics related to internal computations. We find that metastable dynamics slow down during error trials, while state transitions at a pivotal point during the trial take longer in difficult correct trials. Both these phenomena occur during the decision interval, with errors occurring in both easy and difficult trials. Our results provide further support for the emerging role of metastable cortical dynamics in mediating complex cognitive functions and behavior.

Dissociation of task engagement and arousal effects in auditory cortex and midbrain

Both generalized arousal and engagement in a specific task influence sensory neural processing. To isolate effects of these state variables in the auditory system, we recorded single-unit activity from primary auditory cortex (A1) and inferior colliculus (IC) of ferrets during a tone detection task, while monitoring arousal via changes in pupil size. We used a generalized linear model to assess the influence of task engagement and pupil size on sound-evoked activity. In both areas, these two variables affected independent neural populations. Pupil size effects were more prominent in IC, while pupil and task engagement effects were equally likely in A1. Task engagement was correlated with larger pupil; thus, some apparent effects of task engagement should in fact be attributed to fluctuations in pupil size. These results indicate a hierarchy of auditory processing, where generalized arousal enhances activity in midbrain, and effects specific to task engagement become more prominent in cortex.

The midcingulate cortex and temporal integration

The ability to integrate information across time at multiple timescales is a vital element of adaptive behavior, because it provides the capacity to link events separated in time, extract useful information from previous events and actions, and to construct plans for behavior over time. Here we make the argument that this information integration capacity is a central function of the midcingulate cortex (MCC), by reviewing the anatomical, intrinsic network, neurophysiological, and behavioral properties of MCC. The MCC is the region of the medial wall situated dorsal to the corpus callosum and sometimes referred to as dACC. It is positioned within the densely connected core network of the primate brain, with a rich diversity of cognitive, somatomotor and autonomic connections. Furthermore, the MCC shows strong local network inhibition which appears to control the metastability of the region-an established feature of many cortical networks in which the neural dynamics move through a series of quasi-stationary states. We propose that the strong local inhibition in MCC leads to particularly long dynamic state durations, and so less frequent transitions. Apparently as a result of these anatomical features and synaptic and ionic determinants, the MCC cells display the longest neuronal timescales among a range of recorded cortical areas. We conclude that the anatomical position, intrinsic properties, and local network interactions of MCC make it a uniquely positioned cortical area to perform the integration of diverse information over time that is necessary for behavioral adaptation.

Muscarinic-Dependent miR-182 and QR2 Expression Regulation in the Anterior Insula Enables Novel Taste Learning

In a similar manner to other learning paradigms, intact muscarinic acetylcholine receptor (mAChR) neurotransmission or protein synthesis regulation in the anterior insular cortex (aIC) is necessary for appetitive taste learning. Here we describe a parallel local molecular pathway, where GABA_A receptor control of mAChR activation causes upregulation of miRNA-182 and quinone reductase 2 (QR2) mRNA destabilization in the rodent aIC. Damage to long-term memory by prevention of this process, with the use of mAChR antagonist scopolamine before novel taste learning, can be rescued by local QR2 inhibition, demonstrating that QR2 acts downstream of local muscarinic activation. Furthermore, we prove for the first time the presence of endogenous QR2 cofactors in the brain, establishing QR2 as a functional reductase there. In turn, we show that QR2 activity causes the generation of reactive oxygen species, leading to modulation in Kv2.1 redox state. QR2 expression reduction therefore is a previously unaccounted mode of mAChR-mediated inflammation reduction, and thus adds QR2 to the cadre of redox modulators in the brain. The concomitant reduction in QR2 activity during memory consolidation suggests a complementary mechanism to the well established molecular processes of this phase, by which the cortex gleans important information from general sensory stimuli. This places QR2 as a promising new target to tackle neurodegenerative inflammation and the associated impediment of novel memory formation in diseases such as Alzheimer’s disease.

Birhythmic Analog Circuit Maze: A Nonlinear Neurostimulation Testbed

Brain dynamics can exhibit narrow-band nonlinear oscillations and multistability. For a subset of disorders of consciousness and motor control, we hypothesized that some symptoms originate from the inability to spontaneously transition from one attractor to another. Using external perturbations, such as electrical pulses delivered by deep brain stimulation devices, it may be possible to induce such transition out of the pathological attractors. However, the induction of transition may be non-trivial, rendering the current open-loop stimulation strategies insufficient. In order to develop next-generation neural stimulators that can intelligently learn to induce attractor transitions, we require a platform to test the efficacy of such systems. To this end, we designed an analog circuit as a model for the multistable brain dynamics. The circuit spontaneously oscillates stably on two periods as an instantiation of a 3-dimensional continuous-time gated recurrent neural network. To discourage simple perturbation strategies, such as constant or random stimulation patterns from easily inducing transition between the stable limit cycles, we designed a state-dependent nonlinear circuit interface for external perturbation. We demonstrate the existence of nontrivial solutions to the transition problem in our circuit implementation.