The stabilized supralinear network: a unifying circuit motif underlying multi-input integration in sensory cortex

Relating sparse and predictive coding to divisive normalization

Sparse coding, predictive coding and divisive normalization have each been found to be principles that underlie the function of neural circuits in many parts of the brain, supported by substantial experimental evidence. However, the connections between these related principles are still poorly understood. Sparse coding and predictive coding can be reconciled into a learning framework with predictive structure and sparse responses, termed as sparse/predictive coding. However, how sparse/predictive coding (a learning model) is connected with divisive normalization (not a learning model) is still not well investigated. In this paper, we show how sparse coding, predictive coding, and divisive normalization can be described within a unified framework, and illustrate this explicitly within the context of a two-layer neural learning model of sparse/predictive coding. This two-layer model is constructed in a way that implements sparse coding with a network structure that is constructed by implementing predictive coding. We demonstrate how a homeostatic function that regulates neural responses in the model can shape the nonlinearity of neural responses in a way that replicates different forms of divisive normalization. Simulations show that the model can learn simple cells in the primary visual cortex with the property of contrast saturation, which has previously been explained by divisive normalization. In summary, the study demonstrates that the three principles of sparse coding, predictive coding, and divisive normalization can be connected to provide a learning framework based on biophysical properties, such as Hebbian learning and homeostasis, and this framework incorporates both learning and more diverse response nonlinearities observed experimentally. This framework has the potential to also be used to explain how the brain learns to integrate input from different sensory modalities.

Stabilized Supralinear Network Model of Responses to Surround Stimuli in Primary Visual Cortex

In the mammalian primary visual cortex (V1), there are complex interactions between responses to stimuli present in the cell's classical receptive field (CRF) or "center" and in the surrounding region or "surround." The circuit mechanisms underlying these behaviors are likely to represent more general cortical mechanisms for integrating information. Here, we develop a circuit model that accounts for three important features of surround suppression (suppression of response to a center stimulus by addition of a surround stimulus): (1) The surround stimulus suppresses the inhibitory and excitatory currents that the cell receives; (2) The strongest suppression arises when the surround orientation matches that of the center stimulus, even when the center stimulus orientation differs from the cell's preferred orientation; and (3) A surround stimulus of a given orientation most strongly suppresses that orientation's component of the response to a plaid center stimulus ("feature-specific suppression"). We show that a stabilized supralinear network (SSN) with biologically plausible connectivity and synaptic efficacies that depend on cortical distance and orientation difference between units can consistently reproduce phenomena (1) and (3), and, qualitatively, phenomenon (2). We explain the mechanism behind each result. We argue that phenomena (2) and (3) are independent: the model with some aspects of connectivity removed still produces phenomenon (3) but not (2). The model reproduces the rapid time scale of activity decay observed in mouse V1 when thalamic input to V1 is silenced. Finally, we show that these results hold both in networks with rate-based and conductance-based spiking units.

Untangling stability and gain modulation in cortical circuits with multiple interneuron classes

Synaptic inhibition is the mechanistic backbone of a suite of cortical functions, not the least of which are maintaining network stability and modulating neuronal gain. In cortical models with a single inhibitory neuron class, network stabilization and gain control work in opposition to one another - meaning high gain coincides with low stability and vice versa. It is now clear that cortical inhibition is diverse, with molecularly distinguished cell classes having distinct positions within the cortical circuit. We analyze circuit models with pyramidal neurons (E) as well as parvalbumin (PV) and somatostatin (SOM) expressing interneurons. We show how, in E - PV - SOM recurrently connected networks, SOM-mediated modulation can lead to simultaneous increases in neuronal gain and network stability. Our work exposes how the impact of a modulation mediated by SOM neurons depends critically on circuit connectivity and the network state.

Surround modulation is predominantly orientation-unspecific in macaque V1

Surround modulation is a fundamental property of V1 neurons, playing critical roles in stimulus integration and segregation. It is believed to be orientation-specific, as neurons' responses at preferred orientations are suppressed more by iso-oriented surrounds than by cross-oriented surrounds. Here, we investigated an alternative hypothesis that surround modulation is primarily orientation-unspecific, in that the observed "orientation-specific" surround effects actually reflect overall gain changes that affect neurons tuned to all orientations. We employed two-photon calcium imaging to compare V1 population orientation tuning functions under iso- and cross-surround modulation in awake, fixating macaques. While confirming "orientation-specific" surround suppression in individual neurons, our analysis of the population orientation tuning functions revealed that iso-surrounds induce a general orientation-unspecific suppression across all orientation-tuned neurons, plus weak orientation-specific suppression to neurons tuned to the center stimulus orientation. Furthermore, cross-surrounds mainly reduce orientation-unspecific suppression by scaling up responses of all orientation-tuned neurons. These findings suggest a model of population gain control where surround stimuli mostly scale the responses of the neuronal population. Further population coding analyses supported this conclusion, demonstrating that surround suppression leads to degraded target orientation information at least partially due to a reduced number of contributing neurons with diverse orientation preferences.

Lateral inhibition in V1 controls neural and perceptual contrast sensitivity

Lateral inhibition is a central principle in sensory system function. It is thought to operate by the activation of inhibitory neurons that restrict the spatial spread of sensory excitation. However, the neurons, computations and mechanisms underlying cortical lateral inhibition remain debated, and its importance for perception remains unknown. Here we show that lateral inhibition from parvalbumin neurons in mouse primary visual cortex reduced neural and perceptual sensitivity to visual contrast in a uniform subtractive manner, whereas lateral inhibition from somatostatin neurons more effectively changed the slope (or gain) of neural and perceptual contrast sensitivity. A neural circuit model, anatomical tracing and direct subthreshold measurements indicated that the larger spatial footprint for somatostatin versus parvalbumin synaptic inhibition explains this difference. Together, these results define cell-type-specific computational roles for lateral inhibition in primary visual cortex, and establish their unique consequences on sensitivity to contrast, a fundamental aspect of the visual world.

The Computational Bottleneck of Basal Ganglia Output (and What to Do About it)

What the basal ganglia do is an oft-asked question; answers range from the selection of actions to the specification of movement to the estimation of time. Here, I argue that how the basal ganglia do what they do is a less-asked but equally important question. I show that the output regions of the basal ganglia create a stringent computational bottleneck, both structurally, because they have far fewer neurons than do their target regions, and dynamically, because of their tonic, inhibitory output. My proposed solution to this bottleneck is that the activity of an output neuron is setting the weight of a basis function, a function defined by that neuron's synaptic contacts. I illustrate how this may work in practice, allowing basal ganglia output to shift cortical dynamics and control eye movements via the superior colliculus. This solution can account for troubling issues in our understanding of the basal ganglia: why we see output neurons increasing their activity during behavior, rather than only decreasing as predicted by theories based on disinhibition, and why the output of the basal ganglia seems to have so many codes squashed into such a tiny region of the brain.

Subthreshold moment analysis of neuronal populations driven by synchronous synaptic inputs

Even when driven by the same stimulus, neuronal responses are well-known to exhibit a striking level of spiking variability. In-vivo electrophysiological recordings also reveal a surprisingly large degree of variability at the subthreshold level. In prior work, we considered biophysically relevant neuronal models to account for the observed magnitude of membrane voltage fluctuations. We found that accounting for these fluctuations requires weak but nonzero synchrony in the spiking activity, in amount that are consistent with experimentally measured spiking correlations. Here we investigate whether such synchrony can explain additional statistical features of the measured neural activity, including neuronal voltage covariability and voltage skewness. Addressing this question involves conducting a generalized moment analysis of conductance-based neurons in response to input drives modeled as correlated jump processes. Technically, we perform such an analysis using fixed-point techniques from queuing theory that are applicable in the stationary regime of activity. We found that weak but nonzero synchrony can consistently explain the experimentally reported voltage covariance and skewness. This confirms the role of synchrony as a primary driver of cortical variability and supports that physiological neural activity emerges as a population-level phenomenon, especially in the spontaneous regime.

Subthreshold variability of neuronal populations driven by synchronous synaptic inputs

Even when driven by the same stimulus, neuronal responses are well-known to exhibit a striking level of spiking variability. In-vivo electrophysiological recordings also reveal a surprisingly large degree of variability at the subthreshold level. In prior work, we considered biophysically relevant neuronal models to account for the observed magnitude of membrane voltage fluctuations. We found that accounting for these fluctuations requires weak but nonzero synchrony in the spiking activity, in amount that are consistent with experimentally measured spiking correlations. Here we investigate whether such synchrony can explain additional statistical features of the measured neural activity, including neuronal voltage covariability and voltage skewness. Addressing this question involves conducting a generalized moment analysis of conductance-based neurons in response to input drives modeled as correlated jump processes. Technically, we perform such an analysis using fixed-point techniques from queuing theory that are applicable in the stationary regime of activity. We found that weak but nonzero synchrony can consistently explain the experimentally reported voltage covariance and skewness. This confirms the role of synchrony as a primary driver of cortical variability and supports that physiological neural activity emerges as a population-level phenomenon, especially in the spontaneous regime.

Identifying the impact of local connectivity patterns on dynamics in excitatory-inhibitory networks

Networks of excitatory and inhibitory (EI) neurons form a canonical circuit in the brain. Seminal theoretical results on dynamics of such networks are based on the assumption that synaptic strengths depend on the type of neurons they connect, but are otherwise statistically independent. Recent synaptic physiology datasets however highlight the prominence of specific connectivity patterns that go well beyond what is expected from independent connections. While decades of influential research have demonstrated the strong role of the basic EI cell type structure, to which extent additional connectivity features influence dynamics remains to be fully determined. Here we examine the effects of pairwise connectivity motifs on the linear dynamics in EI networks using an analytical framework that approximates the connectivity in terms of low-rank structures. This low-rank approximation is based on a mathematical derivation of the dominant eigenvalues of the connectivity matrix and predicts the impact on responses to external inputs of connectivity motifs and their interactions with cell-type structure. Our results reveal that a particular pattern of connectivity, chain motifs, have a much stronger impact on dominant eigenmodes than other pairwise motifs. An overrepresentation of chain motifs induces a strong positive eigenvalue in inhibition-dominated networks and generates a potential instability that requires revisiting the classical excitation-inhibition balance criteria. Examining effects of external inputs, we show that chain motifs can on their own induce paradoxical responses where an increased input to inhibitory neurons leads to a decrease in their activity due to the recurrent feedback. These findings have direct implications for the interpretation of experiments in which responses to optogenetic perturbations are measured and used to infer the dynamical regime of cortical circuits.

Premature vision drives aberrant development of response properties in primary visual cortex

Development of the mammalian visual system is thought to proceed in two stages. In the first stage, before birth in primates and before eye opening in altricial mammals, spontaneous activity generated by the retina and cortex shapes visual brain circuits in an activity-dependent but experience-independent manner. In the second stage, visual activity generated by sensory experience refines receptive fields. Here we investigated the consequences of altering this sequence of events by prematurely opening one or both eyes of ferrets and examining visual receptive fields in monocular cortex after the closure of the critical period for ocular dominance plasticity. We observed that many cells in animals with prematurely-opened eyes exhibited low-pass temporal frequency tuning and increased temporal frequency bandwidths, and these cells showed slightly increased orientation and direction selectivity index values. Spontaneous activity was greatly elevated in both hemispheres following the premature opening of one or both eyes, suggesting a global change in circuit excitability that was not restricted to cells that viewed the world through the prematurely opened eye. No major changes were noted in spatial frequency tuning. These results suggest that premature visual experience alters circuit excitability and visual receptive fields, in particular with respect to temporal processing. We speculate that closed lids in altricial mammals serve to prevent visual experience until circuits are initially established and are ready to be refined by visual experience.

Feature selectivity of corticocortical feedback along the primate dorsal visual pathway

Anatomical studies have revealed a prominent role for feedback projections in the primate visual cortex. Theoretical models suggest that these projections support important brain functions such as attention, prediction, and learning. However, these models make different predictions about the relationship between feedback connectivity and neuronal stimulus selectivity. We have therefore performed simultaneous recordings in different regions of the primate dorsal visual pathway. Specifically, we recorded neural activity from the medial superior temporal (MST) area, and one of its main feedback targets, the middle temporal (MT) area. We estimated functional connectivity from correlations in the single-neuron spike trains and performed electrical microstimulation in MST to determine its causal influence on MT. Both methods revealed that inhibitory feedback occurred more commonly when the source and target neurons had very different stimulus preferences. At the same time, the strength of feedback suppression was greater for neurons with similar preferences. Excitatory feedback projections, in contrast, showed no consistent relationship with stimulus preferences. These results suggest that corticocortical feedback could play a role in shaping sensory responses according to behavioral or environmental context.NEW & NOTEWORTHY Here, we show that corticocortical feedback influences are often determined by the selectivity of the individual neurons. A common motif is the occurrence of inhibitory feedback among neurons with very different stimulus preferences. This results in strong suppression of responses in area MT when MST is electrically stimulated. Interestingly, this feedback shows a complex interaction with ongoing visual stimulation, being powerfully suppressive when visual inputs are strong, yet excitatory when visual inputs are weak.

Control of Inhibition-Stabilized Oscillations in Wilson-Cowan Networks with Homeostatic Plasticity

Interactions between excitatory and inhibitory neurons in the cerebral cortex give rise to different regimes of activity and modulate brain oscillations. A prominent regime in the cortex is the inhibition-stabilized network (ISN), defined by strong recurrent excitation balanced by inhibition. While theoretical models have captured the response of brain circuits in the ISN state, their connectivity is typically hard-wired, leaving unanswered how a network may self-organize to an ISN state and dynamically switch between ISN and non-ISN states to modulate oscillations. Here, we introduce a mean-rate model of coupled Wilson-Cowan equations, link ISN and non-ISN states to Kolmogorov-Sinai entropy, and demonstrate how homeostatic plasticity (HP) allows the network to express both states depending on its level of tonic activity. This mechanism enables the model to capture a broad range of experimental effects, including (i) a paradoxical decrease in inhibitory activity, (ii) a phase offset between excitation and inhibition, and (iii) damped gamma oscillations. Further, the model accounts for experimental work on asynchronous quenching, where an external input suppresses intrinsic oscillations. Together, findings show that oscillatory activity is modulated by the dynamical regime of the network under the control of HP, thus advancing a framework that bridges neural dynamics, entropy, oscillations, and synaptic plasticity.

Contextual modulation emerges by integrating feedforward and feedback processing in mouse visual cortex

Sensory systems use context to infer meaning. Accordingly, context profoundly influences neural responses to sensory stimuli. However, a cohesive understanding of the circuit mechanisms governing contextual effects across different stimulus conditions is still lacking. Here we present a unified circuit model of mouse visual cortex that accounts for the main standard forms of contextual modulation. This data-driven and biologically realistic circuit, including three primary inhibitory cell types, sheds light on how bottom-up, top-down, and recurrent inputs are integrated across retinotopic space to generate contextual effects in layer 2/3. We establish causal relationships between neural responses, geometrical features of the inputs, and the connectivity patterns. The model not only reveals how a single canonical cortical circuit differently modulates sensory response depending on context but also generates multiple testable predictions, offering insights that apply to broader neural circuitry.

Exact linear theory of perturbation response in a space- and feature-dependent cortical circuit model

What are the principles that govern the responses of cortical networks to their inputs and the emergence of these responses from recurrent connectivity? Recent experiments have probed these questions by measuring cortical responses to two-photon optogenetic perturbations of single cells in the mouse primary visual cortex. A robust theoretical framework is needed to determine the implications of these responses for cortical recurrence. Here we propose a novel analytical approach: a formulation of the dependence of cell-type-specific connectivity on spatial distance that yields an exact solution for the linear perturbation response of a model with multiple cell types and space- and feature-dependent connectivity. Importantly and unlike previous approaches, the solution is valid in regimes of strong as well as weak intra-cortical coupling. Analysis reveals the structure of connectivity implied by various features of single-cell perturbation responses, such as the surprisingly narrow spatial radius of nearby excitation beyond which inhibition dominates, the number of transitions between mean excitation and inhibition thereafter, and the dependence of these responses on feature preferences. Comparison of these results to existing optogenetic perturbation data yields constraints on cell-type-specific connection strengths and their tuning dependence. Finally, we provide experimental predictions regarding the response of inhibitory neurons to single-cell perturbations and the modulation of perturbation response by neuronal gain; the latter can explain observed differences in the feature-tuning of perturbation responses in the presence vs. absence of visual stimuli.

Unconditional stability of a recurrent neural circuit implementing divisive normalization

Stability in recurrent neural models poses a significant challenge, particularly in developing biologically plausible neurodynamical models that can be seamlessly trained. Traditional cortical circuit models are notoriously difficult to train due to expansive nonlinearities in the dynamical system, leading to an optimization problem with nonlinear stability constraints that are difficult to impose. Conversely, recurrent neural networks (RNNs) excel in tasks involving sequential data but lack biological plausibility and interpretability. In this work, we address these challenges by linking dynamic divisive normalization (DN) to the stability of "oscillatory recurrent gated neural integrator circuits" (ORGaNICs), a biologically plausible recurrent cortical circuit model that dynamically achieves DN and that has been shown to simulate a wide range of neurophysiological phenomena. By using the indirect method of Lyapunov, we prove the remarkable property of unconditional local stability for an arbitrary-dimensional ORGaNICs circuit when the recurrent weight matrix is the identity. We thus connect ORGaNICs to a system of coupled damped harmonic oscillators, which enables us to derive the circuit's energy function, providing a normative principle of what the circuit, and individual neurons, aim to accomplish. Further, for a generic recurrent weight matrix, we prove the stability of the 2D model and demonstrate empirically that stability holds in higher dimensions. Finally, we show that ORGaNICs can be trained by backpropagation through time without gradient clipping/scaling, thanks to its intrinsic stability property and adaptive time constants, which address the problems of exploding, vanishing, and oscillating gradients. By evaluating the model's performance on RNN benchmarks, we find that ORGaNICs outperform alternative neurodynamical models on static image classification tasks and perform comparably to LSTMs on sequential tasks.

Dissociation of focal and large-scale inhibitory functions in the older adults: A multimodal MRI study

BACKGROUND

The decline of inhibitory in cognitive aging is linked to reduced cognitive and mental capacities in older adults. However, this decline often shows inconsistent clinical presentations, suggesting varied impacts on different inhibition-related tasks. Inhibitory control, a multifaceted construct, involves various types of inhibition. Understanding these components is crucial for comprehending how aging affects inhibitory functions. Our research investigates the influences of aging on large-scale and focal-scale inhibitory and examines the relationship with brain markers.

METHODS

We examined the impact of aging on inhibitory in 18 younger (20-35 years) and 17 older adults (65-85 years) using focal and large-scale inhibition tasks. The Gabor task assessed focal-scale inhibition, while the Stop Signal Task (SST) evaluated large-scale inhibition. Participants underwent neuropsychological assessments and MRI scans, including magnetic resonance spectroscopy (MRS) and structural and resting fMRI.

RESULTS

Older adults exhibited a marked decline in inhibitory function, with slower SST responses indicating compromised large-scale inhibition. Conversely, the Gabor task showed no significant age-related changes. MRS findings revealed decreased levels of GABA, glutamate, glutamine, and NAA in the pre-SMA, correlating with observed large-scale inhibition in older adults. Additionally, pre-SMA seed-based functional connectivity analysis showed reduced brain network connections in older adults, potentially contributing to inhibitory control deficits.

CONCLUSIONS

Our study elucidates the differential effects of aging on inhibitory functions. While large-scale inhibition is more vulnerable to aging, focal-scale inhibition is relatively preserved. These findings highlight the importance of targeted cognitive interventions and underscore the necessity of a multifaceted approach in aging research.

Neuronal heterogeneity of normalization strength in a circuit model

The size of a neuron's receptive field increases along the visual hierarchy. Neurons in higher-order visual areas integrate information through a canonical computation called normalization, where neurons respond sublinearly to multiple stimuli in the receptive field. Neurons in the visual cortex exhibit highly heterogeneous degrees of normalization. Recent population recordings from visual cortex find that the interactions between neurons, measured by spike count correlations, depend on their normalization strengths. However, the circuit mechanism underlying the heterogeneity of normalization is unclear. In this work, we study normalization in a spiking neuron network model of visual cortex. The model produces a range of neuronal heterogeneity of normalization strength and the heterogeneity is highly correlated with the inhibitory current each neuron receives. Our model reproduces the dependence of spike count correlations on normalization as observed in experimental data, which is explained by the covariance with the inhibitory current. We find that neurons with stronger normalization are more sensitive to contrast differences in images and encode information more efficiently. In addition, networks with more heterogeneity in normalization encode more information about visual stimuli. Together, our model provides a mechanistic explanation of heterogeneous normalization strengths in the visual cortex, and sheds new light on the computational benefits of neuronal heterogeneity.

Cellular-resolution optogenetics reveals attenuation-by-suppression in visual cortical neurons

The relationship between neurons' input and spiking output is central to brain computation. Studies in vitro and in anesthetized animals suggest that nonlinearities emerge in cells' input-output (IO; activation) functions as network activity increases, yet how neurons transform inputs in vivo has been unclear. Here, we characterize cortical principal neurons' activation functions in awake mice using two-photon optogenetics. We deliver fixed inputs at the soma while neurons' activity varies with sensory stimuli. We find that responses to fixed optogenetic input are nearly unchanged as neurons are excited, reflecting a linear response regime above neurons' resting point. In contrast, responses are dramatically attenuated by suppression. This attenuation is a powerful means to filter inputs arriving to suppressed cells, privileging other inputs arriving to excited neurons. These results have two major implications. First, somatic neural activation functions in vivo accord with the activation functions used in recent machine learning systems. Second, neurons' IO functions can filter sensory inputs-not only do sensory stimuli change neurons' spiking outputs, but these changes also affect responses to input, attenuating responses to some inputs while leaving others unchanged.

Structural influences on synaptic plasticity: The role of presynaptic connectivity in the emergence of E/I co-tuning

Cortical neurons are versatile and efficient coding units that develop strong preferences for specific stimulus characteristics. The sharpness of tuning and coding efficiency is hypothesized to be controlled by delicately balanced excitation and inhibition. These observations suggest a need for detailed co-tuning of excitatory and inhibitory populations. Theoretical studies have demonstrated that a combination of plasticity rules can lead to the emergence of excitation/inhibition (E/I) co-tuning in neurons driven by independent, low-noise signals. However, cortical signals are typically noisy and originate from highly recurrent networks, generating correlations in the inputs. This raises questions about the ability of plasticity mechanisms to self-organize co-tuned connectivity in neurons receiving noisy, correlated inputs. Here, we study the emergence of input selectivity and weight co-tuning in a neuron receiving input from a recurrent network via plastic feedforward connections. We demonstrate that while strong noise levels destroy the emergence of co-tuning in the readout neuron, introducing specific structures in the non-plastic pre-synaptic connectivity can re-establish it by generating a favourable correlation structure in the population activity. We further show that structured recurrent connectivity can impact the statistics in fully plastic recurrent networks, driving the formation of co-tuning in neurons that do not receive direct input from other areas. Our findings indicate that the network dynamics created by simple, biologically plausible structural connectivity patterns can enhance the ability of synaptic plasticity to learn input-output relationships in higher brain areas.

Local stimulation of pyramidal neurons in deep cortical layers of anesthetized rats enhances cortical visual information processing

In the primary visual cortex area V1 activation of inhibitory interneurons, which provide negative feedback for excitatory pyramidal neurons, can improve visual response reliability and orientation selectivity. Moreover, optogenetic activation of one class of interneurons, parvalbumin (PV) positive cells, reduces the receptive field (RF) width. These data suggest that in V1 the negative feedback improves visual information processing. However, according to information theory, noise can limit information content in a signal, and to the best of our knowledge, in V1 signal-to-noise ratio (SNR) has never been estimated following either pyramidal or inhibitory neuron activation. Therefore, we optogenetically activated pyramidal or PV neurons in the deep layers of cortical area V1 and measured the SNR and RF area in nearby pyramidal neurons. Activation of pyramidal or PV neurons increased the SNR by 267% and 318%, respectively, and reduced the RF area to 60.1% and 77.5%, respectively, of that of the control. A simple integrate-and-fire neuron model demonstrated that an improved SNR and a reduced RF area can increase the amount of information encoded by neurons. We conclude that in V1 activation of pyramidal neurons improves visual information processing since the location of the visual stimulus can be pinpointed more accurately (via a reduced RF area), and more information is encoded by neurons (due to increased SNR).

Prefrontal synaptic regulation of homeostatic sleep pressure revealed through synaptic chemogenetics

Sleep is regulated by homeostatic processes, yet the biological basis of sleep pressure that accumulates during wakefulness, triggers sleep, and dissipates during sleep remains elusive. We explored a causal relationship between cellular synaptic strength and electroencephalography delta power indicating macro-level sleep pressure by developing a theoretical framework and a molecular tool to manipulate synaptic strength. The mathematical model predicted that increased synaptic strength promotes the neuronal "down state" and raises the delta power. Our molecular tool (synapse-targeted chemically induced translocation of Kalirin-7, SYNCit-K), which induces dendritic spine enlargement and synaptic potentiation through chemically induced translocation of protein Kalirin-7, demonstrated that synaptic potentiation of excitatory neurons in the prefrontal cortex (PFC) increases nonrapid eye movement sleep amounts and delta power. Thus, synaptic strength of PFC excitatory neurons dictates sleep pressure in mammals.

Coordinated changes in a cortical circuit sculpt effects of novelty on neural dynamics

Recent studies have found dramatic cell-type-specific responses to stimulus novelty, highlighting the importance of analyzing the cortical circuitry at this granularity to understand brain function. Although initial work characterized activity by cell type, the alterations in cortical circuitry due to interacting novelty effects remain unclear. We investigated circuit mechanisms underlying the observed neural dynamics in response to novel stimuli using a large-scale public dataset of electrophysiological recordings in behaving mice and a population network model. The model was constrained by multi-patch synaptic physiology and electron microscopy data. We found generally weaker connections under novel stimuli, with shifts in the balance between somatostatin (SST) and vasoactive intestinal polypeptide (VIP) populations and increased excitatory influences on parvalbumin (PV) and SST populations. These findings systematically characterize how cortical circuits adapt to stimulus novelty.

Sub-threshold neuronal activity and the dynamical regime of cerebral cortex

Cortical neurons exhibit temporally irregular spiking patterns and heterogeneous firing rates. These features arise in model circuits operating in a 'fluctuation-driven regime', in which fluctuations in membrane potentials emerge from the network dynamics. However, it is still debated whether the cortex operates in such a regime. We evaluated the fluctuation-driven hypothesis by analyzing spiking and sub-threshold membrane potentials of neurons in the frontal cortex of mice performing a decision-making task. We showed that while standard fluctuation-driven models successfully account for spiking statistics, they fall short in capturing the heterogeneity in sub-threshold activity. This limitation is an inevitable outcome of bombarding single-compartment neurons with a large number of pre-synaptic inputs, thereby clamping the voltage of all neurons to more or less the same average voltage. To address this, we effectively incorporated dendritic morphology into the standard models. Inclusion of dendritic morphology in the neuronal models increased neuronal selectivity and reduced error trials, suggesting a functional role for dendrites during decision-making. Our work suggests that, during decision-making, cortical neurons in high-order cortical areas operate in a fluctuation-driven regime.

Behavioral state and stimulus strength regulate the role of somatostatin interneurons in stabilizing network activity

Inhibition stabilization enables cortical circuits to encode sensory signals across diverse contexts. Somatostatin-expressing (SST) interneurons are well-suited for this role through their strong recurrent connectivity with excitatory pyramidal cells. We developed a cortical circuit model predicting that SST cells become increasingly important for stabilization as sensory input strengthens. We tested this prediction in mouse primary visual cortex by manipulating excitatory input to SST cells, a key parameter for inhibition stabilization, with a novel cell-type specific pharmacological method to selectively block glutamatergic receptors on SST cells. Consistent with our model predictions, we find antagonizing glutamatergic receptors drives a paradoxical facilitation of SST cells with increasing stimulus contrast. In addition, we find even stronger engagement of SST-dependent stabilization when the mice are aroused. Thus, we reveal that the role of SST cells in cortical processing gradually switches as a function of both input strength and behavioral state.

Circuit-motivated generalized affine models characterize stimulus-dependent visual cortical shared variability

Correlated variability in the visual cortex is modulated by stimulus properties. The stimulus dependence of correlated variability impacts stimulus coding and is indicative of circuit structure. An affine model combining a multiplicative factor and an additive offset has been proposed to explain how correlated variability in primary visual cortex (V1) depends on stimulus orientations. However, whether the affine model could be extended to explain modulations by other stimulus variables or variability shared between two brain areas is unknown. Motivated by a simple neural circuit mechanism, we modified the affine model to better explain the contrast dependence of neural variability shared within either primary or secondary visual cortex (V1 or V2) as well as the orientation dependence of neural variability shared between V1 and V2. Our results bridge neural circuit mechanisms and statistical models and provide a parsimonious explanation for the stimulus dependence of correlated variability within and between visual areas.

A comprehensive data-driven model of cat primary visual cortex

Knowledge integration based on the relationship between structure and function of the neural substrate is one of the main targets of neuroinformatics and data-driven computational modeling. However, the multiplicity of data sources, the diversity of benchmarks, the mixing of observables of different natures, and the necessity of a long-term, systematic approach make such a task challenging. Here we present a first snapshot of a long-term integrative modeling program designed to address this issue in the domain of the visual system: a comprehensive spiking model of cat primary visual cortex. The presented model satisfies an extensive range of anatomical, statistical and functional constraints under a wide range of visual input statistics. In the presence of physiological levels of tonic stochastic bombardment by spontaneous thalamic activity, the modeled cortical reverberations self-generate a sparse asynchronous ongoing activity that quantitatively matches a range of experimentally measured statistics. When integrating feed-forward drive elicited by a high diversity of visual contexts, the simulated network produces a realistic, quantitatively accurate interplay between visually evoked excitatory and inhibitory conductances; contrast-invariant orientation-tuning width; center surround interactions; and stimulus-dependent changes in the precision of the neural code. This integrative model offers insights into how the studied properties interact, contributing to a better understanding of visual cortical dynamics. It provides a basis for future development towards a comprehensive model of low-level perception.

A large-scale neuronal network modelling study: Stimulus size modulates gamma oscillations in the primary visual cortex by long-range connections

Stimulus size modulation of neuronal firing activity is a fundamental property of the primary visual cortex. Numerous biological experiments have shown that stimulus size modulation is affected by multiple factors at different spatiotemporal scales, but the exact pathways and mechanisms remain incompletely understood. In this paper, we establish a large-scale neuronal network model of primary visual cortex with layer 2/3 to study how gamma oscillation properties are modulated by stimulus size and especially how long-range connections affect the modulation as realistic neuronal properties and spatial distributions of synaptic connections are considered. It is shown that long-range horizontal synaptic connections are sufficient to produce dimensional modulation of firing rates and gamma oscillations. In particular, with increasing grating stimulus size, the firing rate increases and then decreases, the peak frequency of gamma oscillations decreases and the spectral power increases. These are consistent with biological experimental observations. Furthermore, we explain in detail how the number and spatial distribution of long-range connections affect the size modulation of gamma oscillations by using the analysis of neuronal firing activity and synaptic current fluctuations. Our results provide a mechanism explanation for size modulation of gamma oscillations in the primary visual cortex and reveal the important and unique role played by long-range connections, which contributes to a deeper understanding of the cognitive function of gamma oscillations in visual cortex.

Lateral inhibition in V1 controls neural & perceptual contrast sensitivity

Lateral inhibition is a central principle for sensory system function. It is thought to operate by the activation of inhibitory neurons that restrict the spatial spread of sensory excitation. Much work on the role of inhibition in sensory systems has focused on visual cortex; however, the neurons, computations, and mechanisms underlying cortical lateral inhibition remain debated, and its importance for visual perception remains unknown. Here, we tested how lateral inhibition from PV or SST neurons in mouse primary visual cortex (V1) modulates neural and perceptual sensitivity to stimulus contrast. Lateral inhibition from PV neurons reduced neural and perceptual sensitivity to visual contrast in a uniform subtractive manner, whereas lateral inhibition from SST neurons more effectively changed the slope (or gain) of neural and perceptual contrast sensitivity. A neural circuit model identified spatially extensive lateral projections from SST neurons as the key factor, and we confirmed this with anatomy and direct subthreshold measurements of a larger spatial footprint for SST versus PV lateral inhibition. Together, these results define cell-type specific computational roles for lateral inhibition in V1, and establish their unique consequences on sensitivity to contrast, a fundamental aspect of the visual world.

Learning Fixed Points of Recurrent Neural Networks by Reparameterizing the Network Model

In computational neuroscience, recurrent neural networks are widely used to model neural activity and learning. In many studies, fixed points of recurrent neural networks are used to model neural responses to static or slowly changing stimuli, such as visual cortical responses to static visual stimuli. These applications raise the question of how to train the weights in a recurrent neural network to minimize a loss function evaluated on fixed points. In parallel, training fixed points is a central topic in the study of deep equilibrium models in machine learning. A natural approach is to use gradient descent on the Euclidean space of weights. We show that this approach can lead to poor learning performance due in part to singularities that arise in the loss surface. We use a reparameterization of the recurrent network model to derive two alternative learning rules that produce more robust learning dynamics. We demonstrate that these learning rules avoid singularities and learn more effectively than standard gradient descent. The new learning rules can be interpreted as steepest descent and gradient descent, respectively, under a non-Euclidean metric on the space of recurrent weights. Our results question the common, implicit assumption that learning in the brain should be expected to follow the negative Euclidean gradient of synaptic weights.

The mechanics of correlated variability in segregated cortical excitatory subnetworks

Understanding the genesis of shared trial-to-trial variability in neuronal population activity within the sensory cortex is critical to uncovering the biological basis of information processing in the brain. Shared variability is often a reflection of the structure of cortical connectivity since it likely arises, in part, from local circuit inputs. A series of experiments from segregated networks of (excitatory) pyramidal neurons in the mouse primary visual cortex challenge this view. Specifically, the across-network correlations were found to be larger than predicted given the known weak cross-network connectivity. We aim to uncover the circuit mechanisms responsible for these enhanced correlations through biologically motivated cortical circuit models. Our central finding is that coupling each excitatory subpopulation with a specific inhibitory subpopulation provides the most robust network-intrinsic solution in shaping these enhanced correlations. This result argues for the existence of excitatory-inhibitory functional assemblies in early sensory areas which mirror not just response properties but also connectivity between pyramidal cells. Furthermore, our findings provide theoretical support for recent experimental observations showing that cortical inhibition forms structural and functional subnetworks with excitatory cells, in contrast to the classical view that inhibition is a nonspecific blanket suppression of local excitation.

Synapse-type-specific competitive Hebbian learning forms functional recurrent networks

Cortical networks exhibit complex stimulus-response patterns that are based on specific recurrent interactions between neurons. For example, the balance between excitatory and inhibitory currents has been identified as a central component of cortical computations. However, it remains unclear how the required synaptic connectivity can emerge in developing circuits where synapses between excitatory and inhibitory neurons are simultaneously plastic. Using theory and modeling, we propose that a wide range of cortical response properties can arise from a single plasticity paradigm that acts simultaneously at all excitatory and inhibitory connections-Hebbian learning that is stabilized by the synapse-type-specific competition for a limited supply of synaptic resources. In plastic recurrent circuits, this competition enables the formation and decorrelation of inhibition-balanced receptive fields. Networks develop an assembly structure with stronger synaptic connections between similarly tuned excitatory and inhibitory neurons and exhibit response normalization and orientation-specific center-surround suppression, reflecting the stimulus statistics during training. These results demonstrate how neurons can self-organize into functional networks and suggest an essential role for synapse-type-specific competitive learning in the development of cortical circuits.

The stabilized supralinear network accounts for the contrast dependence of visual cortical gamma oscillations

When stimulated, neural populations in the visual cortex exhibit fast rhythmic activity with frequencies in the gamma band (30-80 Hz). The gamma rhythm manifests as a broad resonance peak in the power-spectrum of recorded local field potentials, which exhibits various stimulus dependencies. In particular, in macaque primary visual cortex (V1), the gamma peak frequency increases with increasing stimulus contrast. Moreover, this contrast dependence is local: when contrast varies smoothly over visual space, the gamma peak frequency in each cortical column is controlled by the local contrast in that column's receptive field. No parsimonious mechanistic explanation for these contrast dependencies of V1 gamma oscillations has been proposed. The stabilized supralinear network (SSN) is a mechanistic model of cortical circuits that has accounted for a range of visual cortical response nonlinearities and contextual modulations, as well as their contrast dependence. Here, we begin by showing that a reduced SSN model without retinotopy robustly captures the contrast dependence of gamma peak frequency, and provides a mechanistic explanation for this effect based on the observed non-saturating and supralinear input-output function of V1 neurons. Given this result, the local dependence on contrast can trivially be captured in a retinotopic SSN which however lacks horizontal synaptic connections between its cortical columns. However, long-range horizontal connections in V1 are in fact strong, and underlie contextual modulation effects such as surround suppression. We thus explored whether a retinotopically organized SSN model of V1 with strong excitatory horizontal connections can exhibit both surround suppression and the local contrast dependence of gamma peak frequency. We found that retinotopic SSNs can account for both effects, but only when the horizontal excitatory projections are composed of two components with different patterns of spatial fall-off with distance: a short-range component that only targets the source column, combined with a long-range component that targets columns neighboring the source column. We thus make a specific qualitative prediction for the spatial structure of horizontal connections in macaque V1, consistent with the columnar structure of cortex.

Self-organization of modular activity in immature cortical networks

During development, cortical activity is organized into distributed modular patterns that are a precursor of the mature columnar functional architecture. Theoretically, such structured neural activity can emerge dynamically from local synaptic interactions through a recurrent network with effective local excitation with lateral inhibition (LE/LI) connectivity. Utilizing simultaneous widefield calcium imaging and optogenetics in juvenile ferret cortex prior to eye opening, we directly test several critical predictions of an LE/LI mechanism. We show that cortical networks transform uniform stimulations into diverse modular patterns exhibiting a characteristic spatial wavelength. Moreover, patterned optogenetic stimulation matching this wavelength selectively biases evoked activity patterns, while stimulation with varying wavelengths transforms activity towards this characteristic wavelength, revealing a dynamic compromise between input drive and the network's intrinsic tendency to organize activity. Furthermore, the structure of early spontaneous cortical activity - which is reflected in the developing representations of visual orientation - strongly overlaps that of uniform opto-evoked activity, suggesting a common underlying mechanism as a basis for the formation of orderly columnar maps underlying sensory representations in the brain.

Approximating Nonlinear Functions With Latent Boundaries in Low-Rank Excitatory-Inhibitory Spiking Networks

Deep feedforward and recurrent neural networks have become successful functional models of the brain, but they neglect obvious biological details such as spikes and Dale's law. Here we argue that these details are crucial in order to understand how real neural circuits operate. Towards this aim, we put forth a new framework for spike-based computation in low-rank excitatory-inhibitory spiking networks. By considering populations with rank-1 connectivity, we cast each neuron's spiking threshold as a boundary in a low-dimensional input-output space. We then show how the combined thresholds of a population of inhibitory neurons form a stable boundary in this space, and those of a population of excitatory neurons form an unstable boundary. Combining the two boundaries results in a rank-2 excitatory-inhibitory (EI) network with inhibition-stabilized dynamics at the intersection of the two boundaries. The computation of the resulting networks can be understood as the difference of two convex functions and is thereby capable of approximating arbitrary non-linear input-output mappings. We demonstrate several properties of these networks, including noise suppression and amplification, irregular activity and synaptic balance, as well as how they relate to rate network dynamics in the limit that the boundary becomes soft. Finally, while our work focuses on small networks (5-50 neurons), we discuss potential avenues for scaling up to much larger networks. Overall, our work proposes a new perspective on spiking networks that may serve as a starting point for a mechanistic understanding of biological spike-based computation.

Neural correlates of perceptual similarity masking in primate V1

Visual detection is a fundamental natural task. Detection becomes more challenging as the similarity between the target and the background in which it is embedded increases, a phenomenon termed 'similarity masking'. To test the hypothesis that V1 contributes to similarity masking, we used voltage sensitive dye imaging (VSDI) to measure V1 population responses while macaque monkeys performed a detection task under varying levels of target-background similarity. Paradoxically, we find that during an initial transient phase, V1 responses to the target are enhanced, rather than suppressed, by target-background similarity. This effect reverses in the second phase of the response, so that in this phase V1 signals are positively correlated with the behavioral effect of similarity. Finally, we show that a simple model with delayed divisive normalization can qualitatively account for our findings. Overall, our results support the hypothesis that a nonlinear gain control mechanism in V1 contributes to perceptual similarity masking.

Response sub-additivity and variability quenching in visual cortex

Sub-additivity and variability are ubiquitous response motifs in the primary visual cortex (V1). Response sub-additivity enables the construction of useful interpretations of the visual environment, whereas response variability indicates the factors that limit the precision with which the brain can do this. There is increasing evidence that experimental manipulations that elicit response sub-additivity often also quench response variability. Here, we provide an overview of these phenomena and suggest that they may have common origins. We discuss empirical findings and recent model-based insights into the functional operations, computational objectives and circuit mechanisms underlying V1 activity. These different modelling approaches all predict that response sub-additivity and variability quenching often co-occur. The phenomenology of these two response motifs, as well as many of the insights obtained about them in V1, generalize to other cortical areas. Thus, the connection between response sub-additivity and variability quenching may be a canonical motif across the cortex.

Functional specificity of recurrent inhibition in visual cortex

In the neocortex, neural activity is shaped by the interaction of excitatory and inhibitory neurons, defined by the organization of their synaptic connections. Although connections among excitatory pyramidal neurons are sparse and functionally tuned, inhibitory connectivity is thought to be dense and largely unstructured. By measuring in vivo visual responses and synaptic connectivity of parvalbumin-expressing (PV+) inhibitory cells in mouse primary visual cortex, we show that the synaptic weights of their connections to nearby pyramidal neurons are specifically tuned according to the similarity of the cells' responses. Individual PV+ cells strongly inhibit those pyramidal cells that provide them with strong excitation and share their visual selectivity. This structured organization of inhibitory synaptic weights provides a circuit mechanism for tuned inhibition onto pyramidal cells despite dense connectivity, stabilizing activity within feature-specific excitatory ensembles while supporting competition between them.

The influence of cortical activity on perception depends on behavioral state and sensory context

The mechanistic link between neural circuit activity and behavior remains unclear. While manipulating cortical activity can bias certain behaviors and elicit artificial percepts, some tasks can still be solved when cortex is silenced or removed. Here, mice were trained to perform a visual detection task during which we selectively targeted groups of visually responsive and co-tuned neurons in L2/3 of primary visual cortex (V1) for two-photon photostimulation. The influence of photostimulation was conditional on two key factors: the behavioral state of the animal and the contrast of the visual stimulus. The detection of low-contrast stimuli was enhanced by photostimulation, while the detection of high-contrast stimuli was suppressed, but crucially, only when mice were highly engaged in the task. When mice were less engaged, our manipulations of cortical activity had no effect on behavior. The behavioral changes were linked to specific changes in neuronal activity. The responses of non-photostimulated neurons in the local network were also conditional on two factors: their functional similarity to the photostimulated neurons and the contrast of the visual stimulus. Functionally similar neurons were increasingly suppressed by photostimulation with increasing visual stimulus contrast, correlating with the change in behavior. Our results show that the influence of cortical activity on perception is not fixed, but dynamically and contextually modulated by behavioral state, ongoing activity and the routing of information through specific circuits.

Self-organization of modular activity in immature cortical networks

During development, cortical activity is organized into distributed modular patterns that are a precursor of the mature columnar functional architecture. Theoretically, such structured neural activity can emerge dynamically from local synaptic interactions through a recurrent network with effective local excitation with lateral inhibition (LE/LI) connectivity. Utilizing simultaneous widefield calcium imaging and optogenetics in juvenile ferret cortex prior to eye opening, we directly test several critical predictions of an LE/LI mechanism. We show that cortical networks transform uniform stimulations into diverse modular patterns exhibiting a characteristic spatial wavelength. Moreover, patterned optogenetic stimulation matching this wavelength selectively biases evoked activity patterns, while stimulation with varying wavelengths transforms activity towards this characteristic wavelength, revealing a dynamic compromise between input drive and the network's intrinsic tendency to organize activity. Furthermore, the structure of early spontaneous cortical activity - which is reflected in the developing representations of visual orientation - strongly overlaps that of uniform opto-evoked activity, suggesting a common underlying mechanism as a basis for the formation of orderly columnar maps underlying sensory representations in the brain.

Primate neocortex performs balanced sensory amplification

The sensory cortex amplifies relevant features of external stimuli. This sensitivity and selectivity arise through the transformation of inputs by cortical circuitry. We characterize the circuit mechanisms and dynamics of cortical amplification by making large-scale simultaneous measurements of single cells in awake primates and testing computational models. By comparing network activity in both driven and spontaneous states with models, we identify the circuit as operating in a regime of non-normal balanced amplification. Incoming inputs are strongly but transiently amplified by strong recurrent feedback from the disruption of excitatory-inhibitory balance in the network. Strong inhibition rapidly quenches responses, thereby permitting the tracking of time-varying stimuli.

On the contrast response function of adapted neural populations

The magnitude of neural responses in sensory cortex depends on the intensity of a stimulus and its probability of being observed within the environment. How these two variables combine to influence the overall response of cortical populations remains unknown. Here we show that, in primary visual cortex, the vector magnitude of the population response is described by a separable power law that factors the intensity of a stimulus and its probability. Moreover, the discriminability between two contrast levels in a cortical population is proportional to the logarithm of the contrast ratio.NEW & NOTEWORTHY The magnitude of neural responses in sensory cortex depends on the intensity of a stimulus and its probability of being observed within the environment. The authors show that, in primary visual cortex, the vector magnitude of the population response is described by a separable power law that factors the intensity of a stimulus and its probability.

The logic of recurrent circuits in the primary visual cortex

Recurrent cortical activity sculpts visual perception by refining, amplifying or suppressing visual input. However, the rules that govern the influence of recurrent activity remain enigmatic. We used ensemble-specific two-photon optogenetics in the mouse visual cortex to isolate the impact of recurrent activity from external visual input. We found that the spatial arrangement and the visual feature preference of the stimulated ensemble and the neighboring neurons jointly determine the net effect of recurrent activity. Photoactivation of these ensembles drives suppression in all cells beyond 30 µm but uniformly drives activation in closer similarly tuned cells. In nonsimilarly tuned cells, compact, cotuned ensembles drive net suppression, while diffuse, cotuned ensembles drive activation. Computational modeling suggests that highly local recurrent excitatory connectivity and selective convergence onto inhibitory neurons explain these effects. Our findings reveal a straightforward logic in which space and feature preference of cortical ensembles determine their impact on local recurrent activity.

Exact Analysis of the Subthreshold Variability for Conductance-Based Neuronal Models with Synchronous Synaptic Inputs

The spiking activity of neocortical neurons exhibits a striking level of variability, even when these networks are driven by identical stimuli. The approximately Poisson firing of neurons has led to the hypothesis that these neural networks operate in the asynchronous state. In the asynchronous state, neurons fire independently from one another, so that the probability that a neuron experience synchronous synaptic inputs is exceedingly low. While the models of asynchronous neurons lead to observed spiking variability, it is not clear whether the asynchronous state can also account for the level of subthreshold membrane potential variability. We propose a new analytical framework to rigorously quantify the subthreshold variability of a single conductance-based neuron in response to synaptic inputs with prescribed degrees of synchrony. Technically, we leverage the theory of exchangeability to model input synchrony via jump-process-based synaptic drives; we then perform a moment analysis of the stationary response of a neuronal model with all-or-none conductances that neglects postspiking reset. As a result, we produce exact, interpretable closed forms for the first two stationary moments of the membrane voltage, with explicit dependence on the input synaptic numbers, strengths, and synchrony. For biophysically relevant parameters, we find that the asynchronous regime yields realistic subthreshold variability (voltage variance ≃4-9 mV2) only when driven by a restricted number of large synapses, compatible with strong thalamic drive. By contrast, we find that achieving realistic subthreshold variability with dense cortico-cortical inputs requires including weak but nonzero input synchrony, consistent with measured pairwise spiking correlations. We also show that, without synchrony, the neural variability averages out to zero for all scaling limits with vanishing synaptic weights, independent of any balanced state hypothesis. This result challenges the theoretical basis for mean-field theories of the asynchronous state.

Decentralized Neural Circuits of Multisensory Information Integration in the Brain

The brain combines multisensory inputs together to obtain a complete and reliable description of the world. Recent experiments suggest that several interconnected multisensory brain areas are simultaneously involved to integrate multisensory information. It was unknown how these mutually connected multisensory areas achieve multisensory integration. To answer this question, using biologically plausible neural circuit models we developed a decentralized system for information integration that comprises multiple interconnected multisensory brain areas. Through studying an example of integrating visual and vestibular cues to infer heading direction, we show that such a decentralized system is well consistent with experimental observations. In particular, we demonstrate that this decentralized system can optimally integrate information by implementing sampling-based Bayesian inference. The Poisson variability of spike generation provides appropriate variability to drive sampling, and the interconnections between multisensory areas store the correlation prior between multisensory stimuli. The decentralized system predicts that optimally integrated information emerges locally from the dynamics of the communication between brain areas and sheds new light on the interpretation of the connectivity between multisensory brain areas.

Exact analysis of the subthreshold variability for conductance-based neuronal models with synchronous synaptic inputs

The spiking activity of neocortical neurons exhibits a striking level of variability, even when these networks are driven by identical stimuli. The approximately Poisson firing of neurons has led to the hypothesis that these neural networks operate in the asynchronous state. In the asynchronous state neurons fire independently from one another, so that the probability that a neuron experience synchronous synaptic inputs is exceedingly low. While the models of asynchronous neurons lead to observed spiking variability, it is not clear whether the asynchronous state can also account for the level of subthreshold membrane potential variability. We propose a new analytical framework to rigorously quantify the subthreshold variability of a single conductance-based neuron in response to synaptic inputs with prescribed degrees of synchrony. Technically we leverage the theory of exchangeability to model input synchrony via jump-process-based synaptic drives; we then perform a moment analysis of the stationary response of a neuronal model with all-or-none conductances that neglects post-spiking reset. As a result, we produce exact, interpretable closed forms for the first two stationary moments of the membrane voltage, with explicit dependence on the input synaptic numbers, strengths, and synchrony. For biophysically relevant parameters, we find that the asynchronous regime only yields realistic subthreshold variability (voltage variance ≃ 4 - 9 m V 2 ) when driven by a restricted number of large synapses, compatible with strong thalamic drive. By contrast, we find that achieving realistic subthreshold variability with dense cortico-cortical inputs requires including weak but nonzero input synchrony, consistent with measured pairwise spiking correlations. We also show that without synchrony, the neural variability averages out to zero for all scaling limits with vanishing synaptic weights, independent of any balanced state hypothesis. This result challenges the theoretical basis for mean-field theories of the asynchronous state.

Mechanisms underlying reshuffling of visual responses by optogenetic stimulation in mice and monkeys

The ability to optogenetically perturb neural circuits opens an unprecedented window into mechanisms governing circuit function. We analyzed and theoretically modeled neuronal responses to visual and optogenetic inputs in mouse and monkey V1. In both species, optogenetic stimulation of excitatory neurons strongly modulated the activity of single neurons yet had weak or no effects on the distribution of firing rates across the population. Thus, the optogenetic inputs reshuffled firing rates across the network. Key statistics of mouse and monkey responses lay on a continuum, with mice/monkeys occupying the low-/high-rate regions, respectively. We show that neuronal reshuffling emerges generically in randomly connected excitatory/inhibitory networks, provided the coupling strength (combination of recurrent coupling and external input) is sufficient that powerful inhibitory feedback cancels the mean optogenetic input. A more realistic model, distinguishing tuned visual vs. untuned optogenetic input in a structured network, reduces the coupling strength needed to explain reshuffling.

Modeling the Role of Contour Integration in Visual Inference

Under difficult viewing conditions, the brain's visual system uses a variety of recurrent modulatory mechanisms to augment feedforward processing. One resulting phenomenon is contour integration, which occurs in the primary visual (V1) cortex and strengthens neural responses to edges if they belong to a larger smooth contour. Computational models have contributed to an understanding of the circuit mechanisms of contour integration, but less is known about its role in visual perception. To address this gap, we embedded a biologically grounded model of contour integration in a task-driven artificial neural network and trained it using a gradient-descent variant. We used this model to explore how brain-like contour integration may be optimized for high-level visual objectives as well as its potential roles in perception. When the model was trained to detect contours in a background of random edges, a task commonly used to examine contour integration in the brain, it closely mirrored the brain in terms of behavior, neural responses, and lateral connection patterns. When trained on natural images, the model enhanced weaker contours and distinguished whether two points lay on the same versus different contours. The model learned robust features that generalized well to out-of-training-distribution stimuli. Surprisingly, and in contrast with the synthetic task, a parameter-matched control network without recurrence performed the same as or better than the model on the natural-image tasks. Thus, a contour integration mechanism is not essential to perform these more naturalistic contour-related tasks. Finally, the best performance in all tasks was achieved by a modified contour integration model that did not distinguish between excitatory and inhibitory neurons.

Multilevel and multifaceted brain response features in spiking, ERP and ERD: experimental observation and simultaneous generation in a neuronal network model with excitation-inhibition balance

Brain as a dynamic system responds to stimulations with specific patterns affected by its inherent ongoing dynamics. The patterns are manifested across different levels of organization-from spiking activity of neurons to collective oscillations in local field potential (LFP) and electroencephalogram (EEG). The multilevel and multifaceted response activities show patterns seemingly distinct and non-comparable from each other, but they should be coherently related because they are generated from the same underlying neural dynamic system. A coherent understanding of the interrelationships between different levels/aspects of activity features is important for understanding the complex brain functions. Here, based on analysis of data from human EEG, monkey LFP and neuronal spiking, we demonstrated that the brain response activities from different levels of neural system are highly coherent: the external stimulus simultaneously generated event-related potentials, event-related desynchronization, and variation in neuronal spiking activities that precisely match with each other in the temporal unfolding. Based on a biologically plausible but generic network of conductance-based integrate-and-fire excitatory and inhibitory neurons with dense connections, we showed that the multiple key features can be simultaneously produced at critical dynamical regimes supported by excitation-inhibition (E-I) balance. The elucidation of the inherent coherency of various neural response activities and demonstration of a simple dynamical neural circuit system having the ability to simultaneously produce multiple features suggest the plausibility of understanding high-level brain function and cognition from elementary and generic neuronal dynamics.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11571-022-09889-w.

Computational role of sleep in memory reorganization

Sleep is considered to play an essential role in memory reorganization. Despite its importance, classical theoretical models did not focus on some sleep characteristics. Here, we review recent theoretical approaches investigating their roles in learning and discuss the possibility that non-rapid eye movement (NREM) sleep selectively consolidates memory, and rapid eye movement (REM) sleep reorganizes the representations of memories. We first review the possibility that slow waves during NREM sleep contribute to memory selection by using sequential firing patterns and the existence of up and down states. Second, we discuss the role of dreaming during REM sleep in developing neuronal representations. We finally discuss how to develop these points further, emphasizing the connections to experimental neuroscience and machine learning.

Sampling-based Bayesian inference in recurrent circuits of stochastic spiking neurons

Two facts about cortex are widely accepted: neuronal responses show large spiking variability with near Poisson statistics and cortical circuits feature abundant recurrent connections between neurons. How these spiking and circuit properties combine to support sensory representation and information processing is not well understood. We build a theoretical framework showing that these two ubiquitous features of cortex combine to produce optimal sampling-based Bayesian inference. Recurrent connections store an internal model of the external world, and Poissonian variability of spike responses drives flexible sampling from the posterior stimulus distributions obtained by combining feedforward and recurrent neuronal inputs. We illustrate how this framework for sampling-based inference can be used by cortex to represent latent multivariate stimuli organized either hierarchically or in parallel. A neural signature of such network sampling are internally generated differential correlations whose amplitude is determined by the prior stored in the circuit, which provides an experimentally testable prediction for our framework.