Spontaneous behaviors drive multidimensional, brainwide activity

EEG of the Dancing Brain: Decoding Sensory, Motor, and Social Processes during Dyadic Dance

Real-world social cognition requires processing and adapting to multiple dynamic information streams. Interpreting neural activity in such ecological conditions remains a key challenge for neuroscience. This study leverages advancements in denoising techniques and multivariate modeling to extract interpretable EEG signals from pairs of (male and/or female) participants engaged in spontaneous dyadic dance. Using multivariate temporal response functions (mTRFs), we investigated how music acoustics, self-generated kinematics, other-generated kinematics, and social coordination uniquely contributed to EEG activity. Electromyogram recordings from ocular, face, and neck muscles were also modeled to control for artifacts. The mTRFs effectively disentangled neural signals associated with four processes: (I) auditory tracking of music, (II) control of self-generated movements, (III) visual monitoring of partner movements, and (IV) visual tracking of social coordination. We show that the first three neural signals are driven by event-related potentials: the P50-N100-P200 triggered by acoustic events, the central lateralized movement-related cortical potentials triggered by movement initiation, and the occipital N170 triggered by movement observation. Notably, the (previously unknown) neural marker of social coordination encodes the spatiotemporal alignment between dancers, surpassing the encoding of self- or partner-related kinematics taken alone. This marker emerges when partners can see each other, exhibits a topographical distribution over occipital areas, and is specifically driven by movement observation rather than initiation. Using data-driven kinematic decomposition, we further show that vertical bounce movements best drive observers' EEG activity. These findings highlight the potential of real-world neuroimaging, combined with multivariate modeling, to uncover the mechanisms underlying complex yet natural social behaviors.

Network influence determines the impact of cortical ensembles on stimulus detection

Causally connecting neural activity patterns to behavioral decisions is essential to understand the neural code but requires direct perturbation of the pattern of interest with high specificity. We combined two-photon imaging and cellular-resolution holographic optogenetic photostimulation to causally test how neural activity in the mouse visual cortex is read out to detect visual stimuli. Contrary to expectations, targeted activation of visually sensitive neural ensembles did not preferentially modify behavior compared with targeting randomly selected ensembles. Instead, an activated ensemble's effect on local network activity was the main predictor of its impact on perception. This suggests that downstream regions summate visual cortex activity without preferentially weighting more informative neurons, a notion confirmed by analyzing the impact of photostimulation on decoding models of neural activity. This work challenges conventional notions for how sensory representations mediate perception and demonstrates that perturbing activity is essential to determine which features of neural activity drive behavior.

The predictive nature of spontaneous brain activity across scales and species

Emerging research suggests the brain operates as a "prediction machine," continuously anticipating sensory, motor, and cognitive outcomes. Central to this capability is the brain's spontaneous activity-ongoing internal processes independent of external stimuli. Neuroimaging and computational studies support that this activity is integral to maintaining and refining mental models of our environment, body, and behaviors, akin to generative models in computation. During rest, spontaneous activity expands the variability of potential representations, enhancing the accuracy and adaptability of these models. When performing tasks, internal models direct brain regions to anticipate sensory and motor states, optimizing performance. This review synthesizes evidence from various species, from C. elegans to humans, highlighting three key aspects of spontaneous brain activity's role in prediction: the similarity between spontaneous and task-related activity, the encoding of behavioral and interoceptive priors, and the high metabolic cost of this activity, underscoring prediction as a fundamental function of brains across species.

Firing Activities of REM- and NREM-Preferring Neurons Are Differently Modulated by Fast Network Oscillations and Behavior in the Hippocampus, Prelimbic Cortex, and Amygdala

Sleep consists of two alternating states-rapid eye movement (REM) and non-REM (NREM) sleep. Neurons adjust their firing activity based on brain state, however, the extent to which this modulation varies across neurons and brain regions remains poorly understood. This study analyzed previously acquired 17-h continuous recordings of single-unit activity and local field potentials in the ventral hippocampal CA1 region, prelimbic cortex layer 5, and basolateral nucleus of the amygdala of fear-conditioned rats. The findings indicate that more than half of the neurons fired faster during REM sleep than during NREM sleep, although a notable subset of neurons exhibited the opposite preference, firing preferentially during NREM sleep. During sleep, the overall firing activity of both REM- and NREM-preferring neurons decreased. However, fast network oscillations, including hippocampal sharp-wave ripples (SWRs), amygdalar high-frequency oscillations, cortical ripples, and cortical spindles, differentially modulated REM- versus NREM-preferring neurons. During wakefulness, REM-preferring neurons fired more slowly but were more intensely activated by SWRs and shock presentations than NREM-preferring neurons. Moreover, during fast network oscillations in sleep, neurons with similar REM/NREM preferences exhibited stronger within- and cross-regional coactivation than those with differing preferences. Conversely, during awake SWRs in fear conditioning sessions, neurons with different REM/NREM preferences showed stronger interregional coactivation than those with similar preferences. These findings suggest that the distinct activity patterns of REM- and NREM-preferring neurons, potentially reflecting different roles in memory, affect local and global networks differently, thereby balancing experience-dependent network modifications with sleep-dependent homeostatic regulation of neuronal excitability.

Brain-wide presynaptic networks of functionally distinct cortical neurons

Revealing the connectivity of functionally identified individual neurons is necessary to understand how activity patterns emerge and support behaviour. Yet the brain-wide presynaptic wiring rules that lay the foundation for the functional selectivity of individual neurons remain largely unexplored. Cortical neurons, even in primary sensory cortex, are heterogeneous in their selectivity, not only to sensory stimuli but also to multiple aspects of behaviour. Here, to investigate presynaptic connectivity rules underlying the selectivity of pyramidal neurons to behavioural state1-10 in primary somatosensory cortex (S1), we used two-photon calcium imaging, neuropharmacology, single-cell-based monosynaptic input tracing and optogenetics. We show that behavioural state-dependent activity patterns are stable over time. These are minimally affected by direct neuromodulatory inputs and are driven primarily by glutamatergic inputs. Analysis of brain-wide presynaptic networks of individual neurons with distinct behavioural state-dependent activity profiles revealed that although behavioural state-related and behavioural state-unrelated neurons shared a similar pattern of local inputs within S1, their long-range glutamatergic inputs differed. Individual cortical neurons, irrespective of their functional properties, received converging inputs from the main S1-projecting areas. Yet neurons that tracked behavioural state received a smaller proportion of motor cortical inputs and a larger proportion of thalamic inputs. Optogenetic suppression of thalamic inputs reduced behavioural state-dependent activity in S1, but this activity was not externally driven. Our results reveal distinct long-range glutamatergic inputs as a substrate for preconfigured network dynamics associated with behavioural state.

Auditory cortex learns to discriminate audiovisual cues through selective multisensory enhancement

Multisensory object discrimination is essential in everyday life, yet the neural mechanisms underlying this process remain unclear. In this study, we trained rats to perform a two-alternative forced-choice task using both auditory and visual cues. Our findings reveal that multisensory perceptual learning actively engages auditory cortex (AC) neurons in both visual and audiovisual processing. Importantly, many audiovisual neurons in the AC exhibited experience-dependent associations between their visual and auditory preferences, displaying a unique integration model. This model employed selective multisensory enhancement for the auditory-visual pairing guiding the contralateral choice, which correlated with improved multisensory discrimination. Furthermore, AC neurons effectively distinguished whether a preferred auditory stimulus was paired with its associated visual stimulus using this distinct integrative mechanism. Our results highlight the capability of sensory cortices to develop sophisticated integrative strategies, adapting to task demands to enhance multisensory discrimination abilities.

Suite3D: Volumetric cell detection for two-photon microscopy

In two-photon imaging of neuronal activity it is common to acquire 3-dimensional volumes. However, these volumes are typically processed plane by plane, leading to duplicated cells across planes, reduced signal-to-noise ratio per cell, uncorrected axial movement, and missed cells. To overcome these limitations, we introduce Suite3D, a volumetric cell detection pipeline. Suite3D corrects for 3D brain motion, estimating axial motion and improving estimates of lateral motion. It detects neurons using 3D correlation, which improves the signal-to-background ratio and detectability of cells. Finally, it performs 3D segmentation, detecting cells across imaging planes. We validated Suite3D with data from conventional multi-plane microscopes and advanced volumetric microscopes, at various resolutions and in various brain regions. Suite3D successfully detected cells appearing on multiple imaging planes, improving cell detectability and signal quality, avoiding duplications, and running >20x faster than a prior volumetric pipeline. Suite3D offers a powerful solution for analyzing volumetric two-photon data.

Thalamic feedback shapes brain responses evoked by cortical stimulation in mice and humans

Cortical stimulation with single pulses is a common technique in clinical practice and research. However, we still do not understand the extent to which it engages subcortical circuits that may contribute to the associated evoked potentials (EPs). Here we show that cortical stimulation generates remarkably similar EPs in humans and mice, with a late component similarly modulated by the state of the targeted cortico-thalamic network. We then optogenetically dissect the underlying circuit in mice, demonstrating that the EPs late component is caused by a thalamic hyperpolarization and rebound. The magnitude of this late component correlates with bursting frequency and synchronicity of thalamic neurons, modulated by the subject's behavioral state. A simulation of the thalamo-cortical circuit highlights that both intrinsic thalamic currents as well as cortical and thalamic GABAergic neurons contribute to this response profile. We conclude that single pulse cortical stimulation engages cortico-thalamo-cortical circuits largely preserved across different species and stimulation modalities.

Multiplexing of cognitive encoding by oculomotor networks leads to incidental gaze shifts

Humans and other animals are adept at learning to perform cognitively demanding behavioral tasks. Neurophysiological recordings in nonhuman primates during such tasks find that the requisite cognitive variables are encoded strongly in core oculomotor brain regions. Here, we assembled a large dataset-11 monkeys performing an abstract visual categorization task, surveyed across more than 1,000 neural recording sessions-to reveal that this produces a robust but uninstructed behavioral "tell," observed in all subjects and experiments: small, cognitively modulated eye movements. We find that these eye movements are causally linked to activity in SC but not LIP, and that they occur following transient alignment of cognitive and saccadic population coding subspaces in SC. This behavioral signature of oculomotor engagement is absent during a similar task that does not require rule-based categorization, suggesting that abstract task behaviors recruit primate oculomotor networks more strongly than previously understood.

Dynamic grouping of ongoing activity in V1 hypercolumns

Neurons' spontaneous activity provides rich information about the brain. A single neuron's activity has close relationships with the local network. In order to understand such relationships, we studied the spontaneous activity of thousands of neurons in macaque V1 and V2 with two-photon calcium imaging. In V1, the ongoing activity was dominated by global fluctuations in which the activity of majority of neurons were correlated. Neurons' activity also relied on their relative locations within the local functional architectures, including ocular dominance, orientation, and color maps. Neurons with similar preferences dynamically grouped into co-activating ensembles and exhibited spatial patterns resembling the local functional maps. Different ensembles had different strengths and frequencies. This observation was consistent across all hypercolumn-sized V1 locations we examined. In V2, different imaging sites had different orientation and color features. However, the spontaneous activity in the sampled regions also correlated with the underlying functional architectures. These results indicate that functional architectures play an essential role in influencing neurons' spontaneous activity.

Dynamic categorization rules alter representations in human visual cortex

Everyday tasks often require stimuli to be categorized dynamically, such that an identical object can elicit different responses based on the current decision rule. Traditionally, sensory regions have been viewed as separate from such context-dependent processing, functioning primarily to process incoming inputs. However, an alternative view suggests sensory regions also integrate inputs with current task goals, facilitating more efficient information relay to higher-level areas. Here we test this by asking human participants to visually categorize novel shape stimuli based on different decision boundaries. Using fMRI and multivariate analyses of retinotopically-defined visual areas, we show that cortical shape representations become more distinct across relevant decision boundaries in a context-dependent manner, with the largest changes in discriminability observed for stimuli near the decision boundary. Importantly, these modulations are associated with improved task performance. These findings demonstrate that visual cortex representations are adaptively modulated to support dynamic behavior.

A comprehensive suite for extracting neuron signals across multiple sessions in one-photon calcium imaging

We developed CaliAli, a comprehensive suite designed to extract neuronal signals from one-photon calcium imaging data collected across multiple sessions in free-moving conditions in mice. CaliAli incorporates information from blood vessels and neurons to correct inter-session misalignments, making it robust against non-rigid brain deformations even after substantial changes in the field of view across sessions. This also makes CaliAli robust against high neuron overlap and changes in active neuron population across sessions. CaliAli performs computationally efficient signal extraction from concatenated video sessions that enhances the detectability of weak calcium signals. Notably, CaliAli enhanced the spatial coding accuracy of extracted hippocampal CA1 neuron activity across sessions. An optogenetic tagging experiment showed that CaliAli enhanced neuronal trackability in the dentate gyrus across a time scale of weeks. Finally, dentate gyrus neurons tracked using CaliAli exhibited stable population activity for 99 days. Overall, CaliAli advances our capacity to understand the activity dynamics of neuronal ensembles over time, which is crucial for deciphering the complex neuronal substrates of natural animal behaviors.

Multiplexed subspaces route neural activity across brain-wide networks

Cognition is flexible, allowing behavior to change on a moment-by-moment basis. Such flexibility relies on the brain's ability to route information through different networks of brain regions to perform different cognitive computations. However, the mechanisms that determine which network of regions is active are not well understood. Here, we combined cortex-wide calcium imaging with high-density electrophysiological recordings in eight cortical and subcortical regions of mice to understand the interactions between regions. We found different dimensions within the population activity of each region were functionally connected with different cortex-wide 'subspace networks' of regions. These subspace networks were multiplexed; each region was functionally connected with multiple independent, yet overlapping, subspace networks. The subspace network that was active changed from moment-to-moment. These changes were associated with changes in the geometric relationship between the neural response within a region and the subspace dimensions: when neural responses were aligned with (i.e., projected along) a subspace dimension, neural activity was increased in the associated regions. Together, our results suggest that changing the geometry of neural representations within a brain region may allow the brain to flexibly engage different brain-wide networks, thereby supporting cognitive flexibility.

Neural heterogeneity enhances reliable neural information processing: Local sensitivity and globally input-slaved transient dynamics

Cortical neuronal activity varies over time and across repeated trials, yet consistently represents stimulus features. The dynamical mechanism underlying this reliable representation and computation remains elusive. This study uncovers a mechanism for reliable neural information processing, leveraging a biologically plausible network model incorporating neural heterogeneity. First, we investigate neuronal timescale diversity, revealing that it disrupts intrinsic coherent spatiotemporal patterns, induces firing rate heterogeneity, enhances local responsive sensitivity, and aligns network activity closely with input. The system exhibits globally input-slaved transient dynamics, essential for reliable neural information processing. Other neural heterogeneities, such as nonuniform input connections, spike threshold heterogeneity, and network in-degree heterogeneity, play similar roles, highlighting the importance of neural heterogeneity in shaping consistent stimulus representation. This mechanism offers a potentially general framework for understanding neural heterogeneity in reliable computation and informs the design of reservoir computing models endowed with liquid wave reservoirs for neuromorphic computing.

Learning produces an orthogonalized state machine in the hippocampus

Cognitive maps confer animals with flexible intelligence by representing spatial, temporal and abstract relationships that can be used to shape thought, planning and behaviour. Cognitive maps have been observed in the hippocampus1, but their algorithmic form and learning mechanisms remain obscure. Here we used large-scale, longitudinal two-photon calcium imaging to record activity from thousands of neurons in the CA1 region of the hippocampus while mice learned to efficiently collect rewards from two subtly different linear tracks in virtual reality. Throughout learning, both animal behaviour and hippocampal neural activity progressed through multiple stages, gradually revealing improved task representation that mirrored improved behavioural efficiency. The learning process involved progressive decorrelations in initially similar hippocampal neural activity within and across tracks, ultimately resulting in orthogonalized representations resembling a state machine capturing the inherent structure of the task. This decorrelation process was driven by individual neurons acquiring task-state-specific responses (that is, 'state cells'). Although various standard artificial neural networks did not naturally capture these dynamics, the clone-structured causal graph, a hidden Markov model variant, uniquely reproduced both the final orthogonalized states and the learning trajectory seen in animals. The observed cellular and population dynamics constrain the mechanisms underlying cognitive map formation in the hippocampus, pointing to hidden state inference as a fundamental computational principle, with implications for both biological and artificial intelligence.

Sensory Encoding Alternates With Hippocampal Ripples across Cycles of Forebrain Spiking Cascades

The brain's response to external events depends on its internal arousal states, which are dynamically governed by neuromodulatory systems and have recently been linked to coordinated spike timing cascades in widespread brain networks. At rest, both arousal fluctuations and spiking cascades are evident throughout the forebrain and play out over multisecond time scales. Here, by analyzing large-scale neural recording data collected by the Allen Institute, it is demonstrated that these intrinsic processes persist across the mouse brain even during periods of continuous visual stimulation. In the stationary animal, each quasi-periodic cascade cycle systematically influenced 1) the efficacy of encoding in visually responsive brain areas and 2) the incidence of memory-related hippocampal ripples. During this cycle, the phase of high arousal is marked by high efficiency in visual encoding whereas the phase of low arousal is marked by the occurrence of hippocampal ripples. However, during bouts of active locomotion, this cycle is abolished and brain maintained a state of elevated visual coding efficiency, with ripples being nearly absent. It is hypothesized that the infra-slow cascade dynamics reflect an adaptive cycle of alternating exteroceptive sensory sampling and internal mnemonic function that persistently pervades the forebrain, only stopping during active exploration of the environment.

Functional connectomics reveals general wiring rule in mouse visual cortex

Understanding the relationship between circuit connectivity and function is crucial for uncovering how the brain computes. In mouse primary visual cortex, excitatory neurons with similar response properties are more likely to be synaptically connected1-8; however, broader connectivity rules remain unknown. Here we leverage the millimetre-scale MICrONS dataset to analyse synaptic connectivity and functional properties of neurons across cortical layers and areas. Our results reveal that neurons with similar response properties are preferentially connected within and across layers and areas-including feedback connections-supporting the universality of 'like-to-like' connectivity across the visual hierarchy. Using a validated digital twin model, we separated neuronal tuning into feature (what neurons respond to) and spatial (receptive field location) components. We found that only the feature component predicts fine-scale synaptic connections beyond what could be explained by the proximity of axons and dendrites. We also discovered a higher-order rule whereby postsynaptic neuron cohorts downstream of presynaptic cells show greater functional similarity than predicted by a pairwise like-to-like rule. Recurrent neural networks trained on a simple classification task develop connectivity patterns that mirror both pairwise and higher-order rules, with magnitudes similar to those in MICrONS data. Ablation studies in these recurrent neural networks reveal that disrupting like-to-like connections impairs performance more than disrupting random connections. These findings suggest that these connectivity principles may have a functional role in sensory processing and learning, highlighting shared principles between biological and artificial systems.

Overlapping Cortical Substrate of Biomechanical Control and Subjective Agency

Every movement requires the nervous system to solve a complex biomechanical control problem, but this process is mostly veiled from one's conscious awareness. Simultaneously, we also have conscious experience of controlling our movements-our sense of agency (SoA). Whether SoA corresponds to those neural representations that implement actual neuromuscular control is an open question with ethical, medical, and legal implications. If SoA is the conscious experience of control, this predicts that SoA can be decoded from the same brain structures that implement the so-called "inverse dynamics" computations for planning movement. We correlated human (male and female) fMRI measurements during hand movements with the internal representations of a deep neural network (DNN) performing the same hand control task in a biomechanical simulation-revealing detailed cortical encodings of sensorimotor states, idiosyncratic to each subject. We then manipulated SoA by usurping control of participants' muscles via electrical stimulation, and found that the same voxels which were best explained by modeled inverse dynamics representations-which, strikingly, were located in canonically visual areas-also predicted SoA. Importantly, model-brain correspondences and robust SoA decoding could both be achieved within single subjects, enabling relationships between motor representations and awareness to be studied at the level of the individual.Significance Statement The inherent complexity of biomechanical control problems is belied by the seeming simplicity of directing movements in our subjective experience. This aspect of our experience suggests we have limited conscious access to the neural and mental representations involved in controlling the body - but of which of the many possible representations are we, in fact, aware? Understanding which motor control representations percolate into awareness has taken on increasing importance as emerging neural interface technologies push the boundaries of human autonomy. In our study, we leverage machine learning models that have learned to control simulated bodies to localize biomechanical control representations in the brain. Then, we show that these brain regions predict perceived agency over the musculature during functional electrical stimulation.

Environmental context influences visual processing in thalamus

Behavioral state modulates neural activity throughout the visual system.1,2,3 This is largely due to changes in arousal that alter internal brain states.4,5,6,7,8,9,10 Much is known about how these internal factors influence visual processing,7,8,9,10,11 but comparatively less is known about the role of external environmental contexts.12 Environmental contexts can promote or prevent certain actions,13 and it remains unclear if and how this affects visual processing. Here, we addressed this question in the thalamus of awake, head-fixed mice while they viewed stimuli but remained stationary in two different environmental contexts: either a cylindrical tube or a circular running wheel that enabled locomotion. We made silicon probe recordings in the dorsal lateral geniculate nucleus (dLGN) while simultaneously measuring multiple metrics of arousal changes so that we could control for these across contexts. We found surprising differences in spatial and temporal processing in dLGN across contexts. The wheel context (versus tube) showed elevated baseline activity and faster but less spatially selective visual responses; however, these visual processing differences disappeared if the wheel no longer enabled locomotion. Our results reveal an unexpected influence of the physical environmental context on fundamental aspects of early visual processing, even in otherwise identical states of alertness and stillness.

Detection and neural encoding of whisker-generated sounds in mice

The vibrissa system of mice and other rodents enables active sensing via whisker movements and is traditionally considered a purely tactile system. Here, we ask whether whisking against objects produces audible sounds and whether mice are capable of perceiving these sounds. We found that whisking by head-fixed mice against objects produces audible sounds well within their hearing range. We recorded neural activity in the auditory cortex of mice in which we had abolished vibrissae tactile sensation and found that the firing rate of auditory neurons was strongly modulated by whisking against objects. Furthermore, the object's identity could be reliably decoded from the population's neuronal activity and closely matched the decoding patterns derived from sounds that were recorded simultaneously, suggesting that neuronal activity reflects acoustic information. Lastly, trained mice, in which vibrissae tactile sensation was abolished, were able to accurately identify objects solely based on the sounds produced during whisking. Our results suggest that, beyond its traditional role as a tactile sensory system, the vibrissa system of rodents engages both tactile and auditory modalities in a multimodal manner during active exploration.

From initial formation to developmental refinement: GABAergic inputs shape neuronal subnetworks in the primary somatosensory cortex

Neuronal subnetworks, also known as ensembles, are functional units formed by interconnected neurons for information processing and encoding in the adult brain. Our study investigates the establishment of neuronal subnetworks in the mouse primary somatosensory (S1) cortex from postnatal days (P)11 to P21 using in vivo two-photon calcium imaging. We found that at P11, neuronal activity was highly synchronized but became sparser by P21. Clustering analyses revealed that while the number of subnetworks remained constant, their activity patterns became more distinct, with increased coherence, independent of cortical layer or sex. Furthermore, the coherence of neuronal activity within individual subnetworks significantly increased when synchrony frequencies were reduced by augmenting gamma-aminobutyric acid (GABA)ergic activity at P15/16, a period when the neuronal subnetworks were still maturing. Together, these findings indicate the early formation of subnetworks and underscore the pivotal roles of GABAergic inputs in modulating S1 neuronal subnetworks.

Scaling of Ventral Hippocampal Activity during Anxiety

The hippocampus supports a multiplicity of functions, with the dorsal region contributing to spatial representations and memory and the ventral hippocampus (vH) being primarily involved in emotional processing. While spatial encoding has been extensively investigated, how the vH activity is tuned to emotional states, e.g., to different anxiety levels, is not well understood. We developed an adjustable linear track maze for male mice with which we could induce a scaling of behavioral anxiety levels within the same spatial environment. Using in vivo single-unit recordings, optogenetic manipulations, and population-level analysis, we examined the changes and causal effects of vH activity at different anxiety levels. We found that anxiogenic experiences activated the vH and that this activity scaled with increasing anxiety levels. We identified two processes that contributed to this scaling of anxiety-related activity: increased tuning and successive remapping of neurons to the anxiogenic compartment. Moreover, optogenetic inhibition of the vH reduced anxiety across different levels, while anxiety-related activity scaling could be decoded using a linear classifier. Collectively, our findings position the vH as a critical limbic region that functions as an "anxiometer" by scaling its activity based on perceived anxiety levels. Our discoveries go beyond the traditional theory of cognitive maps in the hippocampus underlying spatial navigation and memory, by identifying hippocampal mechanisms selectively regulating anxiety.

DySCo: A general framework for dynamic functional connectivity

A crucial challenge in neuroscience involves characterising brain dynamics from high-dimensional brain recordings. Dynamic Functional Connectivity (dFC) is an analysis paradigm that aims to address this challenge. dFC consists of a time-varying matrix (dFC matrix) expressing how pairwise interactions across brain areas change over time. However, the main dFC approaches have been developed and applied mostly empirically, lacking a common theoretical framework and a clear view on the interpretation of the results derived from the dFC matrices. Moreover, the dFC community has not been using the most efficient algorithms to compute and process the matrices efficiently, which has prevented dFC from showing its full potential with high-dimensional datasets and/or real-time applications. In this paper, we introduce the Dynamic Symmetric Connectivity Matrix analysis framework (DySCo), with its associated repository. DySCo is a framework that presents the most commonly used dFC measures in a common language and implements them in a computationally efficient way. This allows the study of brain activity at different spatio-temporal scales, down to the voxel level. DySCo provides a single framework that allows to: (1) Use dFC as a tool to capture the spatio-temporal interaction patterns of data in a form that is easily translatable across different imaging modalities. (2) Provide a comprehensive set of measures to quantify the properties and evolution of dFC over time: the amount of connectivity, the similarity between matrices, and their informational complexity. By using and combining the DySCo measures it is possible to perform a full dFC analysis. (3) Leverage the Temporal Covariance EVD algorithm (TCEVD) to compute and store the eigenvectors and values of the dFC matrices, and then also compute the DySCo measures from the EVD. Developing the framework in the eigenvector space is orders of magnitude faster and more memory efficient than naïve algorithms in the matrix space, without loss of information. The methodology developed here is validated on both a synthetic dataset and a rest/N-back task experimental paradigm from the fMRI Human Connectome Project dataset. We show that all the proposed measures are sensitive to changes in brain configurations and consistent across time and subjects. To illustrate the computational efficiency of the DySCo toolbox, we performed the analysis at the voxel level, a task which is computationally demanding but easily afforded by the TCEVD.

Physically activated modes of attentional control

As we navigate through the day, our attentional control processes are constantly challenged by changing sensory information, goals, expectations, and motivations. At the same time, our bodies and brains are impacted by changes in global physiological state that can influence attentional processes. Based on converging lines of evidence from brain recordings in physically active humans and nonhumans, we propose a new framework incorporating at least two physically activated modes of attentional control in humans: altered gain control and differential neuromodulation of control networks. We discuss the implications of this framework for understanding a broader range of states and cognitive functions studied both in the laboratory and in the wild.

Organizational Principles of the Primate Cerebral Cortex at the Single-Cell Level

The primate cerebral cortex, the major organ for cognition, consists of an immense number of neurons. However, the organizational principles governing these neurons remain unclear. By accessing the single-cell spatial transcriptome of over 25 million neuron cells across the entire macaque cortex, it is discovered that the distribution of neurons within cortical layers is highly non-random. Strikingly, over three-quarters of these neurons are located in distinct neuronal clusters. Within these clusters, different cell types tend to collaborate rather than function independently. Typically, excitatory neuron clusters mainly consist of excitatory-excitatory combinations, while inhibitory clusters primarily contain excitatory-inhibitory combinations. Both cluster types have roughly equal numbers of neurons in each layer. Importantly, most excitatory and inhibitory neuron clusters form spatial partnerships, indicating a balanced local neuronal network and correlating with specific functional regions. These organizational principles are conserved across mouse cortical regions. These findings suggest that different brain regions of the cortex may exhibit similar mechanisms at the neuronal population level.

An opponent striatal circuit for distributional reinforcement learning

Machine learning research has achieved large performance gains on a wide range of tasks by expanding the learning target from mean rewards to entire probability distributions of rewards-an approach known as distributional reinforcement learning (RL)1. The mesolimbic dopamine system is thought to underlie RL in the mammalian brain by updating a representation of mean value in the striatum2, but little is known about whether, where and how neurons in this circuit encode information about higher-order moments of reward distributions3. Here, to fill this gap, we used high-density probes (Neuropixels) to record striatal activity from mice performing a classical conditioning task in which reward mean, reward variance and stimulus identity were independently manipulated. In contrast to traditional RL accounts, we found robust evidence for abstract encoding of variance in the striatum. Chronic ablation of dopamine inputs disorganized these distributional representations in the striatum without interfering with mean value coding. Two-photon calcium imaging and optogenetics revealed that the two major classes of striatal medium spiny neurons-D1 and D2-contributed to this code by preferentially encoding the right and left tails of the reward distribution, respectively. We synthesize these findings into a new model of the striatum and mesolimbic dopamine that harnesses the opponency between D1 and D2 medium spiny neurons4-9 to reap the computational benefits of distributional RL.

Separating cognitive and motor processes in the behaving mouse

The cognitive processes supporting complex animal behavior are closely associated with movements responsible for critical processes, such as facial expressions or the active sampling of our environments. These movements are strongly related to neural activity across much of the brain and are often highly correlated with ongoing cognitive processes. A fundamental issue for understanding the neural signatures of cognition and movements is whether cognitive processes are separable from related movements or if they are driven by common neural mechanisms. Here we demonstrate how the separability of cognitive and motor processes can be assessed and, when separable, how the neural dynamics associated with each component can be isolated. We designed a behavioral task in mice that involves multiple cognitive processes, and we show that dynamics commonly taken to support cognitive processes are strongly contaminated by movements. When cognitive and motor components are isolated using a novel approach for subspace decomposition, we find that they exhibit distinct dynamical trajectories and are encoded by largely separate populations of cells. Accurately isolating dynamics associated with particular cognitive and motor processes will be essential for developing conceptual and computational models of neural circuit function.

Understanding cognitive processes across spatial scales of the brain

Cognition arises from neural operations at multiple spatial scales, from individual neurons to large-scale networks. Despite extensive research on coding principles and emergent cognitive processes across brain areas, investigation across scales has been limited. Here, we propose ways to test the idea that different cognitive processes emerge from distinct information coding principles at various scales, which collectively give rise to complex behavior. This approach involves comparing brain-behavior associations and the underlying neural geometry across scales, alongside an investigation of global and local scale interactions. Bridging findings across species and techniques through open science and collaborations is essential to comprehensively understand the multiscale brain and its functions.

A large field of view 2- and 3-photon microscope

A new multiphoton fluorescence microscope has been developed, offering cellular resolution across a large field of view deep within biological tissues. This opens new possibilities across a range of biological sciences, particularly within neuroscience where optical approaches can reveal signaling in real time throughout an extended network of cells distributed through the brain of an awake, behaving mouse.

Compositional architecture: Orthogonal neural codes for task context and spatial memory in prefrontal cortex

The prefrontal cortex (PFC) is crucial for maintaining working memory across diverse cognitive tasks, yet how it adapts to varying task demands remains unclear. Compositional theories propose that cognitive processes in neural network rely on shared components that can be reused to support different behaviors. However, previous studies have suggested that working memory components are task specific, challenging this framework. Here, we revisit this question using a population-based approach. We recorded neural activity in macaque monkeys performing two spatial working memory tasks with opposing goals: one requiring movement toward previously presented spatial locations (look task) and the other requiring avoidance of those locations (no-look task). Despite differences in task demands, we found that spatial memory representations were largely conserved at the population level, with a common low-dimensional neural subspace encoding memory across both tasks. In parallel, task identity was encoded in an orthogonal subspace, providing a stable and independent representation of contextual information. These results provide neural evidence for a compositional model of working memory, where representational geometry enables the efficient and flexible reuse of mnemonic codes across behavioral contexts while maintaining an independent representation of context.

Higher-order thalamic input to cortex selectively conveys state information

Communication among neocortical areas is largely thought to be mediated by long-range synaptic interactions between cortical neurons, with the thalamus providing only an initial relay of information from the sensory periphery. Higher-order thalamic nuclei receive strong synaptic inputs from the cortex and send robust projections back to other cortical areas, providing a distinct and potentially critical route for corticocortical communication. However, the relative contributions of corticocortical and thalamocortical inputs to higher-order cortical function remain unclear. Using imaging of neurons and axon terminals in combination with optogenetic manipulations, we find that the higher-order visual thalamus of mice has a unique impact on the posterior medial visual cortex (PM). Whereas corticocortical projections from lower cortical areas convey robust visual information to PM, higher-order thalamocortical projections convey information about global arousal state. Together, these findings suggest a key role for the higher-order thalamus in providing contextual signals that may flexibly modulate cortical sensory processing.

Hierarchical behavioral analysis framework as a platform for standardized quantitative identification of behaviors

Behavior is composed of modules that operate based on inherent logic. Understanding behavior and its neural mechanisms is facilitated by clear structural behavioral analysis. Here, we developed a hierarchical behavioral analysis framework (HBAF) that efficiently reveals the organizational logic of these modules by analyzing high-dimensional behavioral data. By creating a spontaneous behavior atlas for male and female mice, we discovered that spontaneous behavior patterns are hardwired, with sniffing serving as the hub node for movement transitions. The sniffing-to-grooming ratio accurately distinguished the spontaneous behavioral states in a high-throughput manner. These states are influenced by emotional status, circadian rhythms, and lighting conditions, leading to unique behavioral characteristics, spatiotemporal features, and dynamic patterns. By implementing the straightforward and achievable spontaneous behavior paradigm, HBAF enables swift and accurate assessment of animal behavioral states and bridges the gap between a theoretical understanding of the behavioral structure and practical analysis using comprehensive multidimensional behavioral information.

Interdigitating Modules for Visual Processing During Locomotion and Rest in Mouse V1

Layer 1 of V1 has been shown to receive locomotion-related signals from the dorsal lateral geniculate (dLGN) and lateral posterior (LP) thalamic nuclei (Roth et al., 2016). Inputs from the dLGN terminate in M2+ patches while inputs from LP target M2- interpatches (D'Souza et al., 2019) suggesting that motion related signals are processed in distinct networks. Here, we investigated by calcium imaging in head-fixed awake mice whether L2/3 neurons underneath L1 M2+ and M2- modules are differentially activated by locomotion, and whether distinct networks of feedback connections from higher cortical areas to L1 may contribute to these differences. We found that strongly locomotion-modulated cell clusters during visual stimulation were aligned with M2- interpatches, while weakly modulated cells clustered under M2+ patches. Unlike M2+ patch cells, pairs of M2- interpatch cells showed increased correlated variability of calcium transients when the sites in the visuotopic map were far apart, suggesting that activity is integrated across large parts of the visual field. Pathway tracing further suggests that strong locomotion modulation in L2/3 M2- interpatch cells of V1 relies on looped, like-to-like networks between apical dendrites of MOs-, PM- and RSP-projecting neurons and feedback input from these areas to L1. M2- interpatches receive strong inputs from SST neurons, suggesting that during locomotion these interneurons influence the firing of specific subnetworks by controlling the excitability of apical dendrites in M2- interpatches.

Visual experience orthogonalizes visual cortical stimulus responses via population code transformation

Sensory and behavioral experience can alter visual cortical stimulus coding, but the precise form of this plasticity is unclear. We measured orientation tuning in 4,000-neuron populations of mouse V1 before and after training on a visuomotor task. Changes to single-cell tuning curves appeared complex, including development of asymmetries and of multiple peaks. Nevertheless, these complex tuning curve transformations can be explained by a simple equation: a convex transformation suppressing responses to task stimuli specifically in cells responding at intermediate levels. The strength of the transformation varies across trials, suggesting a dynamic circuit mechanism rather than static synaptic plasticity. The transformation results in sparsening and orthogonalization of population codes for task stimuli. It cannot improve the performance of an optimal stimulus decoder, which is already perfect even for naive codes, but it improves the performance of a suboptimal decoder model with inductive bias as might be found in downstream readout circuits.

Cross-modal cortical circuit for sound sensitivity in neuropathic pain

Hyperacusis, exaggerated sensitivity to sound, frequently accompanies chronic pain in humans, suggesting interactions between different sensory systems in the brain. However, the neural mechanisms underlying this comorbidity remain largely unexplored. In this study, behavioral tests measuring sound-evoked pupil dilation and reaction times to lick water following auditory stimuli showed hyperacusis-like behaviors in neuropathic pain model mice. Through viral tracing, fiber photometry, and multi-electrode recordings, we identified glutamatergic projections from primary somatosensory cortex (S1HLGlu) to the auditory cortex (ACx) that participate in amplifying sound-evoked neuronal activity following spared nerve injury in the hindlimb. Chemo- or optogenetic manipulation and electrophysiology recordings confirmed that the S1HLGlu → ACx pathway is essential for this heightened response to sound. Specifically, activating this pathway intensified glutamatergic neuronal activity in the ACx and induced hyperacusis-like behaviors, while chemogenetic suppression reversed these effects in neuropathic pain model mice. These findings illustrate the mechanism by which central gain increases in the ACx of neuropathic pain mice, improving our understanding of cross-modal sensory system interactions and suggesting circuit pathway targets for developing interventions to treat pain-associated hyperacusis in clinic.

Tensor-powered insights into neural dynamics

The complex spatiotemporal dynamics of neurons encompass a wealth of information relevant to perception and decision-making, making the decoding of neural activity a central focus in neuroscience research. Traditional machine learning or deep learning-based neural information modeling approaches have achieved significant results in decoding. Nevertheless, such methodologies require the vectorization of data, a process that disrupts the intrinsic relationships inherent in high-dimensional spaces, consequently impeding their capability to effectively process information in high-order tensor domains. In this paper, we introduce a novel decoding approach, namely the Least Squares Sport Tensor Machine (LS-STM), which is based on tensor space and represents a tensorized improvement over traditional vector learning frameworks. In extensive evaluations using human and mouse data, our results demonstrate that LS-STM exhibits superior performance in neural signal decoding tasks compared to traditional vectorization-based decoding methods. Furthermore, LS-STM demonstrates better performance in decoding neural signals with limited samples and the tensor weights of the LS-STM decoder enable the retrospective identification of key neurons during the neural encoding process. This study introduces a novel tensor computing approach and perspective for decoding high-dimensional neural information in the field.

Deciphering neuronal variability across states reveals dynamic sensory encoding

Influenced by non-stationary factors such as brain states and behavior, neurons exhibit substantial response variability even to identical stimuli. However, it remains unclear how their relative impact on neuronal variability evolves over time. To address this question, we designed an encoding model conditioned on latent states to partition variability in the mouse visual cortex across internal brain dynamics, behavior, and external visual stimulus. Applying a hidden Markov model to local field potentials, we consistently identified three distinct oscillation states, each with a unique variability profile. Regression models within each state revealed a dynamic composition of factors influencing spiking variability, with the dominant factor switching within seconds. The state-conditioned regression model uncovered extensive diversity in source contributions across units, varying in accordance with anatomical hierarchy and internal state. This heterogeneity in encoding underscores the importance of partitioning variability over time, particularly when considering the influence of non-stationary factors on sensory processing.

Conjoint specification of action by neocortex and striatum

The interplay between two major forebrain structures-cortex and subcortical striatum-is critical for flexible, goal-directed action. Traditionally, it has been proposed that striatum is critical for selecting what type of action is initiated, while the primary motor cortex is involved in specifying the continuous parameters of an upcoming/ongoing movement. Recent data indicate that striatum may also be involved in specification. These alternatives have been difficult to reconcile because comparing very distinct actions, as is often done, makes essentially indistinguishable predictions. Here, we develop quantitative models to reveal a somewhat paradoxical insight: only comparing neural activity across similar actions makes strongly distinguishing predictions. We thus developed a novel reach-to-pull task in which mice reliably selected between two similar but distinct reach targets and pull forces. Simultaneous cortical and subcortical recordings were uniquely consistent with a model in which cortex and striatum jointly specify continuous parameters governing movement execution.

An adaptable, reusable, and light implant for chronic Neuropixels probes

Electrophysiology has proven invaluable to record neural activity, and the development of Neuropixels probes dramatically increased the number of recorded neurons. These probes are often implanted acutely, but acute recordings cannot be performed in freely moving animals and the recorded neurons cannot be tracked across days. To study key behaviors such as navigation, learning, and memory formation, the probes must be implanted chronically. An ideal chronic implant should (1) allow stable recordings of neurons for weeks; (2) allow reuse of the probes after explantation; (3) be light enough for use in mice. Here, we present the 'Apollo Implant', an open-source and editable device that meets these criteria and accommodates up to two Neuropixels 1.0 or 2.0 probes. The implant comprises a 'payload' module which is attached to the probe and is recoverable, and a 'docking' module which is cemented to the skull. The design is adjustable, making it easy to change the distance between probes, the angle of insertion, and the depth of insertion. We tested the implant across eight labs in head-fixed mice, freely moving mice, and freely moving rats. The number of neurons recorded across days was stable, even after repeated implantations of the same probe. The Apollo implant provides an inexpensive, lightweight, and flexible solution for reusable chronic Neuropixels recordings.

Arousal as a universal embedding for spatiotemporal brain dynamics

Neural activity in awake organisms shows widespread and spatiotemporally diverse correlations with behavioral and physiological measurements. We propose that this covariation reflects in part the dynamics of a unified, multidimensional arousal-related process that regulates brain-wide physiology on the timescale of seconds. By framing this interpretation within dynamical systems theory, we arrive at a surprising prediction: that a single, scalar measurement of arousal (e.g., pupil diameter) should suffice to reconstruct the continuous evolution of multidimensional, spatiotemporal measurements of large-scale brain physiology. To test this hypothesis, we perform multimodal, cortex-wide optical imaging and behavioral monitoring in awake mice. We demonstrate that spatiotemporal measurements of neuronal calcium, metabolism, and brain blood-oxygen can be accurately and parsimoniously modeled from a low-dimensional state-space reconstructed from the time history of pupil diameter. Extending this framework to behavioral and electrophysiological measurements from the Allen Brain Observatory, we demonstrate the ability to integrate diverse experimental data into a unified generative model via mappings from an intrinsic arousal manifold. Our results support the hypothesis that spontaneous, spatially structured fluctuations in brain-wide physiology-widely interpreted to reflect regionally-specific neural communication-are in large part reflections of an arousal-related process. This enriched view of arousal dynamics has broad implications for interpreting observations of brain, body, and behavior as measured across modalities, contexts, and scales.

Type-I nNOS neurons orchestrate cortical neural activity and vasomotion

It is unknown how the brain orchestrates coordination of global neural and vascular dynamics. We sought to uncover the role of a sparse but unusual population of genetically-distinct interneurons known as type-I nNOS neurons, using a novel pharmacological strategic to unilaterally ablate these neurons from the somatosensory cortex of mice. Region-specific ablation produced changes in both neural activity and vascular dynamics, decreased power in the delta-band of the local field potential, reduced sustained vascular responses to prolonged sensory stimulation, and abolished the post-stimulus undershoot in cerebral blood volume. Coherence between the left and right somatosensory cortex gamma-band power envelope and blood volume at ultra-low frequencies was decreased, suggesting type-1 nNOS neurons integrate long-range coordination of brain signals. Lastly, we observed decreases in the amplitude of resting-state blood volume oscillations and decreased vasomotion following the ablation of type-I nNOS neurons. This demonstrates that a small population of nNOS-positive neurons are indispensable for regulating both neural and vascular dynamics in the whole brain and implicates disruption of these neurons in diseases ranging from neurodegeneration to sleep disturbances.

Spatio-temporal transformers for decoding neural movement control

Objective. Deep learning tools applied to high-resolution neurophysiological data have significantly progressed, offering enhanced decoding, real-time processing, and readability for practical applications. However, the design of artificial neural networks to analyze neural activityin vivoremains a challenge, requiring a delicate balance between efficiency in low-data regimes and the interpretability of the results.Approach. To address this challenge, we introduce a novel specialized transformer architecture to analyze single-neuron spiking activity. The model is tested on multi-electrode recordings from the dorsal premotor cortex of non-human primates performing a motor inhibition task.Main results. The proposed architecture provides an early prediction of the correct movement direction, achieving accurate results no later than 230 ms after the Go signal presentation across animals. Additionally, the model can forecast whether the movement will be generated or withheld before a stop signal, unattended, is actually presented. To further understand the internal dynamics of the model, we compute the predicted correlations between time steps and between neurons at successive layers of the architecture, with the evolution of these correlations mirrors findings from previous theoretical analyses.Significance. Overall, our framework provides a comprehensive use case for the practical implementation of deep learning tools in motor control research, highlighting both the predictive capabilities and interpretability of the proposed architecture.

Modeling the Emergence of Circuit Organization and Function during Development

Developing neural circuits show unique patterns of spontaneous activity and structured network connectivity shaped by diverse activity-dependent plasticity mechanisms. Based on extensive experimental work characterizing patterns of spontaneous activity in different brain regions over development, theoretical and computational models have played an important role in delineating the generation and function of individual features of spontaneous activity and their role in the plasticity-driven formation of circuit connectivity. Here, we review recent modeling efforts that explore how the developing cortex and hippocampus generate spontaneous activity, focusing on specific connectivity profiles and the gradual strengthening of inhibition as the key drivers behind the observed developmental changes in spontaneous activity. We then discuss computational models that mechanistically explore how different plasticity mechanisms use this spontaneous activity to instruct the formation and refinement of circuit connectivity, from the formation of single neuron receptive fields to sensory feature maps and recurrent architectures. We end by highlighting several open challenges regarding the functional implications of the discussed circuit changes, wherein models could provide the missing step linking immature developmental and mature adult information processing capabilities.

The developmental emergence of reliable cortical representations

The fundamental structure of cortical networks arises early in development before the onset of sensory experience. However, how endogenously generated networks respond to the onset of sensory experience and how they form mature sensory representations with experience remain unclear. In this study, we examined this 'nature-nurture transform' at the single-trial level using chronic in vivo calcium imaging in ferret visual cortex. At eye opening, visual stimulation evokes robust patterns of modular cortical network activity that are highly variable within and across trials, severely limiting stimulus discriminability. These initial stimulus-evoked modular patterns are distinct from spontaneous network activity patterns present before and at the time of eye opening. Within a week of normal visual experience, cortical networks develop low-dimensional, highly reliable stimulus representations that correspond with reorganized patterns of spontaneous activity. Using a computational model, we propose that reliable visual representations derive from the alignment of feedforward and recurrent cortical networks shaped by novel patterns of visually driven activity.

Deep-learning based Embedding of Functional Connectivity Profiles for Precision Functional Mapping

Spatial correlation of functional connectivity profiles across matching anatomical locations in individuals is often calculated to delineate individual differences in functional networks. Likewise, spatial correlation is assessed across average functional connectivity profiles of groups to evaluate the maturity of functional networks during development. Despite its widespread use, spatial correlation is limited to comparing two samples at a time. In this study, we employed a variational autoencoder to embed functional connectivity profiles from various anatomical locations, individuals, and group averages for simultaneous comparison. We demonstrate that our variational autoencoder, with pre-trained weights, can project new functional connectivity profiles from the vertex space to a latent space with as few as two dimensions, yet still retain meaningful global and local structures in the data. Functional connectivity profiles from various functional networks occupy distinct compartments of the latent space. Moreover, the variability of functional connectivity profiles from the same anatomical location is readily captured in the latent space. We believe that this approach could be useful for visualization and exploratory analyses in precision functional mapping.

Adaptation shapes the representational geometry in mouse V1 to efficiently encode the environment

Sensory adaptation dynamically changes neural responses as a function of previous stimuli, profoundly impacting perception. The response changes induced by adaptation have been characterized in detail in individual neurons and at the population level after averaging across trials. However, it is not clear how adaptation modifies the aspects of the representations that relate more directly to the ability to perceive stimuli, such as their geometry and the noise structure in individual trials. To address this question, we recorded from a population of neurons in the mouse visual cortex and presented one stimulus (an oriented grating) more frequently than the others. We then analyzed these data in terms of representational geometry and studied the ability of a linear decoder to discriminate between similar visual stimuli based on the single-trial population responses. Surprisingly, the discriminability of stimuli near the adaptor increased, even though the responses of individual neurons to these stimuli decreased. Similar changes were observed in artificial neural networks trained to reconstruct the visual stimulus under metabolic constraints. We conclude that the paradoxical effects of adaptation are consistent with the efficient coding framework, allowing the brain to improve the representation of frequent stimuli while limiting the associated metabolic cost.

Interneuronal modulations as a functional switch for cortical computations: mechanisms and implication for disease

Understanding cortical inhibition and its diverse roles remains a key challenge in neurophysiological research. Traditionally, inhibition has been recognized for controlling the stability and rhythmicity of network dynamics, or refining the spatiotemporal properties of cortical representations. In this perspective, we propose that specific types of interneurons may play a complementary role, by modulating the computational properties of neural networks. We review experimental and theoretical evidence, mainly from rodent sensory cortices, that supports this view. Additionally, we explore how dysfunctions in these interneurons may disrupt the network's ability to switch between computational modes, impacting the flexibility of cortical processing and potentially contributing to various neurodevelopmental and psychiatric disorders.

Fast updating feedback from piriform cortex to the olfactory bulb relays multimodal identity and reward contingency signals during rule-reversal

While animals readily adjust their behavior to adapt to relevant changes in the environment, the neural pathways enabling these changes remain largely unknown. Here, using multiphoton imaging, we investigate whether feedback from the piriform cortex to the olfactory bulb supports such behavioral flexibility. To this end, we engage head-fixed male mice in a multimodal rule-reversal task guided by olfactory and auditory cues. Both odor and, surprisingly, the sound cues trigger responses in the cortical bulbar feedback axons which precede the behavioral report. Responses to the same sensory cue are strongly modulated upon changes in stimulus-reward contingency (rule-reversals). The re-shaping of individual bouton responses occurs within seconds of the rule-reversal events and is correlated with changes in behavior. Optogenetic perturbation of cortical feedback within the bulb disrupts the behavioral performance. Our results indicate that the piriform-to-olfactory bulb feedback axons carry stimulus identity and reward contingency signals which are rapidly re-formatted according to changes in the behavioral context.

The unbearable slowness of being: Why do we live at 10 bits/s?

This article is about the neural conundrum behind the slowness of human behavior. The information throughput of a human being is about 10 bits/s. In comparison, our sensory systems gather data at ∼109 bits/s. The stark contrast between these numbers remains unexplained and touches on fundamental aspects of brain function: what neural substrate sets this speed limit on the pace of our existence? Why does the brain need billions of neurons to process 10 bits/s? Why can we only think about one thing at a time? The brain seems to operate in two distinct modes: the "outer" brain handles fast high-dimensional sensory and motor signals, whereas the "inner" brain processes the reduced few bits needed to control behavior. Plausible explanations exist for the large neuron numbers in the outer brain, but not for the inner brain, and we propose new research directions to remedy this.

Whole-brain neural substrates of behavioral variability in the larval zebrafish

Animals engaged in naturalistic behavior can exhibit a large degree of behavioral variability even under sensory invariant conditions. Such behavioral variability can include not only variations of the same behavior, but also variability across qualitatively different behaviors driven by divergent cognitive states, such as fight-or-flight decisions. However, the neural circuit mechanisms that generate such divergent behaviors across trials are not well understood. To investigate this question, here we studied the visual-evoked responses of larval zebrafish to moving objects of various sizes, which we found exhibited highly variable and divergent responses across repetitions of the same stimulus. Given that the neuronal circuits underlying such behaviors span sensory, motor, and other brain areas, we built a novel Fourier light field microscope which enables high-resolution, whole-brain imaging of larval zebrafish during behavior. This enabled us to screen for neural loci which exhibited activity patterns correlated with behavioral variability. We found that despite the highly variable activity of single neurons, visual stimuli were robustly encoded at the population level, and the visual-encoding dimensions of neural activity did not explain behavioral variability. This robustness despite apparent single neuron variability was due to the multi-dimensional geometry of the neuronal population dynamics: almost all neural dimensions that were variable across individual trials, i.e. the "noise" modes, were nearly orthogonal to those encoding for sensory information. Investigating this neuronal variability further, we identified two sparsely-distributed, brain-wide neuronal populations whose pre-motor activity predicted whether the larva would respond to a stimulus and, if so, which direction it would turn on a single-trial level. These populations predicted single-trial behavior seconds before stimulus onset, indicating they encoded time-varying internal modulating behavior, perhaps organizing behavior over longer timescales or enabling flexible behavior routines dependent on the animal's internal state. Our results provide the first whole-brain confirmation that sensory, motor, and internal variables are encoded in a highly mixed fashion throughout the brain and demonstrate that de-mixing each of these components at the neuronal population level is critical to understanding the mechanisms underlying the brain's remarkable flexibility and robustness.