Neural population coding: combining insights from microscopic and mass signals

MEA-seqX: High-Resolution Profiling of Large-Scale Electrophysiological and Transcriptional Network Dynamics

Concepts of brain function imply congruence and mutual causal influence between molecular events and neuronal activity. Decoding entangled information from concurrent molecular and electrophysiological network events demands innovative methodology bridging scales and modalities. The MEA-seqX platform, integrating high-density microelectrode arrays, spatial transcriptomics, optical imaging, and advanced computational strategies, enables the simultaneous recording and analysis of molecular and electrical network activities at mesoscale spatial resolution. Applied to a mouse hippocampal model of experience-dependent plasticity, MEA-seqX unveils massively enhanced nested dynamics between transcription and function. Graph-theoretic analysis reveals an increase in densely connected bimodal hubs, marking the first observation of coordinated hippocampal circuitry dynamics at molecular and functional levels. This platform also identifies different cell types based on their distinct bimodal profiles. Machine-learning algorithms accurately predict network-wide electrophysiological activity features from spatial gene expression, demonstrating a previously inaccessible convergence across modalities, time, and scales.

Multi-voxel pattern analysis for developmental cognitive neuroscientists

The current prevailing approaches to analyzing task fMRI data in developmental cognitive neuroscience are brain connectivity and mass univariate task-based analyses, used either in isolation or as part of a broader analytic framework (e.g., BWAS). While these are powerful tools, it is somewhat surprising that multi-voxel pattern analysis (MVPA) is not more common in developmental cognitive neuroscience given its enhanced ability to both probe neural population codes and greater sensitivity relative to the mass univariate approach. Omitting MVPA methods might represent a missed opportunity to leverage a suite of tools that are uniquely poised to reveal mechanisms underlying brain development. The goal of this review is to spur awareness and adoption of MVPA in developmental cognitive neuroscience by providing a practical introduction to foundational MVPA concepts. We begin by defining MVPA and explain why examining multi-voxel patterns of brain activity can aid in understanding the developing human brain. We then survey four different types of MVPA: Decoding, representational similarity analysis (RSA), pattern expression, and voxel-wise encoding models. Each variant of MVPA is presented with a conceptual overview of the method followed by practical considerations and subvariants thereof. We go on to highlight the types of developmental questions that can be answered by MPVA, discuss practical matters in MVPA implementation germane to developmental cognitive neuroscientists, and make recommendations for integrating MVPA with the existing analytic ecosystem in the field.

Hierarchical emergence of opponent coding in auditory belt cortex

We recorded from neurons in primary auditory cortex (A1) and middle-lateral belt area (ML) while rhesus macaques either discriminated amplitude-modulated noise (AM) from unmodulated noise or passively heard the same stimuli. We used several post hoc pooling models to investigate the ability of auditory cortex to leverage population coding for AM detection. We find that pooled-response AM detection is better in the active condition than the passive condition, and better using rate-based coding than synchrony-based coding. Neurons can be segregated into two classes based on whether they increase (INC) or decrease (DEC) their firing rate in response to increasing modulation depth. In these samples, A1 had relatively fewer DEC neurons (26%) than ML (45%). When responses were pooled without segregating these classes, AM detection using rate-based coding was much better in A1 than in ML, but when pooling only INC neurons, AM detection in ML approached that found in A1. Pooling only DEC neurons resulted in impaired AM detection in both areas. To investigate the role of DEC neurons, we devised two pooling methods that opposed DEC and INC neurons-a direct subtractive method and a two-pool push-pull opponent method. Only the push-pull opponent method resulted in superior AM detection relative to indiscriminate pooling. In the active condition, the opponent method was superior to pooling only INC neurons during the late portion of the response in ML. These results suggest that the increasing prevalence of the DEC response type in ML can be leveraged by appropriate methods to improve AM detection.NEW & NOTEWORTHY We used several post hoc pooling models to investigate the ability of primate auditory cortex to leverage population coding in the detection of amplitude-modulated sounds. When cells are indiscriminately pooled, primary auditory cortex (A1) detects amplitude-modulated sounds better than middle-lateral belt (ML). When cells that decrease firing rate with increasing modulation depth are excluded, or used in a push-pull opponent fashion, detection is similar in the two areas, and macaque behavior can be approximated using reasonably sized pools.

Multi-compartment neuron and population encoding powered spiking neural network for deep distributional reinforcement learning

Inspired by the brain's information processing using binary spikes, spiking neural networks (SNNs) offer significant reductions in energy consumption and are more adept at incorporating multi-scale biological characteristics. In SNNs, spiking neurons serve as the fundamental information processing units. However, in most models, these neurons are typically simplified, focusing primarily on the leaky integrate-and-fire (LIF) point neuron model while neglecting the structural properties of biological neurons. This simplification hampers the computational and learning capabilities of SNNs. In this paper, we propose a brain-inspired deep distributional reinforcement learning algorithm based on SNNs, which integrates a bio-inspired multi-compartment neuron (MCN) model with a population coding approach. The proposed MCN model simulates the structure and function of apical dendritic, basal dendritic, and somatic compartments, achieving computational power comparable to that of biological neurons. Additionally, we introduce an implicit fractional embedding method based on population coding of spiking neurons. We evaluated our model on Atari games, and the experimental results demonstrate that it surpasses the vanilla FQF model, which utilizes traditional artificial neural networks (ANNs), as well as the Spiking-FQF models that are based on ANN-to-SNN conversion methods. Ablation studies further reveal that the proposed multi-compartment neuron model and the quantile fraction implicit population spike representation significantly enhance the performance of MCS-FQF while also reducing power consumption.

Rapid rebalancing of co-tuned ensemble activity in the auditory cortex

Sensory information is represented by small varying neuronal ensembles in sensory cortices. In the auditory cortex (AC) repeated presentations of the same sound activate differing ensembles indicating high trial-by trial variability in activity even though the sounds activate the same percept. Efficient processing of complex acoustic signals requires that these sparsely distributed neuronal ensembles actively interact in order to provide a constant percept. Thus, the differing ensembles might interact to process the incoming sound inputs. Here, we probe interactions within and across ensembles by combining in vivo 2-photon Ca2+ imaging and holographic optogenetic stimulation to study how increased activity of single cells level affects the cortical network. We stimulated a small number of neurons sharing the same frequency preference alongside the presentation of a target pure tone, further increasing their tone-evoked activity. We found that other non-stimulated co-tuned neurons decreased their tone-evoked activity when the frequency of the presented pure tone matched to their tuning property, while non co-tuned neurons were unaffected. Activity decrease was greater for non-stimulated co-tuned neurons with higher frequency selectivity. Co-tuned and non co-tuned neurons were spatially intermingled. Our results shows that co-tuned ensembles communicated and balanced their total activity across the larger network. The rebalanced network activity due to external stimulation remained constant. These effects suggest that co-tuned ensembles in AC interact and rapidly rebalance their activity to maintain encoding homeostasis, and that the rebalanced network is persistent.

Quality space computations for consciousness

The quality space hypothesis about conscious experience proposes that conscious sensory states are experienced in relation to other possible sensory states. For instance, the colour red is experienced as being more like orange, and less like green or blue. Recent empirical findings suggest that subjective similarity space can be explained in terms of similarities in neural activation patterns. Here, we consider how localist, workspace, and higher-order theories of consciousness can accommodate claims about the qualitative character of experience and functionally support a quality space. We review existing empirical evidence for each of these positions, and highlight novel experimental tools, such as altering local activation spaces via brain stimulation or behavioural training, that can distinguish these accounts.

Oscillations in an artificial neural network convert competing inputs into a temporal code

The field of computer vision has long drawn inspiration from neuroscientific studies of the human and non-human primate visual system. The development of convolutional neural networks (CNNs), for example, was informed by the properties of simple and complex cells in early visual cortex. However, the computational relevance of oscillatory dynamics experimentally observed in the visual system are typically not considered in artificial neural networks (ANNs). Computational models of neocortical dynamics, on the other hand, rarely take inspiration from computer vision. Here, we combine methods from computational neuroscience and machine learning to implement multiplexing in a simple ANN using oscillatory dynamics. We first trained the network to classify individually presented letters. Post-training, we added temporal dynamics to the hidden layer, introducing refraction in the hidden units as well as pulsed inhibition mimicking neuronal alpha oscillations. Without these dynamics, the trained network correctly classified individual letters but produced a mixed output when presented with two letters simultaneously, indicating a bottleneck problem. When introducing refraction and oscillatory inhibition, the output nodes corresponding to the two stimuli activate sequentially, ordered along the phase of the inhibitory oscillations. Our model implements the idea that inhibitory oscillations segregate competing inputs in time. The results of our simulations pave the way for applications in deeper network architectures and more complicated machine learning problems.

Multiunit Frontal Eye Field Activity Codes the Visuomotor Transformation, But Not Gaze Prediction or Retrospective Target Memory, in a Delayed Saccade Task

Single-unit (SU) activity-action potentials isolated from one neuron-has traditionally been employed to relate neuronal activity to behavior. However, recent investigations have shown that multiunit (MU) activity-ensemble neural activity recorded within the vicinity of one microelectrode-may also contain accurate estimations of task-related neural population dynamics. Here, using an established model-fitting approach, we compared the spatial codes of SU response fields with corresponding MU response fields recorded from the frontal eye fields (FEFs) in head-unrestrained monkeys (Macaca mulatta) during a memory-guided saccade task. Overall, both SU and MU populations showed a simple visuomotor transformation: the visual response coded target-in-eye coordinates, transitioning progressively during the delay toward a future gaze-in-eye code in the saccade motor response. However, the SU population showed additional secondary codes, including a predictive gaze code in the visual response and retention of a target code in the motor response. Further, when SUs were separated into regular/fast spiking neurons, these cell types showed different spatial code progressions during the late delay period, only converging toward gaze coding during the final saccade motor response. Finally, reconstructing MU populations (by summing SU data within the same sites) failed to replicate either the SU or MU pattern. These results confirm the theoretical and practical potential of MU activity recordings as a biomarker for fundamental sensorimotor transformations (e.g., target-to-gaze coding in the oculomotor system), while also highlighting the importance of SU activity for coding more subtle (e.g., predictive/memory) aspects of sensorimotor behavior.

Neural interactions in the human frontal cortex dissociate reward and punishment learning

How human prefrontal and insular regions interact while maximizing rewards and minimizing punishments is unknown. Capitalizing on human intracranial recordings, we demonstrate that the functional specificity toward reward or punishment learning is better disentangled by interactions compared to local representations. Prefrontal and insular cortices display non-selective neural populations to rewards and punishments. Non-selective responses, however, give rise to context-specific interareal interactions. We identify a reward subsystem with redundant interactions between the orbitofrontal and ventromedial prefrontal cortices, with a driving role of the latter. In addition, we find a punishment subsystem with redundant interactions between the insular and dorsolateral cortices, with a driving role of the insula. Finally, switching between reward and punishment learning is mediated by synergistic interactions between the two subsystems. These results provide a unifying explanation of distributed cortical representations and interactions supporting reward and punishment learning.

Phase-dependent word perception emerges from region-specific sensitivity to the statistics of language

Neural oscillations reflect fluctuations in excitability, which biases the percept of ambiguous sensory input. Why this bias occurs is still not fully understood. We hypothesized that neural populations representing likely events are more sensitive, and thereby become active on earlier oscillatory phases, when the ensemble itself is less excitable. Perception of ambiguous input presented during less-excitable phases should therefore be biased toward frequent or predictable stimuli that have lower activation thresholds. Here, we show such a frequency bias in spoken word recognition using psychophysics, magnetoencephalography (MEG), and computational modelling. With MEG, we found a double dissociation, where the phase of oscillations in the superior temporal gyrus and medial temporal gyrus biased word-identification behavior based on phoneme and lexical frequencies, respectively. This finding was reproduced in a computational model. These results demonstrate that oscillations provide a temporal ordering of neural activity based on the sensitivity of separable neural populations.

The Feel of Speech: Multisystem and Polymodal Somatosensation in Speech Production

PURPOSE

The oral structures such as the tongue and lips have remarkable somatosensory capacities, but understanding the roles of somatosensation in speech production requires a more comprehensive knowledge of somatosensation in the speech production system in its entirety, including the respiratory, laryngeal, and supralaryngeal subsystems. This review was conducted to summarize the system-wide somatosensory information available for speech production.

METHOD

The search was conducted with PubMed/Medline and Google Scholar for articles published until November 2023. Numerous search terms were used in conducting the review, which covered the topics of psychophysics, basic and clinical behavioral research, neuroanatomy, and neuroscience.

RESULTS AND CONCLUSIONS

The current understanding of speech somatosensation rests primarily on the two pillars of psychophysics and neuroscience. The confluence of polymodal afferent streams supports the development, maintenance, and refinement of speech production. Receptors are both canonical and noncanonical, with the latter occurring especially in the muscles innervated by the facial nerve. Somatosensory representation in the cortex is disproportionately large and provides for sensory interactions. Speech somatosensory function is robust over the lifespan, with possible declines in advanced aging. The understanding of somatosensation in speech disorders is largely disconnected from research and theory on speech production. A speech somatoscape is proposed as the generalized, system-wide sensation of speech production, with implications for speech development, speech motor control, and speech disorders.

Neural populations within macaque early vestibular pathways are adapted to encode natural self-motion

How the activities of large neural populations are integrated in the brain to ensure accurate perception and behavior remains a central problem in systems neuroscience. Here, we investigated population coding of naturalistic self-motion by neurons within early vestibular pathways in rhesus macaques (Macacca mulatta). While vestibular neurons displayed similar dynamic tuning to self-motion, inspection of their spike trains revealed significant heterogeneity. Further analysis revealed that, during natural but not artificial stimulation, heterogeneity resulted primarily from variability across neurons as opposed to trial-to-trial variability. Interestingly, vestibular neurons displayed different correlation structures during naturalistic and artificial self-motion. Specifically, while correlations due to the stimulus (i.e., signal correlations) did not differ, correlations between the trial-to-trial variabilities of neural responses (i.e., noise correlations) were instead significantly positive during naturalistic but not artificial stimulation. Using computational modeling, we show that positive noise correlations during naturalistic stimulation benefits information transmission by heterogeneous vestibular neural populations. Taken together, our results provide evidence that neurons within early vestibular pathways are adapted to the statistics of natural self-motion stimuli at the population level. We suggest that similar adaptations will be found in other systems and species.

Evidence for Multiscale Multiplexed Representation of Visual Features in EEG

Distinct neural processes such as sensory and memory processes are often encoded over distinct timescales of neural activations. Animal studies have shown that this multiscale coding strategy is also implemented for individual components of a single process, such as individual features of a multifeature stimulus in sensory coding. However, the generalizability of this encoding strategy to the human brain has remained unclear. We asked if individual features of visual stimuli were encoded over distinct timescales. We applied a multiscale time-resolved decoding method to electroencephalography (EEG) collected from human subjects presented with grating visual stimuli to estimate the timescale of individual stimulus features. We observed that the orientation and color of the stimuli were encoded in shorter timescales, whereas spatial frequency and the contrast of the same stimuli were encoded in longer timescales. The stimulus features appeared in temporally overlapping windows along the trial supporting a multiplexed coding strategy. These results provide evidence for a multiplexed, multiscale coding strategy in the human visual system.

Neuronal Population Encoding of Identity in Primate Prefrontal Cortex

The ventrolateral prefrontal cortex (VLPFC) shows robust activation during the perception of faces and voices. However, little is known about what categorical features of social stimuli drive neural activity in this region. Since perception of identity and expression are critical social functions, we examined whether neural responses to naturalistic stimuli were driven by these two categorical features in the prefrontal cortex. We recorded single neurons in the VLPFC, while two male rhesus macaques (Macaca mulatta) viewed short audiovisual videos of unfamiliar conspecifics making expressions of aggressive, affiliative, and neutral valence. Of the 285 neurons responsive to the audiovisual stimuli, 111 neurons had a main effect (two-way ANOVA) of identity, expression, or their interaction in their stimulus-related firing rates; however, decoding of expression and identity using single-unit firing rates rendered poor accuracy. Interestingly, when decoding from pseudo-populations of recorded neurons, the accuracy for both expression and identity increased with population size, suggesting that the population transmitted information relevant to both variables. Principal components analysis of mean population activity across time revealed that population responses to the same identity followed similar trajectories in the response space, facilitating segregation from other identities. Our results suggest that identity is a critical feature of social stimuli that dictates the structure of population activity in the VLPFC, during the perception of vocalizations and their corresponding facial expressions. These findings enhance our understanding of the role of the VLPFC in social behavior.

Interdependence of "What" and "When" in the Brain

From a brain's-eye-view, when a stimulus occurs and what it is are interrelated aspects of interpreting the perceptual world. Yet in practice, the putative perceptual inferences about sensory content and timing are often dichotomized and not investigated as an integrated process. We here argue that neural temporal dynamics can influence what is perceived, and in turn, stimulus content can influence the time at which perception is achieved. This computational principle results from the highly interdependent relationship of what and when in the environment. Both brain processes and perceptual events display strong temporal variability that is not always modeled; we argue that understanding-and, minimally, modeling-this temporal variability is key for theories of how the brain generates unified and consistent neural representations and that we ignore temporal variability in our analysis practice at the peril of both data interpretation and theory-building. Here, we review what and when interactions in the brain, demonstrate via simulations how temporal variability can result in misguided interpretations and conclusions, and outline how to integrate and synthesize what and when in theories and models of brain computation.

Filtering property of myelinated internode can change neural information representability and might trigger a compensatory action during demyelination

In this paper, for the first time, we showed that an Internode Segment (INS) of a myelinated axon acts as a lowpass filter, and its filter characteristics depend on the number of myelin turns. Consequently, we showed how the representability of a neural signal could be altered with myelin loss in pathological conditions involving demyelinating diseases. Contrary to the traditionally held viewpoint that myelin geometry of an INS is optimised for maximising Conduction Velocity (CV) of Action Potential (AP), our theory provides an alternative viewpoint that myelin geometry of an INS is optimised for maximizing representability of the stimuli a fibre is meant to carry. Subsequently, we show that this new viewpoint could explain hitherto unexplained experimentally observed phenomena such as, shortening of INS length during demyelination and remyelination, and non-uniform distribution of INS in the central nervous system fibres and associated changes in diameter of nodes of ranvier along an axon. Finally, our theory indicates that a compensatory action could take place during demyelination up to a certain number of loss of myelin turns to preserve the neural signal representability by simultaneous linear scaling of the length of an INS and the inner radius of the fibre.

Thermal illusions for thermal displays: a review

Thermal illusions, a subset of haptic illusions, have historically faced technical challenges and limited exploration. They have been underutilized in prior studies related to thermal displays. This review paper primarily aims to comprehensively categorize thermal illusions, offering insights for diverse applications in thermal display design. Recent advancements in the field have spurred a fresh perspective on thermal and pain perception, specifically through the lens of thermal illusions.

First-spike coding promotes accurate and efficient spiking neural networks for discrete events with rich temporal structures

Spiking neural networks (SNNs) are well-suited to process asynchronous event-based data. Most of the existing SNNs use rate-coding schemes that focus on firing rate (FR), and so they generally ignore the spike timing in events. On the contrary, methods based on temporal coding, particularly time-to-first-spike (TTFS) coding, can be accurate and efficient but they are difficult to train. Currently, there is limited research on applying TTFS coding to real events, since traditional TTFS-based methods impose one-spike constraint, which is not realistic for event-based data. In this study, we present a novel decision-making strategy based on first-spike (FS) coding that encodes FS timings of the output neurons to investigate the role of the first-spike timing in classifying real-world event sequences with complex temporal structures. To achieve FS coding, we propose a novel surrogate gradient learning method for discrete spike trains. In the forward pass, output spikes are encoded into discrete times to generate FS times. In the backpropagation, we develop an error assignment method that propagates error from FS times to spikes through a Gaussian window, and then supervised learning for spikes is implemented through a surrogate gradient approach. Additional strategies are introduced to facilitate the training of FS timings, such as adding empty sequences and employing different parameters for different layers. We make a comprehensive comparison between FS and FR coding in the experiments. Our results show that FS coding achieves comparable accuracy to FR coding while leading to superior energy efficiency and distinct neuronal dynamics on data sequences with very rich temporal structures. Additionally, a longer time delay in the first spike leads to higher accuracy, indicating important information is encoded in the timing of the first spike.

Inferring cognitive state underlying conflict choices in verbal Stroop task using heterogeneous input discriminative-generative decoder model

Objective. The subthalamic nucleus (STN) of the basal ganglia interacts with the medial prefrontal cortex (mPFC) and shapes a control loop, specifically when the brain receives contradictory information from either different sensory systems or conflicting information from sensory inputs and prior knowledge that developed in the brain. Experimental studies demonstrated that significant increases in theta activities (2-8 Hz) in both the STN and mPFC as well as increased phase synchronization between mPFC and STN are prominent features of conflict processing. While these neural features reflect the importance of STN-mPFC circuitry in conflict processing, a low-dimensional representation of the mPFC-STN interaction referred to as a cognitive state, that links neural activities generated by these sub-regions to behavioral signals (e.g. the response time), remains to be identified.Approach. Here, we propose a new model, namely, the heterogeneous input discriminative-generative decoder (HI-DGD) model, to infer a cognitive state underlying decision-making based on neural activities (STN and mPFC) and behavioral signals (individuals' response time) recorded in ten Parkinson's disease (PD) patients while they performed a Stroop task. PD patients may have conflict processing which is quantitatively (may be qualitative in some) different from healthy populations.Main results. Using extensive synthetic and experimental data, we showed that the HI-DGD model can diffuse information from neural and behavioral data simultaneously and estimate cognitive states underlying conflict and non-conflict trials significantly better than traditional methods. Additionally, the HI-DGD model identified which neural features made significant contributions to conflict and non-conflict choices. Interestingly, the estimated features match well with those reported in experimental studies.Significance. Finally, we highlight the capability of the HI-DGD model in estimating a cognitive state from a single trial of observation, which makes it appropriate to be utilized in closed-loop neuromodulation systems.

Unsupervised Spiking Neural Network with Dynamic Learning of Inhibitory Neurons

A spiking neural network (SNN) is a type of artificial neural network that operates based on discrete spikes to process timing information, similar to the manner in which the human brain processes real-world problems. In this paper, we propose a new spiking neural network (SNN) based on conventional, biologically plausible paradigms, such as the leaky integrate-and-fire model, spike timing-dependent plasticity, and the adaptive spiking threshold, by suggesting new biological models; that is, dynamic inhibition weight change, a synaptic wiring method, and Bayesian inference. The proposed network is designed for image recognition tasks, which are frequently used to evaluate the performance of conventional deep neural networks. To manifest the bio-realistic neural architecture, the learning is unsupervised, and the inhibition weight is dynamically changed; this, in turn, affects the synaptic wiring method based on Hebbian learning and the neuronal population. In the inference phase, Bayesian inference successfully classifies the input digits by counting the spikes from the responding neurons. The experimental results demonstrate that the proposed biological model ensures a performance improvement compared with other biologically plausible SNN models.

Excitatory Dysfunction Drives Network and Calcium Handling Deficits in 16p11.2 Duplication Schizophrenia Induced Pluripotent Stem Cell-Derived Neurons

BACKGROUND

Schizophrenia (SCZ) is a debilitating psychiatric disorder with a large genetic contribution; however, its neurodevelopmental substrates remain largely unknown. Modeling pathogenic processes in SCZ using human induced pluripotent stem cell-derived neurons (iNs) has emerged as a promising strategy. Copy number variants confer high genetic risk for SCZ, with duplication of the 16p11.2 locus increasing the risk 14.5-fold.

METHODS

To dissect the contribution of induced excitatory neurons (iENs) versus GABAergic (gamma-aminobutyric acidergic) neurons (iGNs) to SCZ pathophysiology, we induced iNs from CRISPR (clustered regularly interspaced short palindromic repeats)-Cas9 isogenic and SCZ patient-derived induced pluripotent stem cells and analyzed SCZ-related phenotypes in iEN monocultures and iEN/iGN cocultures.

RESULTS

In iEN/iGN cocultures, neuronal firing and synchrony were reduced at later, but not earlier, stages of in vitro development. These were fully recapitulated in iEN monocultures, indicating a primary role for iENs. Moreover, isogenic iENs showed reduced dendrite length and deficits in calcium handling. iENs from 16p11.2 duplication-carrying patients with SCZ displayed overlapping deficits in network synchrony, dendrite outgrowth, and calcium handling. Transcriptomic analysis of both iEN cohorts revealed molecular markers of disease related to the glutamatergic synapse, neuroarchitecture, and calcium regulation.

CONCLUSIONS

Our results indicate the presence of 16p11.2 duplication-dependent alterations in SCZ patient-derived iENs. Transcriptomics and cellular phenotyping reveal overlap between isogenic and patient-derived iENs, suggesting a central role of glutamatergic, morphological, and calcium dysregulation in 16p11.2 duplication-mediated pathogenesis. Moreover, excitatory dysfunction during early neurodevelopment is implicated as the basis of SCZ pathogenesis in 16p11.2 duplication carriers. Our results support network synchrony and calcium handling as outcomes directly linked to this genetic risk variant.

Serotonin increases population coding of behaviorally relevant stimuli by enhancing responses of ON but not OFF-type sensory neurons

How neural populations encode sensory input to generate behavioral responses remains a central problem in systems neuroscience. Here we investigated how neuromodulation influences population coding of behaviorally relevant stimuli to give rise to behavior in the electrosensory system of the weakly electric fish Apteronotus leptorhynchus. We performed multi-unit recordings from ON and OFF sensory pyramidal cells in response to stimuli whose amplitude (i.e., envelope) varied in time, before and after electrical stimulation of the raphe nuclei. Overall, raphe stimulation increased population coding by ON- but not by OFF-type cells, despite both cell types showing similar sensitivities to the stimulus at the single neuron level. Surprisingly, only changes in population coding by ON-type cells were correlated with changes in behavioral responses. Taken together, our results show that neuromodulation differentially affects ON vs. OFF-type cells in order to enhance perception of behaviorally relevant sensory input.

Distinctive properties of biological neural networks and recent advances in bottom-up approaches toward a better biologically plausible neural network

Although it may appear infeasible and impractical, building artificial intelligence (AI) using a bottom-up approach based on the understanding of neuroscience is straightforward. The lack of a generalized governing principle for biological neural networks (BNNs) forces us to address this problem by converting piecemeal information on the diverse features of neurons, synapses, and neural circuits into AI. In this review, we described recent attempts to build a biologically plausible neural network by following neuroscientifically similar strategies of neural network optimization or by implanting the outcome of the optimization, such as the properties of single computational units and the characteristics of the network architecture. In addition, we proposed a formalism of the relationship between the set of objectives that neural networks attempt to achieve, and neural network classes categorized by how closely their architectural features resemble those of BNN. This formalism is expected to define the potential roles of top-down and bottom-up approaches for building a biologically plausible neural network and offer a map helping the navigation of the gap between neuroscience and AI engineering.

Learning how network structure shapes decision-making for bio-inspired computing

To better understand how network structure shapes intelligent behavior, we developed a learning algorithm that we used to build personalized brain network models for 650 Human Connectome Project participants. We found that participants with higher intelligence scores took more time to solve difficult problems, and that slower solvers had higher average functional connectivity. With simulations we identified a mechanistic link between functional connectivity, intelligence, processing speed and brain synchrony for trading accuracy with speed in dependence of excitation-inhibition balance. Reduced synchrony led decision-making circuits to quickly jump to conclusions, while higher synchrony allowed for better integration of evidence and more robust working memory. Strict tests were applied to ensure reproducibility and generality of the obtained results. Here, we identify links between brain structure and function that enable to learn connectome topology from noninvasive recordings and map it to inter-individual differences in behavior, suggesting broad utility for research and clinical applications.

Information transmission velocity-based dynamic hierarchical brain networks

The brain functions as an accurate circuit that regulates information to be sequentially propagated and processed in a hierarchical manner. However, it is still unknown how the brain is hierarchically organized and how information is dynamically propagated during high-level cognition. In this study, we developed a new scheme for quantifying the information transmission velocity (ITV) by combining electroencephalogram (EEG) and diffusion tensor imaging (DTI), and then mapped the cortical ITV network (ITVN) to explore the information transmission mechanism of the human brain. The application in MRI-EEG data of P300 revealed bottom-up and top-down ITVN interactions subserving P300 generation, which was comprised of four hierarchical modules. Among these four modules, information exchange between visual- and attention-activated regions occurred at a high velocity, related cognitive processes could thus be efficiently accomplished due to the heavy myelination of these regions. Moreover, inter-individual variability in P300 was probed to be attributed to the difference in information transmission efficiency of the brain, which may provide new insight into the cognitive degenerations in clinical neurodegenerative disorders, such as Alzheimer's disease, from the transmission velocity perspective. Together, these findings confirm the capacity of ITV to effectively determine the efficiency of information propagation in the brain.

Quantitative models of auditory cortical processing

To generate insight from experimental data, it is critical to understand the inter-relationships between individual data points and place them in context within a structured framework. Quantitative modeling can provide the scaffolding for such an endeavor. Our main objective in this review is to provide a primer on the range of quantitative tools available to experimental auditory neuroscientists. Quantitative modeling is advantageous because it can provide a compact summary of observed data, make underlying assumptions explicit, and generate predictions for future experiments. Quantitative models may be developed to characterize or fit observed data, to test theories of how a task may be solved by neural circuits, to determine how observed biophysical details might contribute to measured activity patterns, or to predict how an experimental manipulation would affect neural activity. In complexity, quantitative models can range from those that are highly biophysically realistic and that include detailed simulations at the level of individual synapses, to those that use abstract and simplified neuron models to simulate entire networks. Here, we survey the landscape of recently developed models of auditory cortical processing, highlighting a small selection of models to demonstrate how they help generate insight into the mechanisms of auditory processing. We discuss examples ranging from models that use details of synaptic properties to explain the temporal pattern of cortical responses to those that use modern deep neural networks to gain insight into human fMRI data. We conclude by discussing a biologically realistic and interpretable model that our laboratory has developed to explore aspects of vocalization categorization in the auditory pathway.

Biophysical parameters control signal transfer in spiking network

Introduction

Information transmission and representation in both natural and artificial networks is dependent on connectivity between units. Biological neurons, in addition, modulate synaptic dynamics and post-synaptic membrane properties, but how these relate to information transmission in a population of neurons is still poorly understood. A recent study investigated local learning rules and showed how a spiking neural network can learn to represent continuous signals. Our study builds on their model to explore how basic membrane properties and synaptic delays affect information transfer.

Methods

The system consisted of three input and output units and a hidden layer of 300 excitatory and 75 inhibitory leaky integrate-and-fire (LIF) or adaptive integrate-and-fire (AdEx) units. After optimizing the connectivity to accurately replicate the input patterns in the output units, we transformed the model to more biologically accurate units and included synaptic delay and concurrent action potential generation in distinct neurons. We examined three different parameter regimes which comprised either identical physiological values for both excitatory and inhibitory units (Comrade), more biologically accurate values (Bacon), or the Comrade regime whose output units were optimized for low reconstruction error (HiFi). We evaluated information transmission and classification accuracy of the network with four distinct metrics: coherence, Granger causality, transfer entropy, and reconstruction error.

Results

Biophysical parameters showed a major impact on information transfer metrics. The classification was surprisingly robust, surviving very low firing and information rates, whereas information transmission overall and particularly low reconstruction error were more dependent on higher firing rates in LIF units. In AdEx units, the firing rates were lower and less information was transferred, but interestingly the highest information transmission rates were no longer overlapping with the highest firing rates.

Discussion

Our findings can be reflected on the predictive coding theory of the cerebral cortex and may suggest information transfer qualities as a phenomenological quality of biological cells.

Alternative strategy for driving voltage-oscillator in neocortex of rats

Information integration in the brain requires functional connectivity between local neural networks. Here, we investigated the interregional coupling mechanism from the viewpoint of oscillations using optical recording methods. Low-frequency electrical stimulation of rat neocortical slices in a caffeine-containing medium induced oscillatory activity between the primary visual cortex (Oc1) and medial secondary visual cortex (Oc2M), in which the oscillation generator was located in the Oc2M and was triggered by a feedforward signal. During to-and-fro oscillatory activity, neural excitation was marked in layer II/III. When the upper layer was disrupted between Oc1 and Oc2M, feedforward signals could propagate through the deep layer and switch on the oscillator in the Oc2M. When the lower layer was disrupted between Oc1 and Oc2M, feedforward signals could propagate through the upper layer and switch on the oscillator in the Oc2M. In the backward direction, neither the upper layer cut nor the lower layer cut disrupted the propagation of the oscillations. In all cases, the horizontal and vertical pathways were used as needed. Fluctuations in the oscillatory waveforms of the local field potential at the upper and lower layers in the Oc2M were reversed, suggesting that the oscillation originated between the two layers. Thus, the neocortex may work as a safety device for interregional communications in an alternative way to drive voltage oscillators in the neocortex.

Morphological Features of Human Dendritic Spines

Dendritic spine features in human neurons follow the up-to-date knowledge presented in the previous chapters of this book. Human dendrites are notable for their heterogeneity in branching patterns and spatial distribution. These data relate to circuits and specialized functions. Spines enhance neuronal connectivity, modulate and integrate synaptic inputs, and provide additional plastic functions to microcircuits and large-scale networks. Spines present a continuum of shapes and sizes, whose number and distribution along the dendritic length are diverse in neurons and different areas. Indeed, human neurons vary from aspiny or "relatively aspiny" cells to neurons covered with a high density of intermingled pleomorphic spines on very long dendrites. In this chapter, we discuss the phylogenetic and ontogenetic development of human spines and describe the heterogeneous features of human spiny neurons along the spinal cord, brainstem, cerebellum, thalamus, basal ganglia, amygdala, hippocampal regions, and neocortical areas. Three-dimensional reconstructions of Golgi-impregnated dendritic spines and data from fluorescence microscopy are reviewed with ultrastructural findings to address the complex possibilities for synaptic processing and integration in humans. Pathological changes are also presented, for example, in Alzheimer's disease and schizophrenia. Basic morphological data can be linked to current techniques, and perspectives in this research field include the characterization of spines in human neurons with specific transcriptome features, molecular classification of cellular diversity, and electrophysiological identification of coexisting subpopulations of cells. These data would enlighten how cellular attributes determine neuron type-specific connectivity and brain wiring for our diverse aptitudes and behavior.

Compulsive alcohol drinking in rodents is associated with altered representations of behavioral control and seeking in dorsal medial prefrontal cortex

A key feature of compulsive alcohol drinking is continuing to drink despite negative consequences. To examine the changes in neural activity that underlie this behavior, compulsive alcohol drinking was assessed in a validated rodent model of heritable risk for excessive drinking (alcohol preferring (P) rats). Neural activity was measured in dorsal medial prefrontal cortex (dmPFC-a brain region involved in maladaptive decision-making) and assessed via change point analyses and novel principal component analyses. Neural population representations of specific decision-making variables were measured to determine how they were altered in animals that drink alcohol compulsively. Compulsive animals showed weakened representations of behavioral control signals, but strengthened representations of alcohol seeking-related signals. Finally, chemogenetic-based excitation of dmPFC prevented escalation of compulsive alcohol drinking. Collectively, these data indicate that compulsive alcohol drinking in rats is associated with alterations in dmPFC neural activity that underlie diminished behavioral control and enhanced seeking.

Modular Organization of Signal Transmission in Primate Somatosensory Cortex

Axonal patches are known as the major sites of synaptic connections in the cerebral cortex of higher order mammals. However, the functional role of these patches is highly debated. Patches are formed by populations of nearby neurons in a topographic manner and are recognized as the termination fields of long-distance lateral connections within and between cortical areas. In addition, axons form numerous boutons that lie outside the patches, whose function is also unknown. To better understand the functional roles of these two distinct populations of boutons, we compared individual and collective morphological features of axons within and outside the patches of intra-areal, feedforward, and feedback pathways by way of tract tracing in the somatosensory cortex of New World monkeys. We found that, with the exception of tortuosity, which is an invariant property, bouton spacing and axonal convergence properties differ significantly between axons within patch and no-patch domains. Principal component analyses corroborated the clustering of axons according to patch formation without any additional effect by the type of pathway or laminar distribution. Stepwise logistic regression identified convergence and bouton density as the best predictors of patch formation. These findings support that patches are specific sites of axonal convergence that promote the synchronous activity of neuronal populations. On the other hand, no-patch domains could form a neuroanatomical substrate to diversify the responses of cortical neurons.

Modeling cortical synaptic effects of anesthesia and their cholinergic reversal

General anesthetics work through a variety of molecular mechanisms while resulting in the common end point of sedation and loss of consciousness. Generally, the administration of common anesthetics induces reduction in synaptic excitation while promoting synaptic inhibition. Exogenous modulation of the anesthetics' synaptic effects can help determine the neuronal pathways involved in anesthesia. For example, both animal and human studies have shown that exogenously induced increases in acetylcholine in the brain can elicit wakeful-like behavior despite the continued presence of the anesthetic. However, the underlying mechanisms of anesthesia reversal at the cellular level have not been investigated. Here we apply a computational model of a network of excitatory and inhibitory neurons to simulate the network-wide effects of anesthesia, due to changes in synaptic inhibition and excitation, and their reversal by cholinergic activation through muscarinic receptors. We use a differential evolution algorithm to fit model parameters to match measures of spiking activity, neuronal connectivity, and network dynamics recorded in the visual cortex of rodents during anesthesia with desflurane in vivo. We find that facilitating muscarinic receptor effects of acetylcholine on top of anesthetic-induced synaptic changes predicts the reversal of anesthetic suppression of neurons' spiking activity, functional connectivity, as well as pairwise and population interactions. Thus, our model predicts a specific neuronal mechanism for the cholinergic reversal of anesthesia consistent with experimental behavioral observations.

Neural Synchrony and Network Dynamics in Social Interaction: A Hyper-Brain Cell Assembly Hypothesis

Mounting neurophysiological evidence suggests that interpersonal interaction relies on continual communication between cell assemblies within interacting brains and continual adjustments of these neuronal dynamic states between the brains. In this Hypothesis and Theory article, a Hyper-Brain Cell Assembly Hypothesis is suggested on the basis of a conceptual review of neural synchrony and network dynamics and their roles in emerging cell assemblies within the interacting brains. The proposed hypothesis states that such cell assemblies can emerge not only within, but also between the interacting brains. More precisely, the hyper-brain cell assembly encompasses and integrates oscillatory activity within and between brains, and represents a common hyper-brain unit, which has a certain relation to social behavior and interaction. Hyper-brain modules or communities, comprising nodes across two or several brains, are considered as one of the possible representations of the hypothesized hyper-brain cell assemblies, which can also have a multidimensional or multilayer structure. It is concluded that the neuronal dynamics during interpersonal interaction is brain-wide, i.e., it is based on common neuronal activity of several brains or, more generally, of the coupled physiological systems including brains.

Direct Discriminative Decoder Models for Analysis of High-Dimensional Dynamical Neural Data

With the accelerated development of neural recording technology over the past few decades, research in integrative neuroscience has become increasingly reliant on data analysis methods that are scalable to high-dimensional recordings and computationally tractable. Latent process models have shown promising results in estimating the dynamics of cognitive processes using individual models for each neuron's receptive field. However, scaling these models to work on high-dimensional neural recordings remains challenging. Not only is it impractical to build receptive field models for individual neurons of a large neural population, but most neural data analyses based on individual receptive field models discard the local history of neural activity, which has been shown to be critical in the accurate inference of the underlying cognitive processes. Here, we propose a novel, scalable latent process model that can directly estimate cognitive process dynamics without requiring precise receptive field models of individual neurons or brain nodes. We call this the direct discriminative decoder (DDD) model. The DDD model consists of (1) a discriminative process that characterizes the conditional distribution of the signal to be estimated, or state, as a function of both the current neural activity and its local history, and (2) a state transition model that characterizes the evolution of the state over a longer time period. While this modeling framework inherits advantages of existing latent process modeling methods, its computational cost is tractable. More important, the solution can incorporate any information from the history of neural activity at any timescale in computing the estimate of the state process. There are many choices in building the discriminative process, including deep neural networks or gaussian processes, which adds to the flexibility of the framework. We argue that these attributes of the proposed methodology, along with its applicability to different modalities of neural data, make it a powerful tool for high-dimensional neural data analysis. We also introduce an extension of these methods, called the discriminative-generative decoder (DGD). The DGD includes both discriminative and generative processes in characterizing observed data. As a result, we can combine physiological correlates like behavior with neural data to better estimate underlying cognitive processes. We illustrate the methods, including steps for inference and model identification, and demonstrate applications to multiple data analysis problems with high-dimensional neural recordings. The modeling results demonstrate the computational and modeling advantages of the DDD and DGD methods.

Complementary encoding of spatial information in hippocampal astrocytes

Calcium dynamics into astrocytes influence the activity of nearby neuronal structures. However, because previous reports show that astrocytic calcium signals largely mirror neighboring neuronal activity, current information coding models neglect astrocytes. Using simultaneous two-photon calcium imaging of astrocytes and neurons in the hippocampus of mice navigating a virtual environment, we demonstrate that astrocytic calcium signals encode (i.e., statistically reflect) spatial information that could not be explained by visual cue information. Calcium events carrying spatial information occurred in topographically organized astrocytic subregions. Importantly, astrocytes encoded spatial information that was complementary and synergistic to that carried by neurons, improving spatial position decoding when astrocytic signals were considered alongside neuronal ones. These results suggest that the complementary place dependence of localized astrocytic calcium signals may regulate clusters of nearby synapses, enabling dynamic, context-dependent variations in population coding within brain circuits.

Shed CNTNAP2 ectodomain is detectable in CSF and regulates Ca2+ homeostasis and network synchrony via PMCA2/ATP2B2

Although many neuronal membrane proteins undergo proteolytic cleavage, little is known about the biological significance of neuronal ectodomain shedding (ES). Here, we show that the neuronal sheddome is detectable in human cerebrospinal fluid (hCSF) and is enriched in neurodevelopmental disorder (NDD) risk factors. Among shed synaptic proteins is the ectodomain of CNTNAP2 (CNTNAP2-ecto), a prominent NDD risk factor. CNTNAP2 undergoes activity-dependent ES via MMP9 (matrix metalloprotease 9), and CNTNAP2-ecto levels are reduced in the hCSF of individuals with autism spectrum disorder. Using mass spectrometry, we identified the plasma membrane Ca2+ ATPase (PMCA) extrusion pumps as novel CNTNAP2-ecto binding partners. CNTNAP2-ecto enhances the activity of PMCA2 and regulates neuronal network dynamics in a PMCA2-dependent manner. Our data underscore the promise of sheddome analysis in discovering neurobiological mechanisms, provide insight into the biology of ES and its relationship with the CSF, and reveal a mechanism of regulation of Ca2+ homeostasis and neuronal network synchrony by a shed ectodomain.

Neural Substrates and Models of Omission Responses and Predictive Processes

Predictive coding theories argue that deviance detection phenomena, such as mismatch responses and omission responses, are generated by predictive processes with possibly overlapping neural substrates. Molecular imaging and electrophysiology studies of mismatch responses and corollary discharge in the rodent model allowed the development of mechanistic and computational models of these phenomena. These models enable translation between human and non-human animal research and help to uncover fundamental features of change-processing microcircuitry in the neocortex. This microcircuitry is characterized by stimulus-specific adaptation and feedforward inhibition of stimulus-selective populations of pyramidal neurons and interneurons, with specific contributions from different interneuron types. The overlap of the substrates of different types of responses to deviant stimuli remains to be understood. Omission responses, which are observed both in corollary discharge and mismatch response protocols in humans, are underutilized in animal research and may be pivotal in uncovering the substrates of predictive processes. Omission studies comprise a range of methods centered on the withholding of an expected stimulus. This review aims to provide an overview of omission protocols and showcase their potential to integrate and complement the different models and procedures employed to study prediction and deviance detection.This approach may reveal the biological foundations of core concepts of predictive coding, and allow an empirical test of the framework's promise to unify theoretical models of attention and perception.

Spatialization of Time in the Entorhinal-Hippocampal System

The functional role of the entorhinal-hippocampal system has been a long withstanding mystery. One key theory that has become most popular is that the entorhinal-hippocampal system represents space to facilitate navigation in one's surroundings. In this Perspective article, I introduce a novel idea that undermines the inherent uniqueness of spatial information in favor of time driving entorhinal-hippocampal activity. Specifically, by spatializing events that occur in succession (i.e., across time), the entorhinal-hippocampal system is critical for all types of cognitive representations. I back up this argument with empirical evidence that hints at a role for the entorhinal-hippocampal system in non-spatial representation, and computational models of the logarithmic compression of time in the brain.

Variability of neuronal responses in the posterior superior temporal sulcus predicts choice behavior during social interactions

Recent studies have shown that neural activity in a well-defined patch in the posterior superior temporal sulcus (the "gaze-following patch," GFP) of the primate brain is strongly modulated when the other's gaze attracts the observer's attention to locations/objects, the other is looking at. Changes of the mean discharge rate of neurons in the monkey GFP indicate that they are involved in two distinct computations: the allocation of spatial attention guided by the other's gaze vector and the suppression of gaze following if inappropriate in a given situation. Here, we asked if and how the discharge variability of neurons in the GFP is related to the task and if it carries information on behavioral performance. To this end, we calculated the Fano factor as a measure of across-trial discharge variability as a function of time. Our results show that all neurons exhibiting a task-related discharge-rate modulation also exhibit a stimulus onset-dependent drop in the Fano factor. Furthermore, the amplitude of the Fano factor reduction is modulated by task condition and the neuron's selectivity in this regard. We found that these effects are directly related to the monkeys' behavioral performance in that the Fano factor is predictive about upcoming correct or wrong decisions. Our results indicate that neuronal discharge variability as gauged by the Fano factor, hitherto primarily studied in the context of visual perception or motor control, is an informative measure also in studies of the neural underpinnings of complex social behavior.NEW & NOTEWORTHY Quenching of neural variability following stimulus onset is a widely accepted phenomenon. However, the relevance of quenching for the shaping of complex social behaviors remains to be explored. Here, we show that task selective neurons in the GFP exhibit a higher degree of variability quenching than their neighboring unselective neurons. Furthermore, we demonstrate that behavioral errors are not only associated with lower firing rates but also less variability quenching, suggesting that both facilitate optimal performance.

A Neural Dynamic Model of the Perceptual Grounding of Spatial and Movement Relations

How does the human brain link relational concepts to perceptual experience? For example, a speaker may say "the cup to the left of the computer" to direct the listener's attention to one of two cups on a desk. We provide a neural dynamic account for both perceptual grounding, in which relational concepts enable the attentional selection of objects in the visual array, and for the generation of descriptions of the visual array using relational concepts. In the model, activation in neural populations evolves dynamically under the influence of both inputs and strong interaction as formalized in dynamic field theory. Relational concepts are modeled as patterns of connectivity to perceptual representations. These generalize across the visual array through active coordinate transforms that center the representation of target objects in potential reference objects. How the model perceptually grounds or generates relational descriptions is probed in 104 simulations that systematically vary the spatial and movement relations employed, the number of feature dimensions used, and the number of matching and nonmatching objects. We explain how sequences of decisions emerge from the time- and state-continuous neural dynamics, how relational hypotheses are generated and either accepted or rejected, followed by the selection of new objects or the generation of new relational hypotheses. Its neural realism distinguishes the model from information processing accounts, its capacity to autonomously generate sequences of processing steps distinguishes it from deep neural network accounts. The model points toward a neural dynamic theory of higher cognition.

Understanding ethanol's acute effects on medial prefrontal cortex neural activity using state-space approaches

Acute ethanol (EtOH) intoxication results in several maladaptive behaviors that may be attributable, in part, to the effects of EtOH on neural activity in medial prefrontal cortex (mPFC). The acute effects of EtOH on mPFC function have been largely described as inhibitory. However, translating these observations on function into a mechanism capable of delineating acute EtOH's effects on behavior has proven difficult. This review highlights the role of acute EtOH on electrophysiological measurements of mPFC function and proposes that interpreting these changes through the lens of dynamical systems theory is critical to understand the mechanisms that mediate the effects of EtOH intoxication on behavior. Specifically, the present review posits that the effects of EtOH on mPFC N-methyl-d-aspartate (NMDA) receptors are critical for the expression of impaired behavior following EtOH consumption. This hypothesis is based on the observation that recurrent activity in cortical networks is supported by NMDA receptors, and, when disrupted, may lead to impairments in cognitive function. To evaluate this hypothesis, we discuss the representation of mPFC neural activity in low-dimensional, dynamic state spaces. This approach has proven useful for identifying the underlying computations necessary for the production of behavior. Ultimately, we hypothesize that EtOH-related alterations to NMDA receptor function produces alterations that can be effectively conceptualized as impairments in attractor dynamics and provides insight into how acute EtOH disrupts forms of cognition that rely on mPFC function. This article is part of the special Issue on 'Neurocircuitry Modulating Drug and Alcohol Abuse'.

Causal reductionism and causal structures

Causal reductionism is the widespread assumption that there is no room for additional causes once we have accounted for all elementary mechanisms within a system. Due to its intuitive appeal, causal reductionism is prevalent in neuroscience: once all neurons have been caused to fire or not to fire, it seems that causally there is nothing left to be accounted for. Here, we argue that these reductionist intuitions are based on an implicit, unexamined notion of causation that conflates causation with prediction. By means of a simple model organism, we demonstrate that causal reductionism cannot provide a complete and coherent account of 'what caused what'. To that end, we outline an explicit, operational approach to analyzing causal structures.

Deep Feature Extraction for Resting-State Functional MRI by Self-Supervised Learning and Application to Schizophrenia Diagnosis

In this study, we propose a deep-learning technique for functional MRI analysis. We introduced a novel self-supervised learning scheme that is particularly useful for functional MRI wherein the subject identity is used as the teacher signal of a neural network. The neural network is trained solely based on functional MRI-scans, and the training does not require any explicit labels. The proposed method demonstrated that each temporal volume of resting state functional MRI contains enough information to identify the subject. The network learned a feature space in which the features were clustered per subject for the test data as well as for the training data; this is unlike the features extracted by conventional methods including region of interests (ROIs) pooling signals and principal component analysis. In addition, applying a simple linear classifier to the per-subject mean of the features (namely "identity feature"), we demonstrated that the extracted features could contribute to schizophrenia diagnosis. The classification accuracy of our identity features was comparable to that of the conventional functional connectivity. Our results suggested that our proposed training scheme of the neural network captured brain functioning related to the diagnosis of psychiatric disorders as well as the identity of the subject. Our results together highlight the validity of our proposed technique as a design for self-supervised learning.

A Model of the Early Visual System Based on Parallel Spike-Sequence Detection, Showing Orientation Selectivity

Simple Summary

A computational model of primates’ early visual processing, showing orientation selectivity, is presented. The system importantly integrates two key elements: (1) a neuromorphic spike-decoding structure that considerably resembles the circuitry between layers IV and II/III of the primary visual cortex, both in topology and operation; (2) the plasticity of intrinsic excitability, to embed recent findings about the operation of the same area. The model is proposed as a tool for the analysis and reproduction of the orientation selectivity phenomenon, whose underlying neuronal-level computational mechanisms are today the subject of intense scrutiny. In response to rotated Gabor patches the model is able to exhibit realistic orientation tuning curves and to reproduce responses similar to those found in neurophysiological recordings from the primary visual cortex obtained under the same task, considering different stages of the network. This demonstrates its aptness to capture the mechanisms underlying the evoked response in the primary visual cortex. Our tool is available online, and can be expanded to other experiments using a dedicated software library developed by the authors, to elucidate the computational mechanisms underlying orientation selectivity.

Abstract

Since the first half of the twentieth century, numerous studies have been conducted on how the visual cortex encodes basic image features. One of the hallmarks of basic feature extraction is the phenomenon of orientation selectivity, of which the underlying neuronal-level computational mechanisms remain partially unclear despite being intensively investigated. In this work we present a reduced visual system model (RVSM) of the first level of scene analysis, involving the retina, the lateral geniculate nucleus and the primary visual cortex (V1), showing orientation selectivity. The detection core of the RVSM is the neuromorphic spike-decoding structure MNSD, which is able to learn and recognize parallel spike sequences and considerably resembles the neuronal microcircuits of V1 in both topology and operation. This structure is equipped with plasticity of intrinsic excitability to embed recent findings about V1 operation. The RVSM, which embeds 81 groups of MNSD arranged in 4 oriented columns, is tested using sets of rotated Gabor patches as input. Finally, synthetic visual evoked activity generated by the RVSM is compared with real neurophysiological signal from V1 area: (1) postsynaptic activity of human subjects obtained by magnetoencephalography and (2) spiking activity of macaques obtained by multi-tetrode arrays. The system is implemented using the NEST simulator. The results attest to a good level of resemblance between the model response and real neurophysiological recordings. As the RVSM is available online, and the model parameters can be customized by the user, we propose it as a tool to elucidate the computational mechanisms underlying orientation selectivity.

Orthogonal neural codes for speech in the infant brain

Creating invariant representations from an everchanging speech signal is a major challenge for the human brain. Such an ability is particularly crucial for preverbal infants who must discover the phonological, lexical, and syntactic regularities of an extremely inconsistent signal in order to acquire language. Within the visual domain, an efficient neural solution to overcome variability consists in factorizing the input into a reduced set of orthogonal components. Here, we asked whether a similar decomposition strategy is used in early speech perception. Using a 256-channel electroencephalographic system, we recorded the neural responses of 3-mo-old infants to 120 natural consonant-vowel syllables with varying acoustic and phonetic profiles. Using multivariate pattern analyses, we show that syllables are factorized into distinct and orthogonal neural codes for consonants and vowels. Concerning consonants, we further demonstrate the existence of two stages of processing. A first phase is characterized by orthogonal and context-invariant neural codes for the dimensions of manner and place of articulation. Within the second stage, manner and place codes are integrated to recover the identity of the phoneme. We conclude that, despite the paucity of articulatory motor plans and speech production skills, pre-babbling infants are already equipped with a structured combinatorial code for speech analysis, which might account for the rapid pace of language acquisition during the first year.

An oscillating computational model can track pseudo-rhythmic speech by using linguistic predictions

Neuronal oscillations putatively track speech in order to optimize sensory processing. However, it is unclear how isochronous brain oscillations can track pseudo-rhythmic speech input. Here we propose that oscillations can track pseudo-rhythmic speech when considering that speech time is dependent on content-based predictions flowing from internal language models. We show that temporal dynamics of speech are dependent on the predictability of words in a sentence. A computational model including oscillations, feedback, and inhibition is able to track pseudo-rhythmic speech input. As the model processes, it generates temporal phase codes, which are a candidate mechanism for carrying information forward in time. The model is optimally sensitive to the natural temporal speech dynamics and can explain empirical data on temporal speech illusions. Our results suggest that speech tracking does not have to rely only on the acoustics but could also exploit ongoing interactions between oscillations and constraints flowing from internal language models.

Aperiodic sleep networks promote memory consolidation

Hierarchical synchronization of sleep oscillations establishes communication pathways to support memory reactivation, transfer, and consolidation. From an information-theoretical perspective, oscillations constitute highly structured network states that provide limited information-coding capacity. Recent findings indicate that sleep oscillations occur in transient bursts that are interleaved with aperiodic network states, which were previously considered to be random noise. We argue that aperiodic activity exhibits unique and variable spatiotemporal patterns, providing an ideal information-rich neurophysiological substrate for imprinting new mnemonic patterns onto existing circuits. We discuss novel avenues in conceptualizing and quantifying aperiodic network states during sleep to further understand their relevance and interplay with sleep oscillations in support of memory consolidation.

How Cortical Circuits Implement Cortical Computations: Mouse Visual Cortex as a Model

The mouse, as a model organism to study the brain, gives us unprecedented experimental access to the mammalian cerebral cortex. By determining the cortex's cellular composition, revealing the interaction between its different components, and systematically perturbing these components, we are obtaining mechanistic insight into some of the most basic properties of cortical function. In this review, we describe recent advances in our understanding of how circuits of cortical neurons implement computations, as revealed by the study of mouse primary visual cortex. Further, we discuss how studying the mouse has broadened our understanding of the range of computations performed by visual cortex. Finally, we address how future approaches will fulfill the promise of the mouse in elucidating fundamental operations of cortex.

G protein-coupled receptors as candidates for modulation and activation of the chemical senses in decapod crustaceans

Many studies have characterized class A GPCRs in crustaceans; however, their expression in crustacean chemosensory organs has yet to be detailed. Class A GPCRs comprise several subclasses mediating diverse functions. In this study, using sequence homology, we classified all putative class A GPCRs in two chemosensory organs (antennular lateral flagellum [LF] and walking leg dactyls) and brain of four species of decapod crustaceans (Caribbean spiny lobster Panulirus argus, American lobster Homarus americanus, red-swamp crayfish Procambarus clarkii, and blue crab Callinectes sapidus). We identified 333 putative class A GPCRs– 83 from P. argus, 81 from H. americanus, 102 from P. clarkii, and 67 from C. sapidus–which belong to five distinct subclasses. The numbers of sequences for each subclass in the four decapod species are (in parentheses): opsins (19), small-molecule receptors including biogenic amine receptors (83), neuropeptide receptors (90), leucine-rich repeat-containing GPCRs (LGRs) (24), orphan receptors (117). Most class A GPCRs are predominately expressed in the brain; however, we identified multiple transcripts enriched in the LF and several in the dactyl. In total, we found 55 sequences with higher expression in the chemosensory organs relative to the brain across three decapod species. We also identified novel transcripts enriched in the LF including a metabotropic histamine receptor and numerous orphan receptors. Our work establishes expression patterns for class A GPCRs in the chemosensory organs of crustaceans, providing insight into molecular mechanisms mediating neurotransmission, neuromodulation, and possibly chemoreception.