The Brain as an Efficient and Robust Adaptive Learner

Intelligence, brain structure, dendrites, and genes: Genetic, epigenetic and the underlying of the quadruple helix complexity

Intelligence can be referred to as the mental ability to learn, comprehend abstract concepts, and solve complex problems. Twin and adoption studies have provided insights into the influence of the familial environment and highlighted the importance of heritability in the development of cognition. Detecting the relative contribution of brain areas, neuronal structures, and connectomes has brought some understanding on how various brain areas, white/gray matter structures and neuronal connectivity process information and contribute to intelligence. Using histological, anatomical, electrophysiological, neuropsychological, neuro-imaging and molecular biology methods, several key concepts have emerged: 1) the parietofrontal-hippocampal integrations probably constitute a substrate for smart behavior, 2) neuronal activity results in structural plasticity of dendritic branches responsible for information transfer, critical for learning and memory, 3) intelligent people process information efficiently, 4) the environment triggers mnemonic epigenomic programs (via dynamic regulation of chromatin accessibility, DNA methylation, loop interruption/formation and histone modification) conferring cognitive phenotypes throughout life, and 5) single/double DNA breaks are prominent in human brain disorders associated with cognitive impairment including Alzheimer's disease and schizophrenia. Along with these observations, molecular/cellular/biological studies have identified sets of specific genes associated with higher scores on intelligence tests. Interestingly, many of these genes are associated with dendritogenesis. Because dendrite structure/function is involved in cognition, the control of dendrite genesis/maintenance may be critical for understanding the landscape of general/specific cognitive ability and new pathways for therapeutic approaches.

Computational functions of precisely balanced neuronal microcircuits in an olfactory memory network

Models of balanced autoassociative memory networks predict that specific inhibition is critical to store information in connectivity. To explore these predictions, we characterized and manipulated different subtypes of fast-spiking interneurons in the posterior telencephalic area Dp (pDp) of adult zebrafish, the homolog of the piriform cortex. Modeling of recurrent networks with assemblies showed that a precise balance of excitation and inhibition is important to prevent not only excessive firing rates ("runaway activity") but also the stochastic occurrence of high pattern correlations ("runaway correlations"). Consistent with model predictions, runaway correlations emerged in pDp when synaptic balance was perturbed by optogenetic manipulations of feedback inhibition but not feedforward inhibition. Runaway correlations were driven by sparse subsets of strongly active neurons rather than by a general broadening of tuning curves. These results are consistent with balanced neuronal assemblies in pDp and reveal novel computational functions of inhibitory microcircuits in an autoassociative network.

Structure of activity in multiregion recurrent neural networks

Neural circuits comprise multiple interconnected regions, each with complex dynamics. The interplay between local and global activity is thought to underlie computational flexibility, yet the structure of multiregion neural activity and its origins in synaptic connectivity remain poorly understood. We investigate recurrent neural networks with multiple regions, each containing neurons with random and structured connections. Inspired by experimental evidence of communication subspaces, we use low-rank connectivity between regions to enable selective activity routing. These networks exhibit high-dimensional fluctuations within regions and low-dimensional signal transmission between them. Using dynamical mean-field theory, with cross-region currents as order parameters, we show that regions act as both generators and transmitters of activity-roles that are often in tension. Taming within-region activity can be crucial for effective signal routing. Unlike previous models that suppressed neural activity to control signal flow, our model achieves routing by exciting different high-dimensional activity patterns through connectivity structure and nonlinear dynamics. Our analysis of this disordered system offers insights into multiregion neural data and trained neural networks.

Efficient coding in biophysically realistic excitatory-inhibitory spiking networks

The principle of efficient coding posits that sensory cortical networks are designed to encode maximal sensory information with minimal metabolic cost. Despite the major influence of efficient coding in neuroscience, it has remained unclear whether fundamental empirical properties of neural network activity can be explained solely based on this normative principle. Here, we derive the structural, coding, and biophysical properties of excitatory-inhibitory recurrent networks of spiking neurons that emerge directly from imposing that the network minimizes an instantaneous loss function and a time-averaged performance measure enacting efficient coding. We assumed that the network encodes a number of independent stimulus features varying with a time scale equal to the membrane time constant of excitatory and inhibitory neurons. The optimal network has biologically plausible biophysical features, including realistic integrate-and-fire spiking dynamics, spike-triggered adaptation, and a non-specific excitatory external input. The excitatory-inhibitory recurrent connectivity between neurons with similar stimulus tuning implements feature-specific competition, similar to that recently found in visual cortex. Networks with unstructured connectivity cannot reach comparable levels of coding efficiency. The optimal ratio of excitatory vs inhibitory neurons and the ratio of mean inhibitory-to-inhibitory vs excitatory-to-inhibitory connectivity are comparable to those of cortical sensory networks. The efficient network solution exhibits an instantaneous balance between excitation and inhibition. The network can perform efficient coding even when external stimuli vary over multiple time scales. Together, these results suggest that key properties of biological neural networks may be accounted for by efficient coding.

A neural implementation model of feedback-based motor learning

Animals use feedback to rapidly correct ongoing movements in the presence of a perturbation. Repeated exposure to a predictable perturbation leads to behavioural adaptation that compensates for its effects. Here, we tested the hypothesis that all the processes necessary for motor adaptation may emerge as properties of a controller that adaptively updates its policy. We trained a recurrent neural network to control its own output through an error-based feedback signal, which allowed it to rapidly counteract external perturbations. Implementing a biologically plausible plasticity rule based on this same feedback signal enabled the network to learn to compensate for persistent perturbations through a trial-by-trial process. The network activity changes during learning matched those from populations of neurons from monkey primary motor cortex - known to mediate both movement correction and motor adaptation - during the same task. Furthermore, our model natively reproduced several key aspects of behavioural studies in humans and monkeys. Thus, key features of trial-by-trial motor adaptation can arise from the internal properties of a recurrent neural circuit that adaptively controls its output based on ongoing feedback.

A Unified and Biologically Plausible Relational Graph Representation of Vision Transformers

Vision transformer (ViT) and its variants have achieved remarkable success in various tasks. The key characteristic of these ViT models is to adopt different aggregation strategies of spatial patch information within the artificial neural networks (ANNs). However, there is still a key lack of unified representation of different ViT architectures for systematic understanding and assessment of model representation performance. Moreover, how those well-performing ViT ANNs are similar to real biological neural networks (BNNs) is largely unexplored. To answer these fundamental questions, we, for the first time, propose a unified and biologically plausible relational graph representation of ViT models. Specifically, the proposed relational graph representation consists of two key subgraphs: an aggregation graph and an affine graph. The former considers ViT tokens as nodes and describes their spatial interaction, while the latter regards network channels as nodes and reflects the information communication between channels. Using this unified relational graph representation, we found that: 1) model performance was closely related to graph measures; 2) the proposed relational graph representation of ViT has high similarity with real BNNs; and 3) there was a further improvement in model performance when training with a superior model to constrain the aggregation graph.

Activity waves in condensed excitable phases of Quincke rollers

Traveling waves are universal in excitable systems; yet, the microscopic dynamics of wave propagation is inaccessible in conventional excitable systems. Here, we show that active colloids of Quincke rollers driven by a periodic electric field can form condensed excitable phases. Distinct from existing excitable media, condensed excitable colloids can be tuned reversibly between active liquids and active crystals in which two distinct waves can be excited, respectively. In active liquids, waves propagate by splitting and cross over each other, like sound waves, in collision. In active crystals, waves annihilate or converge, like shock waves, in collision. We show that the microscopic dynamics of sound waves is dominated by electrostatic repulsions while the dynamics of shock waves is encoded with a local density-dependent memory of propulsion. The condensed excitable colloids with tunable and controllable dynamics offer unexplored opportunities for the study of nonlinear phenomena.

Efficient coding in biophysically realistic excitatory-inhibitory spiking networks

The principle of efficient coding posits that sensory cortical networks are designed to encode maximal sensory information with minimal metabolic cost. Despite the major influence of efficient coding in neuroscience, it has remained unclear whether fundamental empirical properties of neural network activity can be explained solely based on this normative principle. Here, we derive the structural, coding, and biophysical properties of excitatory-inhibitory recurrent networks of spiking neurons that emerge directly from imposing that the network minimizes an instantaneous loss function and a time-averaged performance measure enacting efficient coding. We assumed that the network encodes a number of independent stimulus features varying with a time scale equal to the membrane time constant of excitatory and inhibitory neurons. The optimal network has biologically-plausible biophysical features, including realistic integrate-and-fire spiking dynamics, spike-triggered adaptation, and a non-specific excitatory external input. The excitatory-inhibitory recurrent connectivity between neurons with similar stimulus tuning implements feature-specific competition, similar to that recently found in visual cortex. Networks with unstructured connectivity cannot reach comparable levels of coding efficiency. The optimal ratio of excitatory vs inhibitory neurons and the ratio of mean inhibitory-to-inhibitory vs excitatory-to-inhibitory connectivity are comparable to those of cortical sensory networks. The efficient network solution exhibits an instantaneous balance between excitation and inhibition. The network can perform efficient coding even when external stimuli vary over multiple time scales. Together, these results suggest that key properties of biological neural networks may be accounted for by efficient coding.

Geometry and dynamics of representations in a precisely balanced memory network related to olfactory cortex

Biological memory networks are thought to store information by experience-dependent changes in the synaptic connectivity between assemblies of neurons. Recent models suggest that these assemblies contain both excitatory and inhibitory neurons (E/I assemblies), resulting in co-tuning and precise balance of excitation and inhibition. To understand computational consequences of E/I assemblies under biologically realistic constraints we built a spiking network model based on experimental data from telencephalic area Dp of adult zebrafish, a precisely balanced recurrent network homologous to piriform cortex. We found that E/I assemblies stabilized firing rate distributions compared to networks with excitatory assemblies and global inhibition. Unlike classical memory models, networks with E/I assemblies did not show discrete attractor dynamics. Rather, responses to learned inputs were locally constrained onto manifolds that 'focused' activity into neuronal subspaces. The covariance structure of these manifolds supported pattern classification when information was retrieved from selected neuronal subsets. Networks with E/I assemblies therefore transformed the geometry of neuronal coding space, resulting in continuous representations that reflected both relatedness of inputs and an individual's experience. Such continuous representations enable fast pattern classification, can support continual learning, and may provide a basis for higher-order learning and cognitive computations.

Synchronization cluster bursting in adaptive oscillator networks

Adaptive dynamical networks are ubiquitous in real-world systems. This paper aims to explore the synchronization dynamics in networks of adaptive oscillators based on a paradigmatic system of adaptively coupled phase oscillators. Our numerical observations reveal the emergence of synchronization cluster bursting, characterized by periodic transitions between cluster synchronization and global synchronization. By investigating a reduced model, the mechanisms underlying synchronization cluster bursting are clarified. We show that a minimal model exhibiting this phenomenon can be reduced to a phase oscillator with complex-valued adaptation. Furthermore, the adaptivity of the system leads to the appearance of additional symmetries, and thus, to the coexistence of stable bursting solutions with very different Kuramoto order parameters.

Representational learning by optimization of neural manifolds in an olfactory memory network

Higher brain functions depend on experience-dependent representations of relevant information that may be organized by attractor dynamics or by geometrical modifications of continuous "neural manifolds". To explore these scenarios we analyzed odor-evoked activity in telencephalic area pDp of juvenile and adult zebrafish, the homolog of piriform cortex. No obvious signatures of attractor dynamics were detected. Rather, olfactory discrimination training selectively enhanced the separation of neural manifolds representing task-relevant odors from other representations, consistent with predictions of autoassociative network models endowed with precise synaptic balance. Analytical approaches using the framework of manifold capacity revealed multiple geometrical modifications of representational manifolds that supported the classification of task-relevant sensory information. Manifold capacity predicted odor discrimination across individuals, indicating a close link between manifold geometry and behavior. Hence, pDp and possibly related recurrent networks store information in the geometry of representational manifolds, resulting in joint sensory and semantic maps that may support distributed learning processes.

Adaptation of the inferior temporal neurons and efficient visual processing

Numerous studies examining the responses of individual neurons in the inferior temporal (IT) cortex have revealed their characteristics such as two-dimensional or three-dimensional shape tuning, objects, or category selectivity. While these basic selectivities have been studied assuming that their response to stimuli is relatively stable, physiological experiments have revealed that the responsiveness of IT neurons also depends on visual experience. The activity changes of IT neurons occur over various time ranges; among these, repetition suppression (RS), in particular, is robustly observed in IT neurons without any behavioral or task constraints. I observed a similar phenomenon in the ventral visual neurons in macaque monkeys while they engaged in free viewing and actively fixated on one consistent object multiple times. This observation indicates that the phenomenon also occurs in natural situations during which the subject actively views stimuli without forced fixation, suggesting that this phenomenon is an everyday occurrence and widespread across regions of the visual system, making it a default process for visual neurons. Such short-term activity modulation may be a key to understanding the visual system; however, the circuit mechanism and the biological significance of RS remain unclear. Thus, in this review, I summarize the observed modulation types in IT neurons and the known properties of RS. Subsequently, I discuss adaptation in vision, including concepts such as efficient and predictive coding, as well as the relationship between adaptation and psychophysical aftereffects. Finally, I discuss some conceptual implications of this phenomenon as well as the circuit mechanisms and the models that may explain adaptation as a fundamental aspect of visual processing.

Effects of Bumetanide on Neurocognitive Functioning in Children with Autism Spectrum Disorder: Secondary Analysis of a Randomized Placebo-Controlled Trial

We present the secondary-analysis of neurocognitive tests in the 'Bumetanide in Autism Medication and Biomarker' (BAMBI;EUDRA-CT-2014-001560-35) study, a randomized double-blind placebo-controlled (1:1) trial testing 3-months bumetanide treatment (≤ 1 mg twice-daily) in unmedicated children 7-15 years with ASD. Children with IQ ≥ 70 were analyzed for baseline deficits and treatment-effects on the intention-to-treat-population with generalized-linear-models, principal component analysis and network analysis. Ninety-two children were allocated to treatment and 83 eligible for analyses. Heterogeneous neurocognitive impairments were found that were unaffected by bumetanide treatment. Network analysis showed higher modularity after treatment (mean difference:-0.165, 95%CI:-0.317 to - 0.013,p = .034) and changes in the relative importance of response inhibition in the neurocognitive network (mean difference:-0.037, 95%CI:-0.073 to - 0.001,p = .042). This study offers perspectives to include neurocognitive tests in ASD trials.

Predictive learning by a burst-dependent learning rule

Humans and other animals are able to quickly generalize latent dynamics of spatiotemporal sequences, often from a minimal number of previous experiences. Additionally, internal representations of external stimuli must remain stable, even in the presence of sensory noise, in order to be useful for informing behavior. In contrast, typical machine learning approaches require many thousands of samples, and generalize poorly to unexperienced examples, or fail completely to predict at long timescales. Here, we propose a novel neural network module which incorporates hierarchy and recurrent feedback terms, constituting a simplified model of neocortical microcircuits. This microcircuit predicts spatiotemporal trajectories at the input layer using a temporal error minimization algorithm. We show that this module is able to predict with higher accuracy into the future compared to traditional models. Investigating this model we find that successive predictive models learn representations which are increasingly removed from the raw sensory space, namely as successive temporal derivatives of the positional information. Next, we introduce a spiking neural network model which implements the rate-model through the use of a recently proposed biological learning rule utilizing dual-compartment neurons. We show that this network performs well on the same tasks as the mean-field models, by developing intrinsic dynamics that follow the dynamics of the external stimulus, while coordinating transmission of higher-order dynamics. Taken as a whole, these findings suggest that hierarchical temporal abstraction of sequences, rather than feed-forward reconstruction, may be responsible for the ability of neural systems to quickly adapt to novel situations.

Trainable Bilingual Synaptic Functions in Bio-enabled Synaptic Transistors

The signal transmission of the nervous system is regulated by neurotransmitters. Depending on the type of neurotransmitter released by presynaptic neurons, neuron cells can either be excited or inhibited. Maintaining a balance between excitatory and inhibitory synaptic responses is crucial for the nervous system's versatility, elasticity, and ability to perform parallel computing. On the way to mimic the brain's versatility and plasticity traits, creating a preprogrammed balance between excitatory and inhibitory responses is required. Despite substantial efforts to investigate the balancing of the nervous system, a complex circuit configuration has been suggested to simulate the interaction between excitatory and inhibitory synapses. As a meaningful approach, an optoelectronic synapse for balancing the excitatory and inhibitory responses assisted by light mediation is proposed here by deploying humidity-sensitive chiral nematic phases of known polysaccharide cellulose nanocrystals. The environment-induced pitch tuning changes the polarization of the helicoidal organization, affording different hysteresis effects with the subsequent excitatory and inhibitory nonvolatile behavior in the bio-electrolyte-gated transistors. By applying voltage pulses combined with stimulation of chiral light, the artificial optoelectronic synapse tunes not only synaptic functions but also learning pathways and color recognition. These multifunctional bio-based synaptic field-effect transistors exhibit potential for enhanced parallel neuromorphic computing and robot vision technology.

Are sleep disturbances a cause or consequence of autism spectrum disorder?

Autism spectrum disorder (ASD) is a neurodevelopmental disorder characterized by core symptoms such as atypical social communication, stereotyped behaviors, and restricted interests. One of the comorbid symptoms of individuals with ASD is sleep disturbance. There are two major hypotheses regarding the neural mechanism underlying ASD, i.e., the excitation/inhibition (E/I) imbalance and the altered neuroplasticity hypotheses. However, the pathology of ASD remains unclear due to inconsistent research results. This paper argues that sleep is a confounding factor, thus, must be considered when examining the pathology of ASD because sleep plays an important role in modulating the E/I balance and neuroplasticity in the human brain. Investigation of the E/I balance and neuroplasticity during sleep might enhance our understanding of the neural mechanisms of ASD. It may also lead to the development of neurobiologically informed interventions to supplement existing psychosocial therapies.

Distinctive properties of biological neural networks and recent advances in bottom-up approaches toward a better biologically plausible neural network

Although it may appear infeasible and impractical, building artificial intelligence (AI) using a bottom-up approach based on the understanding of neuroscience is straightforward. The lack of a generalized governing principle for biological neural networks (BNNs) forces us to address this problem by converting piecemeal information on the diverse features of neurons, synapses, and neural circuits into AI. In this review, we described recent attempts to build a biologically plausible neural network by following neuroscientifically similar strategies of neural network optimization or by implanting the outcome of the optimization, such as the properties of single computational units and the characteristics of the network architecture. In addition, we proposed a formalism of the relationship between the set of objectives that neural networks attempt to achieve, and neural network classes categorized by how closely their architectural features resemble those of BNN. This formalism is expected to define the potential roles of top-down and bottom-up approaches for building a biologically plausible neural network and offer a map helping the navigation of the gap between neuroscience and AI engineering.

A unifying perspective on neural manifolds and circuits for cognition

Two different perspectives have informed efforts to explain the link between the brain and behaviour. One approach seeks to identify neural circuit elements that carry out specific functions, emphasizing connectivity between neurons as a substrate for neural computations. Another approach centres on neural manifolds - low-dimensional representations of behavioural signals in neural population activity - and suggests that neural computations are realized by emergent dynamics. Although manifolds reveal an interpretable structure in heterogeneous neuronal activity, finding the corresponding structure in connectivity remains a challenge. We highlight examples in which establishing the correspondence between low-dimensional activity and connectivity has been possible, unifying the neural manifold and circuit perspectives. This relationship is conspicuous in systems in which the geometry of neural responses mirrors their spatial layout in the brain, such as the fly navigational system. Furthermore, we describe evidence that, in systems in which neural responses are heterogeneous, the circuit comprises interactions between activity patterns on the manifold via low-rank connectivity. We suggest that unifying the manifold and circuit approaches is important if we are to be able to causally test theories about the neural computations that underlie behaviour.

Biophysical parameters control signal transfer in spiking network

Introduction

Information transmission and representation in both natural and artificial networks is dependent on connectivity between units. Biological neurons, in addition, modulate synaptic dynamics and post-synaptic membrane properties, but how these relate to information transmission in a population of neurons is still poorly understood. A recent study investigated local learning rules and showed how a spiking neural network can learn to represent continuous signals. Our study builds on their model to explore how basic membrane properties and synaptic delays affect information transfer.

Methods

The system consisted of three input and output units and a hidden layer of 300 excitatory and 75 inhibitory leaky integrate-and-fire (LIF) or adaptive integrate-and-fire (AdEx) units. After optimizing the connectivity to accurately replicate the input patterns in the output units, we transformed the model to more biologically accurate units and included synaptic delay and concurrent action potential generation in distinct neurons. We examined three different parameter regimes which comprised either identical physiological values for both excitatory and inhibitory units (Comrade), more biologically accurate values (Bacon), or the Comrade regime whose output units were optimized for low reconstruction error (HiFi). We evaluated information transmission and classification accuracy of the network with four distinct metrics: coherence, Granger causality, transfer entropy, and reconstruction error.

Results

Biophysical parameters showed a major impact on information transfer metrics. The classification was surprisingly robust, surviving very low firing and information rates, whereas information transmission overall and particularly low reconstruction error were more dependent on higher firing rates in LIF units. In AdEx units, the firing rates were lower and less information was transferred, but interestingly the highest information transmission rates were no longer overlapping with the highest firing rates.

Discussion

Our findings can be reflected on the predictive coding theory of the cerebral cortex and may suggest information transfer qualities as a phenomenological quality of biological cells.

Predictive coding is a consequence of energy efficiency in recurrent neural networks

Predictive coding is a promising framework for understanding brain function. It postulates that the brain continuously inhibits predictable sensory input, ensuring preferential processing of surprising elements. A central aspect of this view is its hierarchical connectivity, involving recurrent message passing between excitatory bottom-up signals and inhibitory top-down feedback. Here we use computational modeling to demonstrate that such architectural hardwiring is not necessary. Rather, predictive coding is shown to emerge as a consequence of energy efficiency. When training recurrent neural networks to minimize their energy consumption while operating in predictive environments, the networks self-organize into prediction and error units with appropriate inhibitory and excitatory interconnections and learn to inhibit predictable sensory input. Moving beyond the view of purely top-down-driven predictions, we demonstrate, via virtual lesioning experiments, that networks perform predictions on two timescales: fast lateral predictions among sensory units and slower prediction cycles that integrate evidence over time.

Brain-inspired Predictive Coding Improves the Performance of Machine Challenging Tasks

Backpropagation has been regarded as the most favorable algorithm for training artificial neural networks. However, it has been criticized for its biological implausibility because its learning mechanism contradicts the human brain. Although backpropagation has achieved super-human performance in various machine learning applications, it often shows limited performance in specific tasks. We collectively referred to such tasks as machine-challenging tasks (MCTs) and aimed to investigate methods to enhance machine learning for MCTs. Specifically, we start with a natural question: Can a learning mechanism that mimics the human brain lead to the improvement of MCT performances? We hypothesized that a learning mechanism replicating the human brain is effective for tasks where machine intelligence is difficult. Multiple experiments corresponding to specific types of MCTs where machine intelligence has room to improve performance were performed using predictive coding, a more biologically plausible learning algorithm than backpropagation. This study regarded incremental learning, long-tailed, and few-shot recognition as representative MCTs. With extensive experiments, we examined the effectiveness of predictive coding that robustly outperformed backpropagation-trained networks for the MCTs. We demonstrated that predictive coding-based incremental learning alleviates the effect of catastrophic forgetting. Next, predictive coding-based learning mitigates the classification bias in long-tailed recognition. Finally, we verified that the network trained with predictive coding could correctly predict corresponding targets with few samples. We analyzed the experimental result by drawing analogies between the properties of predictive coding networks and those of the human brain and discussing the potential of predictive coding networks in general machine learning.

Neuroscience and Network Dynamics Toward Brain-Inspired Intelligence

This article surveys the interdisciplinary research of neuroscience, network science, and dynamic systems, with emphasis on the emergence of brain-inspired intelligence. To replicate brain intelligence, a practical way is to reconstruct cortical networks with dynamic activities that nourish the brain functions, instead of using only artificial computing networks. The survey provides a complex network and spatiotemporal dynamics (abbr. network dynamics) perspective for understanding the brain and cortical networks and, furthermore, develops integrated approaches of neuroscience and network dynamics toward building brain-inspired intelligence with learning and resilience functions. Presented are fundamental concepts and principles of complex networks, neuroscience, and hybrid dynamic systems, as well as relevant studies about the brain and intelligence. Other promising research directions, such as brain science, data science, quantum information science, and machine behavior are also briefly discussed toward future applications.

Drifting neuronal representations: Bug or feature?

The brain displays a remarkable ability to sustain stable memories, allowing animals to execute precise behaviors or recall stimulus associations years after they were first learned. Yet, recent long-term recording experiments have revealed that single-neuron representations continuously change over time, contravening the classical assumption that learned features remain static. How do unstable neural codes support robust perception, memories, and actions? Here, we review recent experimental evidence for such representational drift across brain areas, as well as dissections of its functional characteristics and underlying mechanisms. We emphasize theoretical proposals for how drift need not only be a form of noise for which the brain must compensate. Rather, it can emerge from computationally beneficial mechanisms in hierarchical networks performing robust probabilistic computations.

Allostasis, Action, and Affect in Depression: Insights from the Theory of Constructed Emotion

The theory of constructed emotion is a systems neuroscience approach to understanding the nature of emotion. It is also a general theoretical framework to guide hypothesis generation for how actions and experiences are constructed as the brain continually anticipates metabolic needs and attempts to meet those needs before they arise (termed allostasis). In this review, we introduce this framework and hypothesize that allostatic dysregulation is a trans-disorder vulnerability for mental and physical illness. We then review published findings consistent with the hypothesis that several symptoms in major depressive disorder (MDD), such as fatigue, distress, context insensitivity, reward insensitivity, and motor retardation, are associated with persistent problems in energy regulation. Our approach transforms the current understanding of MDD as resulting from enhanced emotional reactivity combined with reduced cognitive control and, in doing so, offers novel hypotheses regarding the development, progression, treatment, and prevention of MDD.

Merging pruning and neuroevolution: towards robust and efficient controllers for modular soft robots

Artificial neural networks (ANNs) can be employed as controllers for robotic agents. Their structure is often complex, with many neurons and connections, especially when the robots have many sensors and actuators distributed across their bodies and/or when high expressive power is desirable. Pruning (removing neurons or connections) reduces the complexity of the ANN, thus increasing its energy efficiency, and has been reported to improve the generalization capability, in some cases. In addition, it is well-known that pruning in biological neural networks plays a fundamental role in the development of brains and their ability to learn. In this study, we consider the evolutionary optimization of neural controllers for the case study of Voxel-based soft robots, a kind of modular, bio-inspired soft robots, applying pruning during fitness evaluation. For a locomotion task, and for centralized as well as distributed controllers, we experimentally characterize the effect of different forms of pruning on after-pruning effectiveness, life-long effectiveness, adaptability to new terrains, and behavior. We find that incorporating some forms of pruning in neuroevolution leads to almost equally effective controllers as those evolved without pruning, with the benefit of higher robustness to pruning. We also observe occasional improvements in generalization ability.

Efficient coding in the economics of human brain connectomics

In systems neuroscience, most models posit that brain regions communicate information under constraints of efficiency. Yet, evidence for efficient communication in structural brain networks characterized by hierarchical organization and highly connected hubs remains sparse. The principle of efficient coding proposes that the brain transmits maximal information in a metabolically economical or compressed form to improve future behavior. To determine how structural connectivity supports efficient coding, we develop a theory specifying minimum rates of message transmission between brain regions to achieve an expected fidelity, and we test five predictions from the theory based on random walk communication dynamics. In doing so, we introduce the metric of compression efficiency, which quantifies the trade-off between lossy compression and transmission fidelity in structural networks. In a large sample of youth (n = 1,042; age 8-23 years), we analyze structural networks derived from diffusion-weighted imaging and metabolic expenditure operationalized using cerebral blood flow. We show that structural networks strike compression efficiency trade-offs consistent with theoretical predictions. We find that compression efficiency prioritizes fidelity with development, heightens when metabolic resources and myelination guide communication, explains advantages of hierarchical organization, links higher input fidelity to disproportionate areal expansion, and shows that hubs integrate information by lossy compression. Lastly, compression efficiency is predictive of behavior-beyond the conventional network efficiency metric-for cognitive domains including executive function, memory, complex reasoning, and social cognition. Our findings elucidate how macroscale connectivity supports efficient coding and serve to foreground communication processes that utilize random walk dynamics constrained by network connectivity.

Supervised training of spiking neural networks for robust deployment on mixed-signal neuromorphic processors

Mixed-signal analog/digital circuits emulate spiking neurons and synapses with extremely high energy efficiency, an approach known as "neuromorphic engineering". However, analog circuits are sensitive to process-induced variation among transistors in a chip ("device mismatch"). For neuromorphic implementation of Spiking Neural Networks (SNNs), mismatch causes parameter variation between identically-configured neurons and synapses. Each chip exhibits a different distribution of neural parameters, causing deployed networks to respond differently between chips. Current solutions to mitigate mismatch based on per-chip calibration or on-chip learning entail increased design complexity, area and cost, making deployment of neuromorphic devices expensive and difficult. Here we present a supervised learning approach that produces SNNs with high robustness to mismatch and other common sources of noise. Our method trains SNNs to perform temporal classification tasks by mimicking a pre-trained dynamical system, using a local learning rule from non-linear control theory. We demonstrate our method on two tasks requiring temporal memory, and measure the robustness of our approach to several forms of noise and mismatch. We show that our approach is more robust than common alternatives for training SNNs. Our method provides robust deployment of pre-trained networks on mixed-signal neuromorphic hardware, without requiring per-device training or calibration.

A general principle of dendritic constancy: A neuron's size- and shape-invariant excitability

Reducing neuronal size results in less membrane and therefore lower input conductance. Smaller neurons are thus more excitable, as seen in their responses to somatic current injections. However, the impact of a neuron's size and shape on its voltage responses to dendritic synaptic activation is much less understood. Here we use analytical cable theory to predict voltage responses to distributed synaptic inputs in unbranched cables, showing that these are entirely independent of dendritic length. For a given synaptic density, neuronal responses depend only on the average dendritic diameter and intrinsic conductivity. This remains valid for a wide range of morphologies irrespective of their arborization complexity. Spiking models indicate that morphology-invariant numbers of spikes approximate the percentage of active synapses. In contrast to spike rate, spike times do depend on dendrite morphology. In summary, neuronal excitability in response to distributed synaptic inputs is largely unaffected by dendrite length or complexity.

Efficient and robust coding in heterogeneous recurrent networks

Cortical networks show a large heterogeneity of neuronal properties. However, traditional coding models have focused on homogeneous populations of excitatory and inhibitory neurons. Here, we analytically derive a class of recurrent networks of spiking neurons that close to optimally track a continuously varying input online, based on two assumptions: 1) every spike is decoded linearly and 2) the network aims to reduce the mean-squared error between the input and the estimate. From this we derive a class of predictive coding networks, that unifies encoding and decoding and in which we can investigate the difference between homogeneous networks and heterogeneous networks, in which each neurons represents different features and has different spike-generating properties. We find that in this framework, 'type 1' and 'type 2' neurons arise naturally and networks consisting of a heterogeneous population of different neuron types are both more efficient and more robust against correlated noise. We make two experimental predictions: 1) we predict that integrators show strong correlations with other integrators and resonators are correlated with resonators, whereas the correlations are much weaker between neurons with different coding properties and 2) that 'type 2' neurons are more coherent with the overall network activity than 'type 1' neurons.

Predictive learning as a network mechanism for extracting low-dimensional latent space representations

Artificial neural networks have recently achieved many successes in solving sequential processing and planning tasks. Their success is often ascribed to the emergence of the task’s low-dimensional latent structure in the network activity – i.e., in the learned neural representations. Here, we investigate the hypothesis that a means for generating representations with easily accessed low-dimensional latent structure, possibly reflecting an underlying semantic organization, is through learning to predict observations about the world. Specifically, we ask whether and when network mechanisms for sensory prediction coincide with those for extracting the underlying latent variables. Using a recurrent neural network model trained to predict a sequence of observations we show that network dynamics exhibit low-dimensional but nonlinearly transformed representations of sensory inputs that map the latent structure of the sensory environment. We quantify these results using nonlinear measures of intrinsic dimensionality and linear decodability of latent variables, and provide mathematical arguments for why such useful predictive representations emerge. We focus throughout on how our results can aid the analysis and interpretation of experimental data.

Neural networks trained using predictive models generate representations that recover the underlying low-dimensional latent structure in the data. Here, the authors demonstrate that a network trained on a spatial navigation task generates place-related neural activations similar to those observed in the hippocampus and show that these are related to the latent structure.

A Network Perspective on Sensorimotor Learning

What happens in the brain when we learn? Ever since the foundational work of Cajal, the field has made numerous discoveries as to how experience could change the structure and function of individual synapses. However, more recent advances have highlighted the need for understanding learning in terms of complex interactions between populations of neurons and synapses. How should one think about learning at such a macroscopic level? Here, we develop a conceptual framework to bridge the gap between the different scales at which learning operates, from synapses to neurons to behavior. Using this framework, we explore the principles that guide sensorimotor learning across these scales, and set the stage for future experimental and theoretical work in the field.

Poisson balanced spiking networks

An important problem in computational neuroscience is to understand how networks of spiking neurons can carry out various computations underlying behavior. Balanced spiking networks (BSNs) provide a powerful framework for implementing arbitrary linear dynamical systems in networks of integrate-and-fire neurons. However, the classic BSN model requires near-instantaneous transmission of spikes between neurons, which is biologically implausible. Introducing realistic synaptic delays leads to an pathological regime known as "ping-ponging", in which different populations spike maximally in alternating time bins, causing network output to overshoot the target solution. Here we document this phenomenon and provide a novel solution: we show that a network can have realistic synaptic delays while maintaining accuracy and stability if neurons are endowed with conditionally Poisson firing. Formally, we propose two alternate formulations of Poisson balanced spiking networks: (1) a "local" framework, which replaces the hard integrate-and-fire spiking rule within each neuron by a "soft" threshold function, such that firing probability grows as a smooth nonlinear function of membrane potential; and (2) a "population" framework, which reformulates the BSN objective function in terms of expected spike counts over the entire population. We show that both approaches offer improved robustness, allowing for accurate implementation of network dynamics with realistic synaptic delays between neurons. Both Poisson frameworks preserve the coding accuracy and robustness to neuron loss of the original model and, moreover, produce positive correlations between similarly tuned neurons, a feature of real neural populations that is not found in the deterministic BSN. This work unifies balanced spiking networks with Poisson generalized linear models and suggests several promising avenues for future research.

Unmasking inhibition prolongs neuronal function in retinal degeneration mouse model

All neurodegenerative diseases involve a relatively long period of timeframe from the onset of the disease to complete loss of functions. Extending this timeframe, even at a reduced level of function, would improve the quality of life of patients with these devastating diseases. The retina, as the part of the central nervous system and a frequent site of many distressing neurodegenerative disease, provides an ideal model to investigate the feasibility of extending the functional timeframe through pharmacologic intervention. Retinitis Pigmentosa (RP) is a group of blinding diseases. Although the rate of progression and degree of visual loss varies, there is usually a prolonged time before patients totally lose their photoreceptors and vision. It is believed that inhibitory mechanisms are still intact and may become relatively strong after the gradual loss of photoreceptors in RP patients. Therefore, it is possible that light-evoked responses of retinal ganglion cells and visual information processes in retinal circuits could be "unmasked" by blocking these inhibitory mechanisms restoring some level of visual function. Our results indicate that if the inhibition in the inner retina was unmasked in the retina of the rd10 mouse (the well-characterized RP mimicking, clinically relevant mouse model), the light-evoked responses of many retinal ganglion cells can be induced and restore their normal light sensitivity. GABA A receptor plays a major role in this masking inhibition. ERG b-wave and behavioral tests of spatial vision partly recovered after the application of PTX. Hence, removing retinal inhibition unmasks signalling mediated by surviving cones, thereby restoring some degree of visual function. These results may offer a novel strategy to restore the visual function with the surviving cones in RP patients and other gradual and progressive neurodegenerative diseases.

Distinguishing Epileptiform Discharges From Normal Electroencephalograms Using Adaptive Fractal and Network Analysis: A Clinical Perspective

Epilepsy is one of the most common disorders of the brain. Clinically, to corroborate an epileptic seizure-like symptom and to find the seizure localization, electroencephalogram (EEG) data are often visually examined by a clinical doctor to detect the presence of epileptiform discharges. Epileptiform discharges are transient waveforms lasting for several tens to hundreds of milliseconds and are mainly divided into seven types. It is important to develop systematic approaches to accurately distinguish these waveforms from normal control ones. This is a difficult task if one wishes to develop first principle rather than black-box based approaches, since clinically used scalp EEGs usually contain a lot of noise and artifacts. To solve this problem, we analyzed 640 multi-channel EEG segments, each 4s long. Among these segments, 540 are short epileptiform discharges, and 100 are from healthy controls. We have proposed two approaches for distinguishing epileptiform discharges from normal EEGs. The first method is based on Signal Range and EEGs' long range correlation properties characterized by the Hurst parameter H extracted by applying adaptive fractal analysis (AFA), which can also maximally suppress the effects of noise and various kinds of artifacts. Our second method is based on networks constructed from three aspects of the scalp EEG signals, the Signal Range, the energy of the alpha wave component, and EEG's long range correlation properties. The networks are further analyzed using singular value decomposition (SVD). The square of the first singular value from SVD is used to construct features to distinguish epileptiform discharges from normal controls. Using Random Forest Classifier (RF), our approaches can achieve very high accuracy in distinguishing epileptiform discharges from normal control ones, and thus are very promising to be used clinically. The network-based approach is also used to infer the localizations of each type of epileptiform discharges, and it is found that the sub-networks representing the most likely location of each type of epileptiform discharges are different among the seven types of epileptiform discharges.

Invertible generalized synchronization: A putative mechanism for implicit learning in neural systems

Regardless of the marked differences between biological and artificial neural systems, one fundamental similarity is that they are essentially dynamical systems that can learn to imitate other dynamical systems whose governing equations are unknown. The brain is able to learn the dynamic nature of the physical world via experience; analogously, artificial neural systems such as reservoir computing networks (RCNs) can learn the long-term behavior of complex dynamical systems from data. Recent work has shown that the mechanism of such learning in RCNs is invertible generalized synchronization (IGS). Yet, whether IGS is also the mechanism of learning in biological systems remains unclear. To shed light on this question, we draw inspiration from features of the human brain to propose a general and biologically feasible learning framework that utilizes IGS. To evaluate the framework's relevance, we construct several distinct neural network models as instantiations of the proposed framework. Regardless of their particularities, these neural network models can consistently learn to imitate other dynamical processes with a biologically feasible adaptation rule that modulates the strength of synapses. Further, we observe and theoretically explain the spontaneous emergence of four distinct phenomena reminiscent of cognitive functions: (i) learning multiple dynamics; (ii) switching among the imitations of multiple dynamical systems, either spontaneously or driven by external cues; (iii) filling-in missing variables from incomplete observations; and (iv) deciphering superimposed input from different dynamical systems. Collectively, our findings support the notion that biological neural networks can learn the dynamic nature of their environment through the mechanism of IGS.

Emergent Elements of Inspiratory Rhythmogenesis: Network Synchronization and Synchrony Propagation

We assessed the mechanism of mammalian breathing rhythmogenesis in the preBötzinger complex (preBötC) in vitro, where experimental tests remain inconsistent with hypotheses of canonical rhythmogenic cellular or synaptic mechanisms, i.e., pacemaker neurons or inhibition. Under rhythmic conditions, in each cycle, an inspiratory burst emerges as (presumptive) preBötC rhythmogenic neurons transition from aperiodic uncorrelated population spike activity to become increasingly synchronized during preinspiration (for ∼50-500 ms), which can trigger inspiratory bursts that propagate to motoneurons. In nonrhythmic conditions, antagonizing GABAA receptors can initiate this synchronization while inducing a higher conductance state in nonrhythmogenic preBötC output neurons. Our analyses uncover salient features of preBötC network dynamics where inspiratory bursts arise when and only when the preBötC rhythmogenic subpopulation strongly synchronizes to drive output neurons. Furthermore, downstream propagation of preBötC network activity, ultimately to motoneurons, is dependent on the strength of input synchrony onto preBötC output neurons exemplifying synchronous propagation of network activity.

Training Spiking Neural Networks for Cognitive Tasks: A Versatile Framework Compatible With Various Temporal Codes

Recent studies have demonstrated the effectiveness of supervised learning in spiking neural networks (SNNs). A trainable SNN provides a valuable tool not only for engineering applications but also for theoretical neuroscience studies. Here, we propose a modified SpikeProp learning algorithm, which ensures better learning stability for SNNs and provides more diverse network structures and coding schemes. Specifically, we designed a spike gradient threshold rule to solve the well-known gradient exploding problem in SNN training. In addition, regulation rules on firing rates and connection weights are proposed to control the network activity during training. Based on these rules, biologically realistic features such as lateral connections, complex synaptic dynamics, and sparse activities are included in the network to facilitate neural computation. We demonstrate the versatility of this framework by implementing three well-known temporal codes for different types of cognitive tasks, namely, handwritten digit recognition, spatial coordinate transformation, and motor sequence generation. Several important features observed in experimental studies, such as selective activity, excitatory-inhibitory balance, and weak pairwise correlation, emerged in the trained model. This agreement between experimental and computational results further confirmed the importance of these features in neural function. This work provides a new framework, in which various neural behaviors can be modeled and the underlying computational mechanisms can be studied.

Learning to represent signals spike by spike

Networks based on coordinated spike coding can encode information with high efficiency in the spike trains of individual neurons. These networks exhibit single-neuron variability and tuning curves as typically observed in cortex, but paradoxically coincide with a precise, non-redundant spike-based population code. However, it has remained unclear whether the specific synaptic connectivities required in these networks can be learnt with local learning rules. Here, we show how to learn the required architecture. Using coding efficiency as an objective, we derive spike-timing-dependent learning rules for a recurrent neural network, and we provide exact solutions for the networks’ convergence to an optimal state. As a result, we deduce an entire network from its input distribution and a firing cost. After learning, basic biophysical quantities such as voltages, firing thresholds, excitation, inhibition, or spikes acquire precise functional interpretations.

Spiking neural networks can encode information with high efficiency in the spike trains of individual neurons if the synaptic weights between neurons are set to specific, optimal values. In this regime, the networks exhibit irregular spike trains, high trial-to-trial variability, and stimulus tuning, as typically observed in cortex. The strong variability on the level of single neurons paradoxically coincides with a precise, non-redundant, and spike-based population code. However, it has remained unclear whether the specific synaptic connectivities required in these spiking networks can be learnt with local learning rules. In this study, we show how the required architecture can be learnt. We derive local and biophysically plausible learning rules for recurrent neural networks from first principles. We show both mathematically and using numerical simulations that these learning rules drive the networks into the optimal state, and we show that the optimal state is governed by the statistics of the input signals. After learning, the voltages of individual neurons can be interpreted as measuring the instantaneous error of the code, given by the error between the desired output signal and the actual output signal.

Supervised learning in spiking neural networks: A review of algorithms and evaluations

As a new brain-inspired computational model of the artificial neural network, a spiking neural network encodes and processes neural information through precisely timed spike trains. Spiking neural networks are composed of biologically plausible spiking neurons, which have become suitable tools for processing complex temporal or spatiotemporal information. However, because of their intricately discontinuous and implicit nonlinear mechanisms, the formulation of efficient supervised learning algorithms for spiking neural networks is difficult, and has become an important problem in this research field. This article presents a comprehensive review of supervised learning algorithms for spiking neural networks and evaluates them qualitatively and quantitatively. First, a comparison between spiking neural networks and traditional artificial neural networks is provided. The general framework and some related theories of supervised learning for spiking neural networks are then introduced. Furthermore, the state-of-the-art supervised learning algorithms in recent years are reviewed from the perspectives of applicability to spiking neural network architecture and the inherent mechanisms of supervised learning algorithms. A performance comparison of spike train learning of some representative algorithms is also made. In addition, we provide five qualitative performance evaluation criteria for supervised learning algorithms for spiking neural networks and further present a new taxonomy for supervised learning algorithms depending on these five performance evaluation criteria. Finally, some future research directions in this research field are outlined.

Multi-level anomalous Hall resistance in a single Hall cross for the applications of neuromorphic device

We demonstrate the process of obtaining memristive multi-states Hall resistance (R_H) change in a single Hall cross (SHC) structure. Otherwise, the working mechanism successfully mimics the behavior of biological neural systems. The motion of domain wall (DW) in the SHC was used to control the ascend (or descend) of the R_H amplitude. The primary synaptic functions such as long-term potentiation (LTP), long-term depression (LTD), and spike-time-dependent plasticity (STDP) could then be emulated by regulating R_H. Applied programmable magnetic field pulses are in varying conditions such as intensity and duration to adjust R_H. These results show that analog readings of DW movement can be closely resembled with the change of synaptic weight and have great potentials for bioinspired neuromorphic computing.

A roadmap to integrate astrocytes into Systems Neuroscience

Systems neuroscience is still mainly a neuronal field, despite the plethora of evidence supporting the fact that astrocytes modulate local neural circuits, networks, and complex behaviors. In this article, we sought to identify which types of studies are necessary to establish whether astrocytes, beyond their well-documented homeostatic and metabolic functions, perform computations implementing mathematical algorithms that sub-serve coding and higher-brain functions. First, we reviewed Systems-like studies that include astrocytes in order to identify computational operations that these cells may perform, using Ca2+ transients as their encoding language. The analysis suggests that astrocytes may carry out canonical computations in a time scale of subseconds to seconds in sensory processing, neuromodulation, brain state, memory formation, fear, and complex homeostatic reflexes. Next, we propose a list of actions to gain insight into the outstanding question of which variables are encoded by such computations. The application of statistical analyses based on machine learning, such as dimensionality reduction and decoding in the context of complex behaviors, combined with connectomics of astrocyte-neuronal circuits, is, in our view, fundamental undertakings. We also discuss technical and analytical approaches to study neuronal and astrocytic populations simultaneously, and the inclusion of astrocytes in advanced modeling of neural circuits, as well as in theories currently under exploration such as predictive coding and energy-efficient coding. Clarifying the relationship between astrocytic Ca2+ and brain coding may represent a leap forward toward novel approaches in the study of astrocytes in health and disease.

Daily Oscillation of the Excitation-Inhibition Balance in Visual Cortical Circuits

A balance between synaptic excitation and inhibition (E/I balance) maintained within a narrow window is widely regarded to be crucial for cortical processing. In line with this idea, the E/I balance is reportedly comparable across neighboring neurons, behavioral states, and developmental stages and altered in many neurological disorders. Motivated by these ideas, we examined whether synaptic inhibition changes over the 24-h day to compensate for the well-documented sleep-dependent changes in synaptic excitation. We found that, in pyramidal cells of visual and prefrontal cortices and hippocampal CA1, synaptic inhibition also changes over the 24-h light/dark cycle but, surprisingly, in the opposite direction of synaptic excitation. Inhibition is upregulated in the visual cortex during the light phase in a sleep-dependent manner. In the visual cortex, these changes in the E/I balance occurred in feedback, but not feedforward, circuits. These observations open new and interesting questions on the function and regulation of the E/I balance.

Reading-out task variables as a low-dimensional reconstruction of neural spike trains in single trials

We propose a new model of the read-out of spike trains that exploits the multivariate structure of responses of neural ensembles. Assuming the point of view of a read-out neuron that receives synaptic inputs from a population of projecting neurons, synaptic inputs are weighted with a heterogeneous set of weights. We propose that synaptic weights reflect the role of each neuron within the population for the computational task that the network has to solve. In our case, the computational task is discrimination of binary classes of stimuli, and weights are such as to maximize the discrimination capacity of the network. We compute synaptic weights as the feature weights of an optimal linear classifier. Once weights have been learned, they weight spike trains and allow to compute the post-synaptic current that modulates the spiking probability of the read-out unit in real time. We apply the model on parallel spike trains from V1 and V4 areas in the behaving monkey macaca mulatta, while the animal is engaged in a visual discrimination task with binary classes of stimuli. The read-out of spike trains with our model allows to discriminate the two classes of stimuli, while population PSTH entirely fails to do so. Splitting neurons in two subpopulations according to the sign of the weight, we show that population signals of the two functional subnetworks are negatively correlated. Disentangling the superficial, the middle and the deep layer of the cortex, we show that in both V1 and V4, superficial layers are the most important in discriminating binary classes of stimuli.

Mutual Inhibition with Few Inhibitory Cells via Nonlinear Inhibitory Synaptic Interaction

In computational neural network models, neurons are usually allowed to excite some and inhibit other neurons, depending on the weight of their synaptic connections. The traditional way to transform such networks into networks that obey Dale's law (i.e., a neuron can either excite or inhibit) is to accompany each excitatory neuron with an inhibitory one through which inhibitory signals are mediated. However, this requires an equal number of excitatory and inhibitory neurons, whereas a realistic number of inhibitory neurons is much smaller. In this letter, we propose a model of nonlinear interaction of inhibitory synapses on dendritic compartments of excitatory neurons that allows the excitatory neurons to mediate inhibitory signals through a subset of the inhibitory population. With this construction, the number of required inhibitory neurons can be reduced tremendously.

Temporal-specific complexity of spiking patterns in spontaneous activity induced by a dual complex network structure

Temporal fluctuation of neural activity in the brain has an important function in optimal information processing. Spontaneous activity is a source of such fluctuation. The distribution of excitatory postsynaptic potentials (EPSPs) between cortical pyramidal neurons can follow a log-normal distribution. Recent studies have shown that networks connected by weak synapses exhibit characteristics of a random network, whereas networks connected by strong synapses have small-world characteristics of small path lengths and large cluster coefficients. To investigate the relationship between temporal complexity spontaneous activity and structural network duality in synaptic connections, we executed a simulation study using the leaky integrate-and-fire spiking neural network with log-normal synaptic weight distribution for the EPSPs and duality of synaptic connectivity, depending on synaptic weight. We conducted multiscale entropy analysis of the temporal spiking activity. Our simulation demonstrated that, when strong synaptic connections approach a small-world network, specific spiking patterns arise during irregular spatio-temporal spiking activity, and the complexity at the large temporal scale (i.e., slow frequency) is enhanced. Moreover, we confirmed through a surrogate data analysis that slow temporal dynamics reflect a deterministic process in the spiking neural networks. This modelling approach may improve the understanding of the spatio-temporal complex neural activity in the brain.

Training dynamically balanced excitatory-inhibitory networks

The construction of biologically plausible models of neural circuits is crucial for understanding the computational properties of the nervous system. Constructing functional networks composed of separate excitatory and inhibitory neurons obeying Dale’s law presents a number of challenges. We show how a target-based approach, when combined with a fast online constrained optimization technique, is capable of building functional models of rate and spiking recurrent neural networks in which excitation and inhibition are balanced. Balanced networks can be trained to produce complicated temporal patterns and to solve input-output tasks while retaining biologically desirable features such as Dale’s law and response variability.

Pleiotropic Meta-Analysis of Cognition, Education, and Schizophrenia Differentiates Roles of Early Neurodevelopmental and Adult Synaptic Pathways

Susceptibility to schizophrenia is inversely correlated with general cognitive ability at both the phenotypic and the genetic level. Paradoxically, a modest but consistent positive genetic correlation has been reported between schizophrenia and educational attainment, despite the strong positive genetic correlation between cognitive ability and educational attainment. Here we leverage published genome-wide association studies (GWASs) in cognitive ability, education, and schizophrenia to parse biological mechanisms underlying these results. Association analysis based on subsets (ASSET), a pleiotropic meta-analytic technique, allowed jointly associated loci to be identified and characterized. Specifically, we identified subsets of variants associated in the expected ("concordant") direction across all three phenotypes (i.e., greater risk for schizophrenia, lower cognitive ability, and lower educational attainment); these were contrasted with variants that demonstrated the counterintuitive ("discordant") relationship between education and schizophrenia (i.e., greater risk for schizophrenia and higher educational attainment). ASSET analysis revealed 235 independent loci associated with cognitive ability, education, and/or schizophrenia at p < 5 × 10-8. Pleiotropic analysis successfully identified more than 100 loci that were not significant in the input GWASs. Many of these have been validated by larger, more recent single-phenotype GWASs. Leveraging the joint genetic correlations of cognitive ability, education, and schizophrenia, we were able to dissociate two distinct biological mechanisms-early neurodevelopmental pathways that characterize concordant allelic variation and adulthood synaptic pruning pathways-that were linked to the paradoxical positive genetic association between education and schizophrenia. Furthermore, genetic correlation analyses revealed that these mechanisms contribute not only to the etiopathogenesis of schizophrenia but also to the broader biological dimensions implicated in both general health outcomes and psychiatric illness.

The Neurobiology of Confidence: From Beliefs to Neurons

How confident are you? As humans, aware of our subjective sense of confidence, we can readily answer. Knowing your level of confidence helps to optimize both routine decisions such as whether to go back and check if the front door was locked and momentous ones like finding a partner for life. Yet the inherently subjective nature of confidence has limited investigations by neurobiologists. Here, we provide an overview of recent advances in this field and lay out a conceptual framework that lets us translate psychological questions about subjective confidence into the language of neuroscience. We show how statistical notions of confidence provide a bridge between our subjective sense of confidence and confidence-guided behaviors in nonhuman animals, thus enabling the study of the underlying neurobiology. We discuss confidence as a core cognitive process that enables organisms to optimize behavior such as learning or resource allocation and that serves as the basis of metacognitive reasoning. These approaches place confidence on a solid footing and pave the way for a mechanistic understanding of how the brain implements confidence-based algorithms to guide behavior.

Neuromodulatory Influences on Integration and Segregation in the Brain

Cognitive function relies on the dynamic cooperation of specialized regions of the brain; however, the elements of the system responsible for coordinating this interaction remain poorly understood. In this Opinion article I argue that this capacity is mediated in part by competitive and cooperative dynamic interactions between two prominent metabotropic neuromodulatory systems - the cholinergic basal forebrain and the noradrenergic locus coeruleus (LC). I assert that activity in these projection nuclei regulates the amount of segregation and integration within the whole brain network by modulating the activity of a diverse set of specialized regions of the brain on a timescale relevant for cognition and attention.