Optimal noise level for coding with tightly balanced networks of spiking neurons in the presence of transmission delays

Cerebellar output shapes cortical preparatory activity during motor adaptation

The cerebellum plays a key role in motor adaptation by driving trial-to-trial recalibration of movements based on previous errors. In primates, cortical correlates of adaptation are encoded already in the pre-movement motor plan, but these early cortical signals could be driven by a cerebellar-to-cortical information flow or evolve independently through intracortical mechanisms. To address this question, we trained female macaque monkeys to reach against a viscous force field (FF) while blocking cerebellar outflow. The cerebellar block led to impaired FF adaptation and a compensatory, re-aiming-like shift in motor cortical preparatory activity. In the null-field conditions, the cerebellar block altered neural preparatory activity by increasing task-representation dimensionality and impeding generalization. A computational model indicated that low-dimensional (cerebellar-like) feedback is sufficient to replicate these findings. We conclude that cerebellar signals carry task structure information that constrains the dimensionality of the cortical preparatory manifold and promotes generalization. In the absence of these signals, cortical mechanisms are harnessed to partially restore adaptation.

Efficient coding in biophysically realistic excitatory-inhibitory spiking networks

The principle of efficient coding posits that sensory cortical networks are designed to encode maximal sensory information with minimal metabolic cost. Despite the major influence of efficient coding in neuroscience, it has remained unclear whether fundamental empirical properties of neural network activity can be explained solely based on this normative principle. Here, we derive the structural, coding, and biophysical properties of excitatory-inhibitory recurrent networks of spiking neurons that emerge directly from imposing that the network minimizes an instantaneous loss function and a time-averaged performance measure enacting efficient coding. We assumed that the network encodes a number of independent stimulus features varying with a time scale equal to the membrane time constant of excitatory and inhibitory neurons. The optimal network has biologically plausible biophysical features, including realistic integrate-and-fire spiking dynamics, spike-triggered adaptation, and a non-specific excitatory external input. The excitatory-inhibitory recurrent connectivity between neurons with similar stimulus tuning implements feature-specific competition, similar to that recently found in visual cortex. Networks with unstructured connectivity cannot reach comparable levels of coding efficiency. The optimal ratio of excitatory vs inhibitory neurons and the ratio of mean inhibitory-to-inhibitory vs excitatory-to-inhibitory connectivity are comparable to those of cortical sensory networks. The efficient network solution exhibits an instantaneous balance between excitation and inhibition. The network can perform efficient coding even when external stimuli vary over multiple time scales. Together, these results suggest that key properties of biological neural networks may be accounted for by efficient coding.

Cerebellar output shapes cortical preparatory activity during motor adaptation

The cerebellum plays a key role in motor adaptation by driving trial-to-trial recalibration of movements based on previous errors. In primates, cortical correlates of adaptation are encoded already in the pre-movement motor plan, but these early cortical signals could be driven by a cerebellar-to-cortical information flow or evolve independently through intracortical mechanisms. To address this question, we trained female macaque monkeys to reach against a viscous force field (FF) while blocking cerebellar outflow. The cerebellar block led to impaired FF adaptation and a compensatory, re-aiming-like shift in motor cortical preparatory activity. In the null-field conditions, the cerebellar block altered neural preparatory activity by increasing task-representation dimensionality and impeding generalization. A computational model indicated that low-dimensional (cerebellar-like) feedback is sufficient to replicate these findings. We conclude that cerebellar signals carry task structure information that constrains the dimensionality of the cortical preparatory manifold and promotes generalization. In the absence of these signals, cortical mechanisms are harnessed to partially restore adaptation.

Signatures of criticality in efficient coding networks

The critical brain hypothesis states that the brain can benefit from operating close to a second-order phase transition. While it has been shown that several computational aspects of sensory processing (e.g., sensitivity to input) can be optimal in this regime, it is still unclear whether these computational benefits of criticality can be leveraged by neural systems performing behaviorally relevant computations. To address this question, we investigate signatures of criticality in networks optimized to perform efficient coding. We consider a spike-coding network of leaky integrate-and-fire neurons with synaptic transmission delays. Previously, it was shown that the performance of such networks varies nonmonotonically with the noise amplitude. Interestingly, we find that in the vicinity of the optimal noise level for efficient coding, the network dynamics exhibit some signatures of criticality, namely, scale-free dynamics of the spiking and the presence of crackling noise relation. Our work suggests that two influential, and previously disparate theories of neural processing optimization (efficient coding and criticality) may be intimately related.

DenRAM: neuromorphic dendritic architecture with RRAM for efficient temporal processing with delays

An increasing number of studies are highlighting the importance of spatial dendritic branching in pyramidal neurons in the neocortex for supporting non-linear computation through localized synaptic integration. In particular, dendritic branches play a key role in temporal signal processing and feature detection. This is accomplished thanks to coincidence detection (CD) mechanisms enabled by the presence of synaptic delays that align temporally disparate inputs for effective integration. Computational studies on spiking neural networks further highlight the significance of delays for achieving spatio-temporal pattern recognition with pure feed-forward neural networks, without the need of resorting to recurrent architectures. In this work, we present "DenRAM", the first realization of a feed-forward spiking neural network with dendritic compartments, implemented using analog electronic circuits integrated into a 130 nm technology node and coupled with Resistive Random Access Memory (RRAM) technology. DenRAM's dendritic circuits use RRAM devices to implement both delays and synaptic weights in the network. By configuring the RRAM devices to reproduce bio-realistic timescales, and by exploiting their heterogeneity we experimentally demonstrate DenRAM's ability to replicate synaptic delay profiles, and to efficiently implement CD for spatio-temporal pattern recognition. To validate the architecture, we conduct comprehensive system-level simulations on two representative temporal benchmarks, demonstrating DenRAM's resilience to analog hardware noise, and its superior accuracy compared to recurrent architectures with an equivalent number of parameters. DenRAM not only brings rich temporal processing capabilities to neuromorphic architectures, but also reduces the memory footprint of edge devices, warrants high accuracy on temporal benchmarks, and represents a significant step-forward in low-power real-time signal processing technologies.

Establishing brain states in neuroimaging data

The definition of a brain state remains elusive, with varying interpretations across different sub-fields of neuroscience-from the level of wakefulness in anaesthesia, to activity of individual neurons, voltage in EEG, and blood flow in fMRI. This lack of consensus presents a significant challenge to the development of accurate models of neural dynamics. However, at the foundation of dynamical systems theory lies a definition of what constitutes the 'state' of a system-i.e., a specification of the system's future. Here, we propose to adopt this definition to establish brain states in neuroimaging timeseries by applying Dynamic Causal Modelling (DCM) to low-dimensional embedding of resting and task condition fMRI data. We find that ~90% of subjects in resting conditions are better described by first-order models, whereas ~55% of subjects in task conditions are better described by second-order models. Our work calls into question the status quo of using first-order equations almost exclusively within computational neuroscience and provides a new way of establishing brain states, as well as their associated phase space representations, in neuroimaging datasets.