Estimating the Information Extracted by a Single Spiking Neuron from a Continuous Input Time Series

The tuning of tuning: How adaptation influences single cell information transfer

Sensory neurons reconstruct the world from action potentials (spikes) impinging on them. To effectively transfer information about the stimulus to the next processing level, a neuron needs to be able to adapt its working range to the properties of the stimulus. Here, we focus on the intrinsic neural properties that influence information transfer in cortical neurons and how tightly their properties need to be tuned to the stimulus statistics for them to be effective. We start by measuring the intrinsic information encoding properties of putative excitatory and inhibitory neurons in L2/3 of the mouse barrel cortex. Excitatory neurons show high thresholds and strong adaptation, making them fire sparsely and resulting in a strong compression of information, whereas inhibitory neurons that favour fast spiking transfer more information. Next, we turn to computational modelling and ask how two properties influence information transfer: 1) spike-frequency adaptation and 2) the shape of the IV-curve. We find that a subthreshold (but not threshold) adaptation, the 'h-current', and a properly tuned leak conductance can increase the information transfer of a neuron, whereas threshold adaptation can increase its working range. Finally, we verify the effect of the IV-curve slope in our experimental recordings and show that excitatory neurons form a more heterogeneous population than inhibitory neurons. These relationships between intrinsic neural features and neural coding that had not been quantified before will aid computational, theoretical and systems neuroscientists in understanding how neuronal populations can alter their coding properties, such as through the impact of neuromodulators. Why the variability of intrinsic properties of excitatory neurons is larger than that of inhibitory ones is an exciting question, for which future research is needed.

Revisiting neural information, computing and linking capacity

Neural information theory represents a fundamental method to model dynamic relations in biological systems. However, the notion of information, its representation, its content and how it is processed are the subject of fierce debates. Since the limiting capacity of neuronal links strongly depends on how neurons are hypothesized to work, their operating modes are revisited by analyzing the differences between the results of the communication models published during the past seven decades and those of the recently developed generalization of the classical information theory. It is pointed out that the operating mode of neurons is in resemblance with an appropriate combination of the formerly hypothesized analog and digital working modes; furthermore that not only the notion of neural information and its processing must be reinterpreted. Given that the transmission channel is passive in Shannon's model, the active role of the transfer channels (the axons) may introduce further transmission limits in addition to the limits concluded from the information theory. The time-aware operating model enables us to explain why (depending on the researcher's point of view) the operation can be considered either purely analog or purely digital.

Neural Information Processing and Computations of Two-Input Synapses

Information processing in artificial neural networks is largely dependent on the nature of neuron models. While commonly used models are designed for linear integration of synaptic inputs, accumulating experimental evidence suggests that biological neurons are capable of nonlinear computations for many converging synaptic inputs via homo- and heterosynaptic mechanisms. This nonlinear neuronal computation may play an important role in complex information processing at the neural circuit level. Here we characterize the dynamics and coding properties of neuron models on synaptic transmissions delivered from two hidden states. The neuronal information processing is influenced by the cooperative and competitive interactions among synapses and the coherence of the hidden states. Furthermore, we demonstrate that neuronal information processing under two-input synaptic transmission can be mapped to linearly nonseparable XOR as well as basic AND/OR operations. In particular, the mixtures of linear and nonlinear neuron models outperform the fashion-MNIST test compared to the neural networks consisting of only one type. This study provides a computational framework for assessing information processing of neuron and synapse models that may be beneficial for the design of brain-inspired artificial intelligence algorithms and neuromorphic systems.

Towards Generalizing the Information Theory for Neural Communication

Neuroscience extensively uses the information theory to describe neural communication, among others, to calculate the amount of information transferred in neural communication and to attempt the cracking of its coding. There are fierce debates on how information is represented in the brain and during transmission inside the brain. The neural information theory attempts to use the assumptions of electronic communication; despite the experimental evidence that the neural spikes carry information on non-discrete states, they have shallow communication speed, and the spikes' timing precision matters. Furthermore, in biology, the communication channel is active, which enforces an additional power bandwidth limitation to the neural information transfer. The paper revises the notions needed to describe information transfer in technical and biological communication systems. It argues that biology uses Shannon's idea outside of its range of validity and introduces an adequate interpretation of information. In addition, the presented time-aware approach to the information theory reveals pieces of evidence for the role of processes (as opposed to states) in neural operations. The generalized information theory describes both kinds of communication, and the classic theory is the particular case of the generalized theory.

A databank for intracellular electrophysiological mapping of the adult somatosensory cortex

Background

Neurons in the supragranular layers of the somatosensory cortex integrate sensory (bottom-up) and cognitive/perceptual (top-down) information as they orchestrate communication across cortical columns. It has been inferred, based on intracellular recordings from juvenile animals, that supragranular neurons are electrically mature by the fourth postnatal week. However, the dynamics of the neuronal integration in adulthood is largely unknown. Electrophysiological characterization of the active properties of these neurons throughout adulthood will help to address the biophysical and computational principles of the neuronal integration.

Findings

Here, we provide a database of whole-cell intracellular recordings from 315 neurons located in the supragranular layers (L2/3) of the primary somatosensory cortex in adult mice (9–45 weeks old) from both sexes (females, N = 195; males, N = 120). Data include 361 somatic current-clamp (CC) and 476 voltage-clamp (VC) experiments, recorded using a step-and-hold protocol (CC, N = 257; VC, N = 46), frozen noise injections (CC, N = 104) and triangular voltage sweeps (VC, 10 (N = 132), 50 (N = 146) and 100 ms (N = 152)), from regular spiking (N = 169) and fast-spiking neurons (N = 66).

Conclusions

The data can be used to systematically study the properties of somatic integration and the principles of action potential generation across sexes and across electrically characterized neuronal classes in adulthood. Understanding the principles of the somatic transformation of postsynaptic potentials into action potentials will shed light onto the computational principles of intracellular information transfer in single neurons and information processing in neuronal networks, helping to recreate neuronal functions in artificial systems.

Neural coding: A single neuron's perspective

What any sensory neuron knows about the world is one of the cardinal questions in Neuroscience. Information from the sensory periphery travels across synaptically coupled neurons as each neuron encodes information by varying the rate and timing of its action potentials (spikes). Spatiotemporally correlated changes in this spiking regimen across neuronal populations are the neural basis of sensory representations. In the somatosensory cortex, however, spiking of individual (or pairs of) cortical neurons is only minimally informative about the world. Recent studies showed that one solution neurons implement to counteract this information loss is adapting their rate of information transfer to the ongoing synaptic activity by changing the membrane potential at which spike is generated. Here we first introduce the principles of information flow from the sensory periphery to the primary sensory cortex in a model sensory (whisker) system, and subsequently discuss how the adaptive spike threshold gates the intracellular information transfer from the somatic post-synaptic potential to action potentials, controlling the information content of communication across somatosensory cortical neurons.

A new approach to detect the coding rule of the cortical spiking model in the information transmission

Investigation of the role of the local field potential (LFP) fluctuations in encoding the received sensory information by the nervous system remains largely unknown. On the other hand, transmission of these translation rules in information transmission between the structure of sensory stimuli and the cortical oscillations to the bio-inspired artificial neural networks operating at the efficiency of the nervous system is still a vague puzzle. In order to move towards this important goal, computational neuroscience tools can be useful so, we simulated a large-scale network of excitatory and inhibitory spiking neurons with synaptic connections consisting of AMPA and GABA currents as a model of cortical populations. Spiking network was equipped with spike-based unsupervised weight optimization based on the dynamical behavior of the excitatory (AMPA) and inhibitory (GABA) synapses using Spike Timing Dependent Plasticity (STDP) on the MNIST benchmark and we specified how the generated LFP by the network contained information about input patterns. The main result of this article is that the calculated coefficients of Prolate spheroidal wave functions (PSWF) from the input pattern with mean square error (MSE) criterion and power spectrum of LFP with maximum correntropy criterion (MCC) are equal. The more important result is that 82.3% of PSWF coefficients are the same as the connecting weights of the cortical neurons to the classifying neurons after the completion of the training process. Higher compliance percentage of coefficients with synaptic weights (82.3%) gives the expectance us that this coding rule will be able to extend to biological systems. Eventually, we introduced the cortical spiking network as an information channel, which transmits the information of the input pattern in the form of PSWF coefficients to the power spectrum of the output generated LFP.