Modeling of neural systems by use of neuronal modes

Spike Prediction on Primary Motor Cortex from Medial Prefrontal Cortex during Task Learning

OBJECTIVES

Brain-machine interfaces (BMIs) aim to help people with motor disabilities by interpreting brain signals into motor intentions using advanced signal processing methods. Currently, BMI users require intensive training to perform a pre-defined task, not to mention learning a new task. Thus, it is essential to understand neural information pathways among the cortical areas in task learning to provide principles for designing BMIs with learning abilities. We propose to investigate the relationship between the medial prefrontal cortex (mPFC) and primary motor cortex (M1), which are actively involved in motor control and task learning, and show how information is conveyed in spikes between the two regions on a single-trial basis by computational models.

APPROACH

We are interested in modeling the functional relationship between mPFC and M1 activities during task learning. Six Sprague Dawley rats were trained to learn a new behavioral task. Neural spike data was recorded from mPFC and M1 during learning. We then implement the generalized linear model, the second-order generalized Laguerre-Volterra model, and the staged point-process model to predict M1 spikes from mPFC spikes across multiple days during task learning. The prediction performance is compared across different models or learning stages to reveal the relationship between mPFC and M1 spike activities.

MAIN RESULTS

We find that M1 neural spikes can be well predicted from mPFC spikes on the single-trial level, which indicates a highly correlated relationship between mPFC and M1 activities during task learning. By comparing the performance across models, we find that models with higher nonlinear capacity perform significantly better than linear models. This indicates that predicting M1 activity from mPFC activity requires the model to consider higher-order nonlinear interactions beyond pairwise interactions. We also find that the correlation coefficient between the mPFC and M1 spikes increases during task learning. The spike prediction models perform the best when the subjects become well trained on the new task compared with the early and middle stages. The results suggest that the co-activation between mPFC and M1 activities evolves during task learning, and becomes stronger as subjects become well trained.

SIGNIFICANCE

This study demonstrates that the dynamic patterns of M1 spikes can be predicted from mPFC spikes during task learning, and this will further help in the design of adaptive BMI decoders for task learning.

A Double-Layer Multi-Resolution Classification Model for Decoding Spatiotemporal Patterns of Spikes With Small Sample Size

We build a double-layer, multiple temporal-resolution classification model for decoding single-trial spatiotemporal patterns of spikes. The model takes spiking activities as input signals and binary behavioral or cognitive variables as output signals and represents the input-output mapping with a double-layer ensemble classifier. In the first layer, to solve the underdetermined problem caused by the small sample size and the very high dimensionality of input signals, B-spline functional expansion and L1-regularized logistic classifiers are used to reduce dimensionality and yield sparse model estimations. A wide range of temporal resolutions of neural features is included by using a large number of classifiers with different numbers of B-spline knots. Each classifier serves as a base learner to classify spatiotemporal patterns into the probability of the output label with a single temporal resolution. A bootstrap aggregating strategy is used to reduce the estimation variances of these classifiers. In the second layer, another L1-regularized logistic classifier takes outputs of first-layer classifiers as inputs to generate the final output predictions. This classifier serves as a meta-learner that fuses multiple temporal resolutions to classify spatiotemporal patterns of spikes into binary output labels. We test this decoding model with both synthetic and experimental data recorded from rats and human subjects performing memory-dependent behavioral tasks. Results show that this method can effectively avoid overfitting and yield accurate prediction of output labels with small sample size. The double-layer, multi-resolution classifier consistently outperforms the best single-layer, single-resolution classifier by extracting and utilizing multi-resolution spatiotemporal features of spike patterns in the classification.

Distinct Manifestations of Cooperative, Multidimensional Stimulus Representations in Different Auditory Forebrain Stations

Classic spectrotemporal receptive fields (STRFs) for auditory neurons are usually expressed as a single linear filter representing a single encoded stimulus feature. Multifilter STRF models represent the stimulus-response relationship of primary auditory cortex (A1) neurons more accurately because they can capture multiple stimulus features. To determine whether multifilter processing is unique to A1, we compared the utility of single-filter versus multifilter STRF models in the medial geniculate body (MGB), anterior auditory field (AAF), and A1 of ketamine-anesthetized cats. We estimated STRFs using both spike-triggered average (STA) and maximally informative dimension (MID) methods. Comparison of basic filter properties of first maximally informative dimension (MID1) and second maximally informative dimension (MID2) in the 3 stations revealed broader spectral integration of MID2s in MGBv and A1 as opposed to AAF. MID2 peak latency was substantially longer than for STAs and MID1s in all 3 stations. The 2-filter MID model captured more information and yielded better predictions in many neurons from all 3 areas but disproportionately more so in AAF and A1 compared with MGBv. Significantly, information-enhancing cooperation between the 2 MIDs was largely restricted to A1 neurons. This demonstrates significant differences in how these 3 forebrain stations process auditory information, as expressed in effective and synergistic multifilter processing.

Multi-Input, Multi-Output Neuronal Mode Network Approach to Modeling the Encoding Dynamics and Functional Connectivity of Neural Systems

This letter proposes a novel method, multi-input, multi-output neuronal mode network (MIMO-NMN), for modeling encoding dynamics and functional connectivity in neural ensembles such as the hippocampus. Compared with conventional approaches such as the Volterra-Wiener model, linear-nonlinear-cascade (LNC) model, and generalized linear model (GLM), the NMN has several advantages in terms of estimation accuracy, model interpretation, and functional connectivity analysis. We point out the limitations of current neural spike modeling methods, especially the estimation biases caused by the imbalanced class problem when the number of zeros is significantly larger than ones in the spike data. We use synthetic data to test the performance of NMN with a comparison of the traditional methods, and the results indicate the NMN approach could reduce the imbalanced class problem and achieve better predictions. Subsequently, we apply the MIMO-NMN method to analyze data from the human hippocampus. The results indicate that the MIMO-NMN method is a promising approach to modeling neural dynamics and analyzing functional connectivity of multi-neuronal data.

Mechanism-Based and Input-Output Modeling of the Key Neuronal Connections and Signal Transformations in the CA3-CA1 Regions of the Hippocampus

This letter examines the results of input-output (nonparametric) modeling based on the analysis of data generated by a mechanism-based (parametric) model of CA3-CA1 neuronal connections in the hippocampus. The motivation is to obtain biological insight into the interpretation of such input-output (Volterra-equivalent) models estimated from synthetic data. The insights obtained may be subsequently used to interpretat input-output models extracted from actual experimental data. Specifically, we found that a simplified parametric model may serve as a useful tool to study the signal transformations in the hippocampal CA3-CA1 regions. Input-output modeling of model-based synthetic data show that GABAergic interneurons are responsible for regulating neuronal excitation, controlling the precision of spike timing, and maintaining network oscillations, in a manner consistent with previous studies. The input-output model obtained from real data exhibits intriguing similarities with its synthetic-data counterpart, demonstrating the importance of a dynamic resonance in the system/model response around 2 Hz to 3 Hz. Using the input-output model from real data as a guide, we may be able to amend the parametric model by incorporating more mechanisms in order to yield better-matching input-output model. The approach we present can also be applied to the study of other neural systems and pathways.

Reconstruction of neural network topology using spike train data: Small-world features of hippocampal network

As the amount of experimental data made publicly accessible has gradually increased in recent years, it is now possible to reconsider many of the longstanding questions in neuroscience. In this paper, we present an efficient frame-work for reconstructing the functional connectivity from the spike train data curated from the Collaborative Research in Computational Neuroscience (CRCNS) program. We used a modified generalized linear model (GLM) framework with L1 norm penalty to investigate 10 datasets. These datasets contain spike train data collected from the hippocampal region of rats performing various tasks. Analysis of the reconstructed network showed that the neural network in the hippocampal region of well-trained rats demonstrated significant small-world features.

A cognitive prosthesis for memory facilitation by closed-loop functional ensemble stimulation of hippocampal neurons in primate brain

Very productive collaborative investigations characterized how multineuron hippocampal ensembles recorded in nonhuman primates (NHPs) encode short-term memory necessary for successful performance in a delayed match to sample (DMS) task and utilized that information to devise a unique nonlinear multi-input multi-output (MIMO) memory prosthesis device to enhance short-term memory in real-time during task performance. Investigations have characterized how the hippocampus in primate brain encodes information in a multi-item, rule-controlled, delayed match to sample (DMS) task. The MIMO model was applied via closed loop feedback micro-current stimulation during the task via conformal electrode arrays and enhanced performance of the complex memory requirements. These findings clearly indicate detection of a means by which the hippocampus encodes information and transmits this information to other brain regions involved in memory processing. By employing the nonlinear dynamic multi-input/multi-output (MIMO) model, developed and adapted to hippocampal neural ensemble firing patterns derived from simultaneous recorded multi-neuron CA1 and CA3 activity, it was possible to extract information encoded in the Sample phase of DMS trials that was necessary for successful performance in the subsequent Match phase of the task. The extension of this MIMO model to online delivery of electrical stimulation patterns to the same recording loci that exhibited successful CA1 firing in the DMS Sample Phase provided the means to increase task performance on a trial-by-trial basis. Increased utility of the MIMO model as a memory prosthesis was exhibited by the demonstration of cumulative increases in DMS task performance with repeated MIMO stimulation over many sessions. These results, reported below in this article, provide the necessary demonstrations to further the feasibility of the MIMO model as a memory prosthesis to recover and/or enhance encoding of cognitive information in humans with memory disruptions resulting from brain injury, disease or aging.

An Asynchronous Recurrent Network of Cellular Automaton-Based Neurons and Its Reproduction of Spiking Neural Network Activities

Modeling and implementation approaches for the reproduction of input-output relationships in biological nervous tissues contribute to the development of engineering and clinical applications. However, because of high nonlinearity, the traditional modeling and implementation approaches encounter difficulties in terms of generalization ability (i.e., performance when reproducing an unknown data set) and computational resources (i.e., computation time and circuit elements). To overcome these difficulties, asynchronous cellular automaton-based neuron (ACAN) models, which are described as special kinds of cellular automata that can be implemented as small asynchronous sequential logic circuits have been proposed. This paper presents a novel type of such ACAN and a theoretical analysis of its excitability. This paper also presents a novel network of such neurons, which can mimic input-output relationships of biological and nonlinear ordinary differential equation model neural networks. Numerical analyses confirm that the presented network has a higher generalization ability than other major modeling and implementation approaches. In addition, Field-Programmable Gate Array-implementations confirm that the presented network requires lower computational resources.

Evaluating the Small-World-Ness of a Sampled Network: Functional Connectivity of Entorhinal-Hippocampal Circuitry

The amount of publicly accessible experimental data has gradually increased in recent years, which makes it possible to reconsider many longstanding questions in neuroscience. In this paper, an efficient framework is presented for reconstructing functional connectivity using experimental spike-train data. A modified generalized linear model (GLM) with L1-norm penalty was used to investigate 10 datasets. These datasets contain spike-train data collected from the entorhinal-hippocampal region in the brains of rats performing different tasks. The analysis shows that entorhinal-hippocampal network of well-trained rats demonstrated significant small-world features. It is found that the connectivity structure generated by distance-dependent models is responsible for the observed small-world features of the reconstructed networks. The models are utilized to simulate a subset of units recorded from a large biological neural network using multiple electrodes. Two metrics for quantifying the small-world-ness both suggest that the reconstructed network from the sampled nodes estimates a more prominent small-world-ness feature than that of the original unknown network when the number of recorded neurons is small. Finally, this study shows that it is feasible to adjust the estimated small-world-ness results based on the number of neurons recorded to provide a more accurate reference of the network property.

Understanding spike-triggered covariance using Wiener theory for receptive field identification

Receptive field identification is a vital problem in sensory neurophysiology and vision. Much research has been done in identifying the receptive fields of nonlinear neurons whose firing rate is determined by the nonlinear interactions of a small number of linear filters. Despite more advanced methods that have been proposed, spike-triggered covariance (STC) continues to be the most widely used method in such situations due to its simplicity and intuitiveness. Although the connection between STC and Wiener/Volterra kernels has often been mentioned in the literature, this relationship has never been explicitly derived. Here we derive this relationship and show that the STC matrix is actually a modified version of the second-order Wiener kernel, which incorporates the input autocorrelation and mixes first- and second-order dynamics. It is then shown how, with little modification of the STC method, the Wiener kernels may be obtained and, from them, the principal dynamic modes, a set of compact and efficient linear filters that essentially combine the spike-triggered average and STC matrix and generalize to systems with both continuous and point-process outputs. Finally, using Wiener theory, we show how these obtained filters may be corrected when they were estimated using correlated inputs. Our correction technique is shown to be superior to those commonly used in the literature for both correlated Gaussian images and natural images.

System identification of point-process neural systems using probability based Volterra kernels

BACKGROUND

Neural information processing involves a series of nonlinear dynamical input/output transformations between the spike trains of neurons/neuronal ensembles. Understanding and quantifying these transformations is critical both for understanding neural physiology such as short-term potentiation and for developing cognitive neural prosthetics.

NEW METHOD

A novel method for estimating Volterra kernels for systems with point-process inputs and outputs is developed based on elementary probability theory. These Probability Based Volterra (PBV) kernels essentially describe the probability of an output spike given q input spikes at various lags t1, t2, …, tq.

RESULTS

The PBV kernels are used to estimate both synthetic systems where ground truth is available and data from the CA3 and CA1 regions rodent hippocampus. The PBV kernels give excellent predictive results in both cases. Furthermore, they are shown to be quite robust to noise and to have good convergence and overfitting properties. Through a slight modification, the PBV kernels are shown to also deal well with correlated point-process inputs.

COMPARISON WITH EXISTING METHODS

The PBV kernels were compared with kernels estimated through least squares estimation (LSE) and through the Laguerre expansion technique (LET). The LSE kernels were shown to fair very poorly with real data due to the large amount of input noise. Although the LET kernels gave the best predictive results in all cases, they require prior parameter estimation. It was shown how the PBV and LET methods can be combined synergistically to maximize performance.

CONCLUSIONS

The PBV kernels provide a novel and intuitive method of characterizing point-process input-output nonlinear systems.

Model-based asessment of an in-vivo predictive relationship from CA1 to CA3 in the rodent hippocampus

Although an anatomical connection from CA1 to CA3 via the Entorhinal Cortex (EC) and through backprojecting interneurons has long been known it exist, it has never been examined quantitatively on the single neuron level, in the in-vivo nonpatholgical, nonperturbed brain. Here, single spike activity was recorded using a multi-electrode array from the CA3 and CA1 areas of the rodent hippocampus (N = 7) during a behavioral task. The predictive power from CA3→CA1 and CA1→CA3 was examined by constructing Multivariate Autoregressive (MVAR) models from recorded neurons in both directions. All nonsignificant inputs and models were identified and removed by means of Monte Carlo simulation methods. It was found that 121/166 (73 %) CA3→CA1 models and 96/145 (66 %) CA1→CA3 models had significant predictive power, thus confirming a predictive 'Granger' causal relationship from CA1 to CA3. This relationship is thought to be caused by a combination of truly causal connections such as the CA1→EC→CA3 pathway and common inputs such as those from the Septum. All MVAR models were then examined in the frequency domain and it was found that CA3 kernels had significantly more power in the theta and beta range than those of CA1, confirming CA3's role as an endogenous hippocampal pacemaker.

On parsing the neural code in the prefrontal cortex of primates using principal dynamic modes

Nonlinear modeling of multi-input multi-output (MIMO) neuronal systems using Principal Dynamic Modes (PDMs) provides a novel method for analyzing the functional connectivity between neuronal groups. This paper presents the PDM-based modeling methodology and initial results from actual multi-unit recordings in the prefrontal cortex of non-human primates. We used the PDMs to analyze the dynamic transformations of spike train activity from Layer 2 (input) to Layer 5 (output) of the prefrontal cortex in primates performing a Delayed-Match-to-Sample task. The PDM-based models reduce the complexity of representing large-scale neural MIMO systems that involve large numbers of neurons, and also offer the prospect of improved biological/physiological interpretation of the obtained models. PDM analysis of neuronal connectivity in this system revealed "input-output channels of communication" corresponding to specific bands of neural rhythms that quantify the relative importance of these frequency-specific PDMs across a variety of different tasks. We found that behavioral performance during the Delayed-Match-to-Sample task (correct vs. incorrect outcome) was associated with differential activation of frequency-specific PDMs in the prefrontal cortex.

A nonlinear autoregressive Volterra model of the Hodgkin-Huxley equations

We propose a new variant of Volterra-type model with a nonlinear auto-regressive (NAR) component that is a suitable framework for describing the process of AP generation by the neuron membrane potential, and we apply it to input-output data generated by the Hodgkin-Huxley (H-H) equations. Volterra models use a functional series expansion to describe the input-output relation for most nonlinear dynamic systems, and are applicable to a wide range of physiologic systems. It is difficult, however, to apply the Volterra methodology to the H-H model because is characterized by distinct subthreshold and suprathreshold dynamics. When threshold is crossed, an autonomous action potential (AP) is generated, the output becomes temporarily decoupled from the input, and the standard Volterra model fails. Therefore, in our framework, whenever membrane potential exceeds some threshold, it is taken as a second input to a dual-input Volterra model. This model correctly predicts membrane voltage deflection both within the subthreshold region and during APs. Moreover, the model naturally generates a post-AP afterpotential and refractory period. It is known that the H-H model converges to a limit cycle in response to a constant current injection. This behavior is correctly predicted by the proposed model, while the standard Volterra model is incapable of generating such limit cycle behavior. The inclusion of cross-kernels, which describe the nonlinear interactions between the exogenous and autoregressive inputs, is found to be absolutely necessary. The proposed model is general, non-parametric, and data-derived.

Markers of pathological excitability derived from principal dynamic modes of hippocampal neurons

Transformation of principal dynamic modes (PDMs) under epileptogenic conditions was investigated by computing the Volterra kernels in a rodent epilepsy model derived from a mouse whole hippocampal preparation, where epileptogenesis was induced by altering the concentrations of Mg(2 +) and K(+) of the perfusate for different levels of excitability. Both integrating and differentiating PDMs were present in the neuronal dynamics, and both of them increased in absolute magnitude for increased excitability levels. However, the integrating PDMs dominated at all levels of excitability in terms of their relative contributions to the overall response, whereas the dominant frequency responses of the differentiating PDMs were shifted to higher ranges under epileptogenic conditions, from ripple activities (75-200 Hz) to fast ripple activities (200-500 Hz).

Nonlinear modeling of dynamic interactions within neuronal ensembles using Principal Dynamic Modes

A methodology for nonlinear modeling of multi-input multi-output (MIMO) neuronal systems is presented that utilizes the concept of Principal Dynamic Modes (PDM). The efficacy of this new methodology is demonstrated in the study of the dynamic interactions between neuronal ensembles in the Pre-Frontal Cortex (PFC) of a behaving non-human primate (NHP) performing a Delayed Match-to-Sample task. Recorded spike trains from Layer-2 and Layer-5 neurons were viewed as the "inputs" and "outputs", respectively, of a putative MIMO system/model that quantifies the dynamic transformation of multi-unit neuronal activity between Layer-2 and Layer-5 of the PFC. Model prediction performance was evaluated by means of computed Receiver Operating Characteristic (ROC) curves. The PDM-based approach seeks to reduce the complexity of MIMO models of neuronal ensembles in order to enable the practicable modeling of large-scale neural systems incorporating hundreds or thousands of neurons, which is emerging as a preeminent issue in the study of neural function. The "scaling-up" issue has attained critical importance as multi-electrode recordings are increasingly used to probe neural systems and advance our understanding of integrated neural function. The initial results indicate that the PDM-based modeling methodology may greatly reduce the complexity of the MIMO model without significant degradation of performance. Furthermore, the PDM-based approach offers the prospect of improved biological/physiological interpretation of the obtained MIMO models.

Closing the loop for memory prosthesis: detecting the role of hippocampal neural ensembles using nonlinear models

A major factor involved in providing closed loop feedback for control of neural function is to understand how neural ensembles encode online information critical to the final behavioral endpoint. This issue was directly assessed in rats performing a short-term delay memory task in which successful encoding of task information is dependent upon specific spatio-temporal firing patterns recorded from ensembles of CA3 and CA1 hippocampal neurons. Such patterns, extracted by a specially designed nonlinear multi-input multi-output (MIMO) nonlinear mathematical model, were used to predict successful performance online via a closed loop paradigm which regulated trial difficulty (time of retention) as a function of the "strength" of stimulus encoding. The significance of the MIMO model as a neural prosthesis has been demonstrated by substituting trains of electrical stimulation pulses to mimic these same ensemble firing patterns. This feature was used repeatedly to vary "normal" encoding as a means of understanding how neural ensembles can be "tuned" to mimic the inherent process of selecting codes of different strength and functional specificity. The capacity to enhance and tune hippocampal encoding via MIMO model detection and insertion of critical ensemble firing patterns shown here provides the basis for possible extension to other disrupted brain circuitry.

A nonlinear model for hippocampal cognitive prosthesis: memory facilitation by hippocampal ensemble stimulation

Collaborative investigations have characterized how multineuron hippocampal ensembles encode memory necessary for subsequent successful performance by rodents in a delayed nonmatch to sample (DNMS) task and utilized that information to provide the basis for a memory prosthesis to enhance performance. By employing a unique nonlinear dynamic multi-input/multi-output (MIMO) model, developed and adapted to hippocampal neural ensemble firing patterns derived from simultaneous recorded CA1 and CA3 activity, it was possible to extract information encoded in the sample phase necessary for successful performance in the nonmatch phase of the task. The extension of this MIMO model to online delivery of electrical stimulation delivered to the same recording loci that mimicked successful CA1 firing patterns, provided the means to increase levels of performance on a trial-by-trial basis. Inclusion of several control procedures provides evidence for the specificity of effective MIMO model generated patterns of electrical stimulation. Increased utility of the MIMO model as a prosthesis device was exhibited by the demonstration of cumulative increases in DNMS task performance with repeated MIMO stimulation over many sessions on both stimulation and nonstimulation trials, suggesting overall system modification with continued exposure. Results reported here are compatible with and extend prior demonstrations and further support the candidacy of the MIMO model as an effective cortical prosthesis.

Restorative encoding memory integrative neural device: "REMIND"

Construction and application of a neural prosthesis device that enhances existing and replaces lost memory capacity in humans is the focus of research described here in rodents. A unique approach for the analysis and application of neural population firing has been developed to decipher the pattern in which information is successfully encoded by the hippocampus where mnemonic accuracy is critical. A nonlinear dynamic multi-input multi-output (MIMO) model is utilized to extract memory relevant firing patterns in CA3 and CA1 and to predict online what the consequences of the encoded firing patterns reflect for subsequent information retrieval for successful performance of delayed-nonmatch-to-sample (DNMS) memory task in rodents. The MIMO model has been tested successfully in a number of different contexts, each of which produced improved performance by a) utilizing online predicted codes to regulate task difficulty, b) employing electrical stimulation of CA1 output areas in the same pattern as successful cell firing, c) employing electrical stimulation to recover cell firing compromised by pharmacological agents and d) transferring and improving performance in naïve animals using the same stimulation patterns that are effective in fully trained animals. The results in rodents formed the basis for extension of the MIMO model to nonhuman primates in the same type of memory task that is now being tested in the last step prior to its application in humans.

Evidence-based modeling of network discharge dynamics during periodic pacing to control epileptiform activity

Deep brain stimulation (DBS) is a promising therapeutic approach for epilepsy treatment. Recently, research has focused on the implementation of stimulation protocols that would adapt to the patients need (adaptive stimulation) and deliver electrical stimuli only when it is most useful. A formal mathematical description of the effects of electrical stimulation on neuronal networks is a prerequisite for the development of adaptive DBS algorithms. Using tools from non-linear dynamic analysis, we describe an evidence-based, mathematical modeling approach that (1) accurately simulates epileptiform activity at time-scales of single and multiple ictal discharges, (2) simulates modulation of neural dynamics during epileptiform activity in response to fixed, low-frequency electrical stimulation, (3) defines a mapping from real-world observations to model state, and (4) defines a mapping from model state to real-world observations. We validate the real-world utility of the model's properties by statistical comparison between the number, duration, and interval of ictal-like discharges observed in vitro and those simulated in silica under conditions of repeated stimuli at fixed-frequency. These validation results confirm that the evidence-based modeling approach captures robust, informative features of neural network dynamics of in vitro epileptiform activity under periodic pacing and support its use for further implementation of adaptive DBS protocols for epilepsy treatment.

A cortical neural prosthesis for restoring and enhancing memory

A primary objective in developing a neural prosthesis is to replace neural circuitry in the brain that no longer functions appropriately. Such a goal requires artificial reconstruction of neuron-to-neuron connections in a way that can be recognized by the remaining normal circuitry, and that promotes appropriate interaction. In this study, the application of a specially designed neural prosthesis using a multi-input/multi-output (MIMO) nonlinear model is demonstrated by using trains of electrical stimulation pulses to substitute for MIMO model derived ensemble firing patterns. Ensembles of CA3 and CA1 hippocampal neurons, recorded from rats performing a delayed-nonmatch-to-sample (DNMS) memory task, exhibited successful encoding of trial-specific sample lever information in the form of different spatiotemporal firing patterns. MIMO patterns, identified online and in real-time, were employed within a closed-loop behavioral paradigm. Results showed that the model was able to predict successful performance on the same trial. Also, MIMO model-derived patterns, delivered as electrical stimulation to the same electrodes, improved performance under normal testing conditions and, more importantly, were capable of recovering performance when delivered to animals with ensemble hippocampal activity compromised by pharmacologic blockade of synaptic transmission. These integrated experimental-modeling studies show for the first time that, with sufficient information about the neural coding of memories, a neural prosthesis capable of real-time diagnosis and manipulation of the encoding process can restore and even enhance cognitive, mnemonic processes.

Modeling of nonlinear nonstationary dynamic systems with a novel class of artificial neural networks

This paper introduces a novel neural-network architecture that can be used to model time-varying Volterra systems from input-output data. The Volterra systems constitute a very broad class of stable nonlinear dynamic systems that can be extended to cover nonstationary (time-varying) cases. This novel architecture is composed of parallel subnets of three-layer perceptrons with polynomial activation functions, with the output of each subnet modulated by an appropriate time function that gives the summative output its time-varying characteristics. The paper shows the equivalence between this network architecture and the class of time-varying Volterra systems, and demonstrates the range of applicability of this approach with computer-simulated examples and real data. Although certain types of nonstationarities may not be amenable to this approach, it is hoped that this methodology will provide the practical tools for modeling some broad classes of nonlinear, nonstationary systems from input-output data, thus advancing the state of the art in a problem area that is widely viewed as a daunting challenge.

Transformation of neuronal modes associated with low-Mg2+/high-K+ conditions in an in vitro model of epilepsy

Nonparametric system modeling constitutes a robust method for the analysis of physiological systems as it can be used to identify nonlinear dynamic input-output relationships and facilitate their description. First- and second-order kernels of hippocampal CA3 pyramidal neurons in an in vitro slice preparation were computed using the Volterra-Wiener approach to investigate system changes associated with epileptogenic low-magnesium/high-potassium (low-Mg(2+)/high-K(+)) conditions. The principal dynamic modes (PDMs) of neurons were calculated from the first- and second-order kernel estimates in order to characterize changes in neural coding functionality. From our analysis, an increase in nonlinear properties was observed in kernels under low-Mg(2+)/high-K(+). Furthermore, the PDMs revealed that the sampled hippocampal CA3 neurons were primarily of integrating character and that the contribution of a differentiating mode component was enhanced under low-Mg(2+)/high-K(+).

Boolean modeling of neural systems with point-process inputs and outputs. Part I: theory and simulations

This paper presents a new modeling approach for neural systems with point-process (spike) inputs and outputs that utilizes Boolean operators (i.e. modulo 2 multiplication and addition that correspond to the logical AND and OR operations respectively, as well as the AND_NOT logical operation representing inhibitory effects). The form of the employed mathematical models is akin to a "Boolean-Volterra" model that contains the product terms of all relevant input lags in a hierarchical order, where terms of order higher than first represent nonlinear interactions among the various lagged values of each input point-process or among lagged values of various inputs (if multiple inputs exist) as they reflect on the output. The coefficients of this Boolean-Volterra model are also binary variables that indicate the presence or absence of the respective term in each specific model/system. Simulations are used to explore the properties of such models and the feasibility of their accurate estimation from short data-records in the presence of noise (i.e. spurious spikes). The results demonstrate the feasibility of obtaining reliable estimates of such models, with excitatory and inhibitory terms, in the presence of considerable noise (spurious spikes) in the outputs and/or the inputs in a computationally efficient manner. A pilot application of this approach to an actual neural system is presented in the companion paper (Part II).

Limbic dysregulation is associated with lowered heart rate variability and increased trait anxiety in healthy adults

OBJECTIVES

We tested whether dynamic interaction between limbic regions supports a control systems model of excitatory and inhibitory components of a negative feedback loop, and whether dysregulation of those dynamics might correlate with trait differences in anxiety and their cardiac characteristics among healthy adults.

EXPERIMENTAL DESIGN

Sixty-five subjects received fMRI scans while passively viewing angry, fearful, happy, and neutral facial stimuli. Subjects also completed a trait anxiety inventory, and were monitored using ambulatory wake ECG. The ECG data were analyzed for heart rate variability, a measure of autonomic regulation. The fMRI data were analyzed with respect to six limbic regions (bilateral amygdala, bilateral hippocampus, Brodmann Areas 9, 45) using limbic time-series cross-correlations, maximum BOLD amplitude, and BOLD amplitude at each point in the time-series.

PRINCIPAL OBSERVATIONS

Diminished coupling between limbic time-series in response to the neutral, fearful, and happy faces was associated with greater trait anxiety, greater sympathetic activation, and lowered heart rate variability. Individuals with greater levels of trait anxiety showed delayed activation of Brodmann Area 45 in response to the fearful and happy faces, and lowered Brodmann Area 45 activation with prolonged left amygdala activation in response to the neutral faces.

CONCLUSIONS

The dynamics support limbic regulation as a control system, in which dysregulation, as assessed by diminished coupling between limbic time-series, is associated with increased trait anxiety and excitatory autonomic outputs. Trait-anxious individuals showed delayed inhibitory activation in response to overt-affect stimuli and diminished inhibitory activation with delayed extinction of excitatory activation in response to ambiguous-affect stimuli.

Modeling convergent ON and OFF pathways in the early visual system

For understanding the computation and function of single neurons in sensory systems, one needs to investigate how sensory stimuli are related to a neuron's response and which biological mechanisms underlie this relationship. Mathematical models of the stimulus-response relationship have proved very useful in approaching these issues in a systematic, quantitative way. A starting point for many such analyses has been provided by phenomenological "linear-nonlinear" (LN) models, which comprise a linear filter followed by a static nonlinear transformation. The linear filter is often associated with the neuron's receptive field. However, the structure of the receptive field is generally a result of inputs from many presynaptic neurons, which may form parallel signal processing pathways. In the retina, for example, certain ganglion cells receive excitatory inputs from ON-type as well as OFF-type bipolar cells. Recent experiments have shown that the convergence of these pathways leads to intriguing response characteristics that cannot be captured by a single linear filter. One approach to adjust the LN model to the biological circuit structure is to use multiple parallel filters that capture ON and OFF bipolar inputs. Here, we review these new developments in modeling neuronal responses in the early visual system and provide details about one particular technique for obtaining the required sets of parallel filters from experimental data.

VLSI implementation of a nonlinear neuronal model: a "neural prosthesis" to restore hippocampal trisynaptic dynamics

We are developing a biomimetic electronic neural prosthesis to replace regions of the hippocampal brain area that have been damaged by disease or insult. We have used the hippocampal slice preparation as the first step in developing such a prosthesis. The major intrinsic circuitry of the hippocampus consists of an excitatory cascade involving the dentate gyrus (DG), CA3, and CA1 subregions; this trisynaptic circuit can be maintained in a transverse slice preparation. Our demonstration of a neural prosthesis for the hippocampal slice involves: (i) surgically removing CA3 function from the trisynaptic circuit by transecting CA3 axons, (ii) replacing biological CA3 function with a hardware VLSI (very large scale integration) model of the nonlinear dynamics of CA3, and (iii) through a specially designed multi-site electrode array, transmitting DG output to the hardware device, and routing the hardware device output to the synaptic inputs of the CA1 subregion, thus by-passing the damaged CA3. Field EPSPs were recorded from the CA1 dendritic zone in intact slices and "hybrid" DG-VLSI-CA1 slices. Results show excellent agreement between data from intact slices and transected slices with the hardware-substituted CA3: propagation of temporal patterns of activity from DG-->VLSI-->CA1 reproduces that observed experimentally in the biological DG-->CA3-->CA1 circuit.

Nonlinear dynamic modeling of spike train transformations for hippocampal-cortical prostheses

One of the fundamental principles of cortical brain regions, including the hippocampus, is that information is represented in the ensemble firing of populations of neurons, i.e., spatio-temporal patterns of electrophysiological activity. The hippocampus has long been known to be responsible for the formation of declarative, or fact-based, memories. Damage to the hippocampus disrupts the propagation of spatio-temporal patterns of activity through hippocampal internal circuitry, resulting in a severe anterograde amnesia. Developing a neural prosthesis for the damaged hippocampus requires restoring this multiple-input, multiple-output transformation of spatio-temporal patterns of activity. Because the mechanisms underlying synaptic transmission and generation of electrical activity in neurons are inherently nonlinear, any such prosthesis must be based on a nonlinear multiple-input, multiple-output model. In this paper, we have formulated the transformational process of multi-site propagation of spike activity between two subregions of the hippocampus (CA3 and CA1) as the identification of a multiple-input, multiple-output (MIMO) system, and proposed that it can be decomposed into a series of multiple-input, single-output (MISO) systems. Each MISO system is modeled as a physiologically plausible structure that consists of 1) linear/nonlinear feedforward Volterra kernels modeling synaptic transmission and dendritic integration, 2) a linear feedback Volterra kernel modeling spike-triggered after-potentials, 3) a threshold for spike generation, 4) a summation process for somatic integration, and 5) a noise term representing intrinsic neuronal noise and the contributions of unobserved inputs. Input and output spike trains were recorded from hippocampal CA3 and CA1 regions of rats performing a spatial delayed-nonmatch-to-sample memory task that requires normal hippocampal function. Kernels were expanded with Laguerre basis functions and estimated using a maximum-likelihood method. Complexity of the feedforward kernel was progressively increased to capture higher-order system nonlinear dynamics. Results showed higher prediction accuracies as kernel complexity increased. Self-kernels describe the nonlinearities within each input. Cross-kernels capture the nonlinear interaction between inputs. Second- and third-order nonlinear models were found to successfully predict the CA1 output spike distribution based on CA3 input spike trains. First-order, linear models were shown to be insufficient.

A modeling paradigm incorporating parametric and non-parametric methods

A novel parametric/non-parametric modeling paradigm was defined and used in characterization of synaptic transmission. In this paradigm, parametric and nonparametric techniques were incorporated in a complementary manner. Non-parametric method was used to generalize experimental data and extract system input/output properties. It provided a quantitative and intuitive way to validate a parametric model with respect to general, complete input patterns. Biological processes or mechanisms missed by the conventional parametric modeling approach were revealed and subsequently included into the modified parametric model.

Principal dynamic mode analysis of action potential firing in a spider mechanoreceptor

The encoding of mechanical stimuli into action potentials in two types of spider mechanoreceptor neurons is modeled by use of the principal dynamic modes (PDM) methodology. The PDM model is equivalent to the general Wiener-Bose model and consists of a minimum set of linear dynamic filters (PDMs), followed by a multivariate static nonlinearity and a threshold function. The PDMs are obtained by performing eigen-decomposition of a matrix constructed using the first-order and second-order Volterra kernels of the system, which are estimated by means of the Laguerre expansion technique, utilizing measurements of pseudorandom mechanical stimulation (input signal) and the resulting action potentials (output signal). The static nonlinearity, which can be viewed as a measure of the probability of action potential firing as a function of the PDM output values, is computed as the locus of points of the latter that correspond to output action potentials. The performance of the model is assessed by computing receiver operating characteristic (ROC) curves, akin to the ones used in decision theory and quantified by computing the area under the ROC curve. Three PDMs are revealed by the analysis. The first PDM exhibits a high-pass characteristic, illustrating the importance of the velocity of slit displacement in the generation of action potentials at the mechanoreceptor output, while the second and third PDMs exhibit band-pass and low-pass characteristics, respectively. The corresponding three-input nonlinearity exhibits asymmetric behavior with respect to its arguments, suggesting directional dependence of the mechanoreceptor response on the mechanical stimulation and the PDM outputs, in agreement to our findings from a previous study (Ann Biomed Eng 27:391-402, 1999). Differences between the Type A and B neurons are observed in the zeroth-order Volterra kernels (related to the average firing), as well as in the magnitudes of the second and third PDMs that perform band-pass and low-pass processing of the input signal, respectively.

General methodology for nonlinear modeling of neural systems with Poisson point-process inputs

This paper presents a general methodological framework for the practical modeling of neural systems with point-process inputs (sequences of action potentials or, more broadly, identical events) based on the Volterra and Wiener theories of functional expansions and system identification. The paper clarifies the distinctions between Volterra and Wiener kernels obtained from Poisson point-process inputs. It shows that only the Wiener kernels can be estimated via cross-correlation, but must be defined as zero along the diagonals. The Volterra kernels can be estimated far more accurately (and from shorter data-records) by use of the Laguerre expansion technique adapted to point-process inputs, and they are independent of the mean rate of stimulation (unlike their P-W counterparts that depend on it). The Volterra kernels can also be estimated for broadband point-process inputs that are not Poisson. Useful applications of this modeling approach include cases where we seek to determine (model) the transfer characteristics between one neuronal axon (a point-process 'input') and another axon (a point-process 'output') or some other measure of neuronal activity (a continuous 'output', such as population activity) with which a causal link exists.

Nonlinear Analysis of the Separate Contributions of Autonomic Nervous Systems to Heart Rate Variability Using Principal Dynamic Modes

This paper introduces a modified principal dynamic modes (PDM) method, which is able to separate the dynamics of sympathetic and parasympathetic nervous activities. The PDM is based on the principle that among all possible choices of expansion bases, there are some that require the minimum number of basis functions to achieve a given mean-square approximation of the system output. Such a minimum set of basis functions is termed PDMs of the nonlinear system. We found that the first two dominant PDMs have similar frequency characteristics for parasympathetic and sympathetic activities, as reported in the literature. These results are consistent for all nine of our healthy human subjects using our modified PDM approach. Validation of the purported separation of parasympathetic and sympathetic activities was performed by the application of the autonomic nervous system blocking drugs atropine and propranolol. With separate applications of the respective drugs, we found a significant decrease in the amplitude of the waveforms that correspond to each nervous activity. Furthermore, we observed near complete elimination of these dynamics when both drugs were given to the subjects. Comparison of our method to the conventional low-frequency/high-frequency ratio shows that our proposed approach provides more accurate assessment of the autonomic nervous balance. Our nonlinear PDM approach allows a clear separation of the two autonomic nervous activities, the lack of which has been the main reason why heart rate variability analysis has not had wide clinical acceptance.

A novel network for nonlinear modeling of neural systems with arbitrary point-process inputs

This paper address the issue of nonlinear model estimation for neural systems with arbitrary point-process inputs using a novel network that is composed of a pre-processing stage of a Laguerre filter bank followed by a single hidden layer with polynomial activation functions. The nonlinear modeling problem for neural systems has been attempted thus far only with Poisson point-process inputs and using cross-correlation methods to estimate low-order nonlinearities. The specific contribution of this paper is the use of the described novel network to achieve practical estimation of the requisite nonlinear model in the case of arbitrary (i.e. non-Poisson) point-process inputs and high-order nonlinearities. The success of this approach has critical implications for the study of neuronal ensembles, for which nonlinear modeling has been hindered by the requirement of Poisson process inputs and by the presence of high-order nonlinearities. The proposed methodology yields accurate models even for short input-output data records and in the presence of considerable noise. The efficacy of this approach is demonstrated with computer-simulated examples having continuous output and point-process output, and with real data from the dentate gyrus of the hippocampus.

Application of fast orthogonal search to linear and nonlinear stochastic systems

Standard deterministic autoregressive moving average (ARMA) models consider prediction errors to be unexplainable noise sources. The accuracy of the estimated ARMA model parameters depends on producing minimum prediction errors. In this study, an accurate algorithm is developed for estimating linear and nonlinear stochastic ARMA model parameters by using a method known as fast orthogonal search, with an extended model containing prediction errors as part of the model estimation process. The extended algorithm uses fast orthogonal search in a two-step procedure in which deterministic terms in the nonlinear difference equation model are first identified and then reestimated, this time in a model containing the prediction errors. Since the extended algorithm uses an orthogonal procedure, together with automatic model order selection criteria, the significant model terms are estimated efficiently and accurately. The model order selection criteria developed for the extended algorithm are also crucial in obtaining accurate parameter estimates. Several simulated examples are presented to demonstrate the efficacy of the algorithm.

Modeling methodology for nonlinear physiological systems

A general modeling approach for a broad class of nonlinear systems is presented that uses the concept of principal dynamic modes (PDMs). These PDMs constitute a filter bank whose outputs feed into a multi-input static nonlinearity of multinomial (polynomial) form to yield a general model for the broad class of Volterra systems. Because the practically obtainable models (from stimulus-response data) are of arbitrary order of nonlinearity, this approach is applicable to many nonlinear physiological systems heretofore beyond our methodological means. Two specific methods are proposed for the estimation of these PDMs and the associated nonlinearities from stimulus-response data. Method I uses eigendecomposition of a properly constructed matrix using the first two kernel estimates (obtained by existing methods). Method II uses a particular class of feedforward artificial neural networks with polynomial activation functions. The efficacy of these two methods is demonstrated with computer-simulated examples, and their relative performance is discussed. The advent of this approach promises a practicable solution to the vexing problem of modeling highly nonlinear physiological systems, provided that experimental data be available for reliable estimation of the requisite PDMs.

The significance of neural ensemble codes during behavior and cognition

The development of techniques to record from populations of neurons has made it possible to ask questions concerning the encoding of task-relevant information in awake, behaving animals. The issue of how groups of neurons within different brain structures register and retrieve representations of behaviorally significant events can now be addressed using multineuron-recording techniques. This review examines recent studies employing simultaneous recording of ten or more individual neurons in the mammalian brain. A major issue discussed is whether ensemble information content reconstructed from single-neuron recordings may be underestimated if compared to ensembles where those same neurons were recorded simultaneously. The mechanics of ensemble information encoding in the hippocampus is illustrated from population statistical analyses of ensemble activity during performance of a delay task. Detailed descriptions of methods of extracting ensemble information, as well as cross-correlational analyses, are discussed in the context of emergent issues regarding interpretation of ensemble data.

Nonlinear neuronal mode analysis of action potential encoding in the cockroach tactile spine neuron

Neuronal mode analysis is a recently developed technique for modelling the behavior of nonlinear systems whose outputs consist of action potentials. The system is modelled as a set of parallel linear filters, or modes, which feed into a multi-input threshold. The characteristics of the principal modes and the multi-input threshold device can be derived from Laguerre function expansions of the computed first- and second-order Volterra kernels when the system is stimulated with a randomly varying input. Neuronal mode analysis was used to model the encoder properties of the cockroach tactile spine neuron, a nonlinear, rapidly adapting, sensory neuron with reliable behavior. The analysis found two principal modes, one rapid and excitatory, the other slower and inhibitory. The two modes have analogies to two of the pathways in a block-structured model of the encoder that was developed from previous physiological investigations of the neuron. These results support the block-structured model and offer a new approach to identifying the components responsible for the nonlinear dynamic properties of this neuronal encoder.