Parametric and non-parametric modeling of short-term synaptic plasticity. Part I: Computational study

A Double-Layer Multi-Resolution Classification Model for Decoding Spatiotemporal Patterns of Spikes With Small Sample Size

We build a double-layer, multiple temporal-resolution classification model for decoding single-trial spatiotemporal patterns of spikes. The model takes spiking activities as input signals and binary behavioral or cognitive variables as output signals and represents the input-output mapping with a double-layer ensemble classifier. In the first layer, to solve the underdetermined problem caused by the small sample size and the very high dimensionality of input signals, B-spline functional expansion and L1-regularized logistic classifiers are used to reduce dimensionality and yield sparse model estimations. A wide range of temporal resolutions of neural features is included by using a large number of classifiers with different numbers of B-spline knots. Each classifier serves as a base learner to classify spatiotemporal patterns into the probability of the output label with a single temporal resolution. A bootstrap aggregating strategy is used to reduce the estimation variances of these classifiers. In the second layer, another L1-regularized logistic classifier takes outputs of first-layer classifiers as inputs to generate the final output predictions. This classifier serves as a meta-learner that fuses multiple temporal resolutions to classify spatiotemporal patterns of spikes into binary output labels. We test this decoding model with both synthetic and experimental data recorded from rats and human subjects performing memory-dependent behavioral tasks. Results show that this method can effectively avoid overfitting and yield accurate prediction of output labels with small sample size. The double-layer, multi-resolution classifier consistently outperforms the best single-layer, single-resolution classifier by extracting and utilizing multi-resolution spatiotemporal features of spike patterns in the classification.

A Glutamatergic Spine Model to Enable Multi-Scale Modeling of Nonlinear Calcium Dynamics

In synapses, calcium is required for modulating synaptic transmission, plasticity, synaptogenesis, and synaptic pruning. The regulation of calcium dynamics within neurons involves cellular mechanisms such as synaptically activated channels and pumps, calcium buffers, and calcium sequestrating organelles. Many experimental studies tend to focus on only one or a small number of these mechanisms, as technical limitations make it difficult to observe all features at once. Computational modeling enables incorporation of many of these properties together, allowing for more complete and integrated studies. However, the scale of existing detailed models is often limited to synaptic and dendritic compartments as the computational burden rapidly increases when these models are integrated in cellular or network level simulations. In this article we present a computational model of calcium dynamics at the postsynaptic spine of a CA1 pyramidal neuron, as well as a methodology that enables its implementation in multi-scale, large-scale simulations. We first present a mechanistic model that includes individually validated models of various components involved in the regulation of calcium at the spine. We validated our mechanistic model by comparing simulated calcium levels to experimental data found in the literature. We performed additional simulations with the mechanistic model to determine how the simulated calcium activity varies with respect to presynaptic-postsynaptic stimulation intervals and spine distance from the soma. We then developed an input-output (IO) model that complements the mechanistic calcium model and provide a computationally efficient representation for use in larger scale modeling studies; we show the performance of the IO model compared to the mechanistic model in terms of accuracy and speed. The models presented here help achieve two objectives. First, the mechanistic model provides a comprehensive platform to describe spine calcium dynamics based on individual contributing factors. Second, the IO model is trained on the main dynamical features of the mechanistic model and enables nonlinear spine calcium modeling on the cell and network level simulation scales. Utilizing both model representations provide a multi-level perspective on calcium dynamics, originating from the molecular interactions at spines and propagating the effects to higher levels of activity involved in network behavior.

ASIC Implementation of a Nonlinear Dynamical Model for Hippocampal Prosthesis

A hippocampal prosthesis is a very large scale integration (VLSI) biochip that needs to be implanted in the biological brain to solve a cognitive dysfunction. In this letter, we propose a novel low-complexity, small-area, and low-power programmable hippocampal neural network application-specific integrated circuit (ASIC) for a hippocampal prosthesis. It is based on the nonlinear dynamical model of the hippocampus: namely multi-input, multi-output (MIMO)-generalized Laguerre-Volterra model (GLVM). It can realize the real-time prediction of hippocampal neural activity. New hardware architecture, a storage space configuration scheme, low-power convolution, and gaussian random number generator modules are proposed. The ASIC is fabricated in 40 nm technology with a core area of 0.122 mm[Formula: see text] and test power of 84.4 [Formula: see text]W. Compared with the design based on the traditional architecture, experimental results show that the core area of the chip is reduced by 84.94% and the core power is reduced by 24.30%.

Designing Patient-Specific Optimal Neurostimulation Patterns for Seizure Suppression

Neurostimulation is a promising therapy for abating epileptic seizures. However, it is extremely difficult to identify optimal stimulation patterns experimentally. In this study, human recordings are used to develop a functional 24 neuron network statistical model of hippocampal connectivity and dynamics. Spontaneous seizure-like activity is induced in silico in this reconstructed neuronal network. The network is then used as a testbed to design and validate a wide range of neurostimulation patterns. Commonly used periodic trains were not able to permanently abate seizures at any frequency. A simulated annealing global optimization algorithm was then used to identify an optimal stimulation pattern, which successfully abated 92% of seizures. Finally, in a fully responsive, or closed-loop, neurostimulation paradigm, the optimal stimulation successfully prevented the network from entering the seizure state. We propose that the framework presented here for algorithmically identifying patient-specific neurostimulation patterns can greatly increase the efficacy of neurostimulation devices for seizures.

Mechanism-Based and Input-Output Modeling of the Key Neuronal Connections and Signal Transformations in the CA3-CA1 Regions of the Hippocampus

This letter examines the results of input-output (nonparametric) modeling based on the analysis of data generated by a mechanism-based (parametric) model of CA3-CA1 neuronal connections in the hippocampus. The motivation is to obtain biological insight into the interpretation of such input-output (Volterra-equivalent) models estimated from synthetic data. The insights obtained may be subsequently used to interpretat input-output models extracted from actual experimental data. Specifically, we found that a simplified parametric model may serve as a useful tool to study the signal transformations in the hippocampal CA3-CA1 regions. Input-output modeling of model-based synthetic data show that GABAergic interneurons are responsible for regulating neuronal excitation, controlling the precision of spike timing, and maintaining network oscillations, in a manner consistent with previous studies. The input-output model obtained from real data exhibits intriguing similarities with its synthetic-data counterpart, demonstrating the importance of a dynamic resonance in the system/model response around 2 Hz to 3 Hz. Using the input-output model from real data as a guide, we may be able to amend the parametric model by incorporating more mechanisms in order to yield better-matching input-output model. The approach we present can also be applied to the study of other neural systems and pathways.

Cannabinoids disrupt memory encoding by functionally isolating hippocampal CA1 from CA3

Much of the research on cannabinoids (CBs) has focused on their effects at the molecular and synaptic level. However, the effects of CBs on the dynamics of neural circuits remains poorly understood. This study aims to disentangle the effects of CBs on the functional dynamics of the hippocampal Schaffer collateral synapse by using data-driven nonparametric modeling. Multi-unit activity was recorded from rats doing an working memory task in control sessions and under the influence of exogenously administered tetrahydrocannabinol (THC), the primary CB found in marijuana. It was found that THC left firing rate unaltered and only slightly reduced theta oscillations. Multivariate autoregressive models, estimated from spontaneous spiking activity, were then used to describe the dynamical transformation from CA3 to CA1. They revealed that THC served to functionally isolate CA1 from CA3 by reducing feedforward excitation and theta information flow. The functional isolation was compensated by increased feedback excitation within CA1, thus leading to unaltered firing rates. Finally, both of these effects were shown to be correlated with memory impairments in the working memory task. By elucidating the circuit mechanisms of CBs, these results help close the gap in knowledge between the cellular and behavioral effects of CBs.

Research into cannabinoids (CBs) over the last several decades has found that they induce a large variety of oftentimes opposing effects on various neuronal receptors and processes. Due to this plethora of effects, disentangling how CBs influence neuronal circuits has proven challenging. This paper contributes to our understanding of the circuit level effects of CBs by using data driven modeling to examine how THC affects the input-output relationship in the Schaffer collateral synapse in the hippocampus. It was found that THC functionally isolated CA1 from CA3 by reducing feedforward excitation and theta information flow while simultaneously increasing feedback excitation within CA1. By elucidating the circuit mechanisms of CBs, these results help close the gap in knowledge between the cellular and behavioral effects of CBs.

Understanding spike-triggered covariance using Wiener theory for receptive field identification

Receptive field identification is a vital problem in sensory neurophysiology and vision. Much research has been done in identifying the receptive fields of nonlinear neurons whose firing rate is determined by the nonlinear interactions of a small number of linear filters. Despite more advanced methods that have been proposed, spike-triggered covariance (STC) continues to be the most widely used method in such situations due to its simplicity and intuitiveness. Although the connection between STC and Wiener/Volterra kernels has often been mentioned in the literature, this relationship has never been explicitly derived. Here we derive this relationship and show that the STC matrix is actually a modified version of the second-order Wiener kernel, which incorporates the input autocorrelation and mixes first- and second-order dynamics. It is then shown how, with little modification of the STC method, the Wiener kernels may be obtained and, from them, the principal dynamic modes, a set of compact and efficient linear filters that essentially combine the spike-triggered average and STC matrix and generalize to systems with both continuous and point-process outputs. Finally, using Wiener theory, we show how these obtained filters may be corrected when they were estimated using correlated inputs. Our correction technique is shown to be superior to those commonly used in the literature for both correlated Gaussian images and natural images.

Volterra representation enables modeling of complex synaptic nonlinear dynamics in large-scale simulations

Chemical synapses are comprised of a wide collection of intricate signaling pathways involving complex dynamics. These mechanisms are often reduced to simple spikes or exponential representations in order to enable computer simulations at higher spatial levels of complexity. However, these representations cannot capture important nonlinear dynamics found in synaptic transmission. Here, we propose an input-output (IO) synapse model capable of generating complex nonlinear dynamics while maintaining low computational complexity. This IO synapse model is an extension of a detailed mechanistic glutamatergic synapse model capable of capturing the input-output relationships of the mechanistic model using the Volterra functional power series. We demonstrate that the IO synapse model is able to successfully track the nonlinear dynamics of the synapse up to the third order with high accuracy. We also evaluate the accuracy of the IO synapse model at different input frequencies and compared its performance with that of kinetic models in compartmental neuron models. Our results demonstrate that the IO synapse model is capable of efficiently replicating complex nonlinear dynamics that were represented in the original mechanistic model and provide a method to replicate complex and diverse synaptic transmission within neuron network simulations.

Hippocampal closed-loop modeling and implications for seizure stimulation design

OBJECTIVE

Traditional hippocampal modeling has focused on the series of feedforward synapses known as the trisynaptic pathway. However, feedback connections from CA1 back to the hippocampus through the entorhinal cortex (EC) actually make the hippocampus a closed-loop system. By constructing a functional closed-loop model of the hippocampus, one may learn how both physiological and epileptic oscillations emerge and design efficient neurostimulation patterns to abate such oscillations.

APPROACH

Point process input-output models where estimated from recorded rodent hippocampal data to describe the nonlinear dynamical transformation from CA3 → CA1, via the schaffer-collateral synapse, and CA1 → CA3 via the EC. Each Volterra-like subsystem was composed of linear dynamics (principal dynamic modes) followed by static nonlinearities. The two subsystems were then wired together to produce the full closed-loop model of the hippocampus.

MAIN RESULTS

Closed-loop connectivity was found to be necessary for the emergence of theta resonances as seen in recorded data, thus validating the model. The model was then used to identify frequency parameters for the design of neurostimulation patterns to abate seizures.

SIGNIFICANCE

Deep-brain stimulation (DBS) is a new and promising therapy for intractable seizures. Currently, there is no efficient way to determine optimal frequency parameters for DBS, or even whether periodic or broadband stimuli are optimal. Data-based computational models have the potential to be used as a testbed for designing optimal DBS patterns for individual patients. However, in order for these models to be successful they must incorporate the complex closed-loop structure of the seizure focus. This study serves as a proof-of-concept of using such models to design efficient personalized DBS patterns for epilepsy.

System identification of point-process neural systems using probability based Volterra kernels

BACKGROUND

Neural information processing involves a series of nonlinear dynamical input/output transformations between the spike trains of neurons/neuronal ensembles. Understanding and quantifying these transformations is critical both for understanding neural physiology such as short-term potentiation and for developing cognitive neural prosthetics.

NEW METHOD

A novel method for estimating Volterra kernels for systems with point-process inputs and outputs is developed based on elementary probability theory. These Probability Based Volterra (PBV) kernels essentially describe the probability of an output spike given q input spikes at various lags t1, t2, …, tq.

RESULTS

The PBV kernels are used to estimate both synthetic systems where ground truth is available and data from the CA3 and CA1 regions rodent hippocampus. The PBV kernels give excellent predictive results in both cases. Furthermore, they are shown to be quite robust to noise and to have good convergence and overfitting properties. Through a slight modification, the PBV kernels are shown to also deal well with correlated point-process inputs.

COMPARISON WITH EXISTING METHODS

The PBV kernels were compared with kernels estimated through least squares estimation (LSE) and through the Laguerre expansion technique (LET). The LSE kernels were shown to fair very poorly with real data due to the large amount of input noise. Although the LET kernels gave the best predictive results in all cases, they require prior parameter estimation. It was shown how the PBV and LET methods can be combined synergistically to maximize performance.

CONCLUSIONS

The PBV kernels provide a novel and intuitive method of characterizing point-process input-output nonlinear systems.

Identification of functional synaptic plasticity from spiking activities using nonlinear dynamical modeling

This paper presents a systems identification approach for studying the long-term synaptic plasticity using natural spiking activities. This approach consists of three modeling steps. First, a multi-input, single-output (MISO), nonlinear dynamical spiking neuron model is formulated to estimate and represent the synaptic strength in means of functional connectivity between input and output neurons. Second, this MISO model is extended to a nonstationary form to track the time-varying properties of the synaptic strength. Finally, a Volterra modeling method is used to extract the synaptic learning rule, e.g., spike-timing-dependent plasticity, for the explanation of the input-output nonstationarity as the consequence of the past input-output spiking patterns. This framework is developed to study the underlying mechanisms of learning and memory formation in behaving animals, and may serve as the computational basis for building the next-generation adaptive cortical prostheses.

Model-based asessment of an in-vivo predictive relationship from CA1 to CA3 in the rodent hippocampus

Although an anatomical connection from CA1 to CA3 via the Entorhinal Cortex (EC) and through backprojecting interneurons has long been known it exist, it has never been examined quantitatively on the single neuron level, in the in-vivo nonpatholgical, nonperturbed brain. Here, single spike activity was recorded using a multi-electrode array from the CA3 and CA1 areas of the rodent hippocampus (N = 7) during a behavioral task. The predictive power from CA3→CA1 and CA1→CA3 was examined by constructing Multivariate Autoregressive (MVAR) models from recorded neurons in both directions. All nonsignificant inputs and models were identified and removed by means of Monte Carlo simulation methods. It was found that 121/166 (73 %) CA3→CA1 models and 96/145 (66 %) CA1→CA3 models had significant predictive power, thus confirming a predictive 'Granger' causal relationship from CA1 to CA3. This relationship is thought to be caused by a combination of truly causal connections such as the CA1→EC→CA3 pathway and common inputs such as those from the Septum. All MVAR models were then examined in the frequency domain and it was found that CA3 kernels had significantly more power in the theta and beta range than those of CA1, confirming CA3's role as an endogenous hippocampal pacemaker.

Insights on synaptic paired-pulse response using parametric and non-parametric models

Paired-pulse protocol is a well-established stimulation pattern used to characterize short-term changes in synaptic potency. Due to the experimental difficulty in accessing and measuring responses and interactions between subsynaptic elements, understanding the mechanisms that shape synaptic response is extremely challenging. We already proposed to address this issue and gain insights on the matter using a complex integrated modeling platform called EONS (Elementary Objects of the Nervous System). The use of this parametric platform provided us with insightful information on the subsynaptic components and how their interactions shape synaptic dynamics. We herein propose to add and combine a non-parametric model to (i) simplify the modeling framework, the number of underlying parameters and the overall computational complexity while faithfully maintaining the desirable synaptic behavior and (ii) provide a clear and concise framework to characterize AMPA and NMDA contributions to the observed paired-pulse responses.

Extraction and restoration of hippocampal spatial memories with non-linear dynamical modeling

To build a cognitive prosthesis that can replace the memory function of the hippocampus, it is essential to model the input-output function of the damaged hippocampal region, so the prosthetic device can stimulate the downstream hippocampal region, e.g., CA1, with the output signal, e.g., CA1 spike trains, predicted from the ongoing input signal, e.g., CA3 spike trains, and the identified input-output function, e.g., CA3-CA1 model. In order for the downstream region to form appropriate long-term memories based on the restored output signal, furthermore, the output signal should contain sufficient information about the memories that the animal has formed. In this study, we verify this premise by applying regression and classification modelings of the spatio-temporal patterns of spike trains to the hippocampal CA3 and CA1 data recorded from rats performing a memory-dependent delayed non-match-to-sample (DNMS) task. The regression model is essentially the multiple-input, multiple-output (MIMO) non-linear dynamical model of spike train transformation. It predicts the output spike trains based on the input spike trains and thus restores the output signal. In addition, the classification model interprets the signal by relating the spatio-temporal patterns to the memory events. We have found that: (1) both hippocampal CA3 and CA1 spike trains contain sufficient information for predicting the locations of the sample responses (i.e., left and right memories) during the DNMS task; and more importantly (2) the CA1 spike trains predicted from the CA3 spike trains by the MIMO model also are sufficient for predicting the locations on a single-trial basis. These results show quantitatively that, with a moderate number of unitary recordings from the hippocampus, the MIMO non-linear dynamical model is able to extract and restore spatial memory information for the formation of long-term memories and thus can serve as the computational basis of the hippocampal memory prosthesis.

From data patterns to mechanistic models in acute critical illness

The complexity of the physiologic and inflammatory response in acute critical illness has stymied the accurate diagnosis and development of therapies. The Society for Complex Acute Illness was formed a decade ago with the goal of leveraging multiple complex systems approaches to address this unmet need. Two main paths of development have characterized the society's approach: (i) data pattern analysis, either defining the diagnostic/prognostic utility of complexity metrics of physiologic signals or multivariate analyses of molecular and genetic data and (ii) mechanistic mathematical and computational modeling, all being performed with an explicit translational goal. Here, we summarize the progress to date on each of these approaches, along with pitfalls inherent in the use of each approach alone. We suggest that the next decade holds the potential to merge these approaches, connecting patient diagnosis to treatment via mechanism-based dynamical system modeling and feedback control and allowing extrapolation from physiologic signals to biomarkers to novel drug candidates. As a predicate example, we focus on the role of data-driven and mechanistic models in neuroscience and the impact that merging these modeling approaches can have on general anesthesia.

Identification of sparse neural functional connectivity using penalized likelihood estimation and basis functions

One key problem in computational neuroscience and neural engineering is the identification and modeling of functional connectivity in the brain using spike train data. To reduce model complexity, alleviate overfitting, and thus facilitate model interpretation, sparse representation and estimation of functional connectivity is needed. Sparsities include global sparsity, which captures the sparse connectivities between neurons, and local sparsity, which reflects the active temporal ranges of the input-output dynamical interactions. In this paper, we formulate a generalized functional additive model (GFAM) and develop the associated penalized likelihood estimation methods for such a modeling problem. A GFAM consists of a set of basis functions convolving the input signals, and a link function generating the firing probability of the output neuron from the summation of the convolutions weighted by the sought model coefficients. Model sparsities are achieved by using various penalized likelihood estimations and basis functions. Specifically, we introduce two variations of the GFAM using a global basis (e.g., Laguerre basis) and group LASSO estimation, and a local basis (e.g., B-spline basis) and group bridge estimation, respectively. We further develop an optimization method based on quadratic approximation of the likelihood function for the estimation of these models. Simulation and experimental results show that both group-LASSO-Laguerre and group-bridge-B-spline can capture faithfully the global sparsities, while the latter can replicate accurately and simultaneously both global and local sparsities. The sparse models outperform the full models estimated with the standard maximum likelihood method in out-of-sample predictions.

An analysis of the expression locus of long-term potentiation in hippocampal CA1 neurons

Long-term potentiation (LTP) has long been understood as an increase in the potency of a synaptic connection between two neurons. In this study, we combine a previously developed two-stage cascade model with electrophysiological recordings of rat hippocampal CA1 pyramidal cells both before and after LTP to analyze linear and nonlinear contributions of pre and post-synaptic partners to the strengthening of their synaptic connectivity. The result suggests that the major nonlinear expression locus of LTP exists in the post-synaptic side. Additionally, the report reveals that LTP should be understood not only in the traditional view as a change in the magnitude of communication between two cells, but also as a change in their temporal coding properties of information exchange.

A nonlinear model for hippocampal cognitive prosthesis: memory facilitation by hippocampal ensemble stimulation

Collaborative investigations have characterized how multineuron hippocampal ensembles encode memory necessary for subsequent successful performance by rodents in a delayed nonmatch to sample (DNMS) task and utilized that information to provide the basis for a memory prosthesis to enhance performance. By employing a unique nonlinear dynamic multi-input/multi-output (MIMO) model, developed and adapted to hippocampal neural ensemble firing patterns derived from simultaneous recorded CA1 and CA3 activity, it was possible to extract information encoded in the sample phase necessary for successful performance in the nonmatch phase of the task. The extension of this MIMO model to online delivery of electrical stimulation delivered to the same recording loci that mimicked successful CA1 firing patterns, provided the means to increase levels of performance on a trial-by-trial basis. Inclusion of several control procedures provides evidence for the specificity of effective MIMO model generated patterns of electrical stimulation. Increased utility of the MIMO model as a prosthesis device was exhibited by the demonstration of cumulative increases in DNMS task performance with repeated MIMO stimulation over many sessions on both stimulation and nonstimulation trials, suggesting overall system modification with continued exposure. Results reported here are compatible with and extend prior demonstrations and further support the candidacy of the MIMO model as an effective cortical prosthesis.

A hippocampal cognitive prosthesis: multi-input, multi-output nonlinear modeling and VLSI implementation

This paper describes the development of a cognitive prosthesis designed to restore the ability to form new long-term memories typically lost after damage to the hippocampus. The animal model used is delayed nonmatch-to-sample (DNMS) behavior in the rat, and the "core" of the prosthesis is a biomimetic multi-input/multi-output (MIMO) nonlinear model that provides the capability for predicting spatio-temporal spike train output of hippocampus (CA1) based on spatio-temporal spike train inputs recorded presynaptically to CA1 (e.g., CA3). We demonstrate the capability of the MIMO model for highly accurate predictions of CA1 coded memories that can be made on a single-trial basis and in real-time. When hippocampal CA1 function is blocked and long-term memory formation is lost, successful DNMS behavior also is abolished. However, when MIMO model predictions are used to reinstate CA1 memory-related activity by driving spatio-temporal electrical stimulation of hippocampal output to mimic the patterns of activity observed in control conditions, successful DNMS behavior is restored. We also outline the design in very-large-scale integration for a hardware implementation of a 16-input, 16-output MIMO model, along with spike sorting, amplification, and other functions necessary for a total system, when coupled together with electrode arrays to record extracellularly from populations of hippocampal neurons, that can serve as a cognitive prosthesis in behaving animals.

Nonlinear dynamic modeling of neuron action potential threshold during synaptically driven broadband intracellular activity

Activity-dependent variation of neuronal thresholds for action potential (AP) generation is one of the key determinants of spike-train temporal-pattern transformations from presynaptic to postsynaptic spike trains. In this study, we model the nonlinear dynamics of the threshold variation during synaptically driven broadband intracellular activity. First, membrane potentials of single CA1 pyramidal cells were recorded under physiologically plausible broadband stimulation conditions. Second, a method was developed to measure AP thresholds from the continuous recordings of membrane potentials. It involves measuring the turning points of APs by analyzing the third-order derivatives of the membrane potentials. Four stimulation paradigms with different temporal patterns were applied to validate this method by comparing the measured AP turning points and the actual AP thresholds estimated with varying stimulation intensities. Results show that the AP turning points provide consistent measurement of the AP thresholds, except for a constant offset. It indicates that 1) the variation of AP turning points represents the nonlinearities of threshold dynamics; and 2) an optimization of the constant offset is required to achieve accurate spike prediction. Third, a nonlinear dynamical third-order Volterra model was built to describe the relations between the threshold dynamics and the AP activities. Results show that the model can predict threshold accurately based on the preceding APs. Finally, the dynamic threshold model was integrated into a previously developed single neuron model and resulted in a 33% improvement in spike prediction.

Nonlinear dynamic modeling of synaptically driven single hippocampal neuron intracellular activity

A high-order nonlinear dynamic model of the input-output properties of single hippocampal CA1 pyramidal neurons was developed based on synaptically driven intracellular activity. The purpose of this study is to construct a model that: 1) can capture the nonlinear dynamics of both subthreshold activities [postsynaptic potentials (PSPs)] and suprathreshold activities (action potentials) in a single formalism; 2) is sufficiently general to be applied to any spike-input and spike-output neurons (point process input and point process output neural systems); and 3) is computationally efficient. The model consisted of three major components: 1) feedforward kernels (up to third order) that transform presynaptic action potentials into PSPs; 2) a constant threshold, above which action potentials are generated; and 3) a feedback kernel (first order) that describes spike-triggered after-potentials. The model was applied to CA1 pyramidal cells, as they were electrically stimulated with broadband Poisson random impulse trains through the Schaffer collaterals. The random impulse trains used here have physiological properties similar to spiking patterns observed in CA3 hippocampal neurons. PSPs and action potentials were recorded from the soma of CA1 pyramidal neurons using whole-cell patch-clamp recording. We evaluated the model performance separately with respect to PSP waveforms and the occurrence of spikes. The average normalized mean square error of PSP prediction is 14.4%. The average spike prediction error rate is 18.8%. In summary, although prediction errors still could be reduced, the model successfully captures the majority of high-order nonlinear dynamics of the single-neuron intracellular activity. The model captures the general biophysical processes with a small set of open parameters that are directly constrained by the intracellular recording, and thus, can be easily applied to any spike-input and spike-output neuron.

A two-stage cascade nonlinear dynamical model of single neurons for the separation and quantification of pre- and post-synaptic mechanisms of synaptic transmission

Neurons receive pre-synaptic spike trains and transform them into post-synaptic spike trains. This spike train to spike train temporal transformation underlies all cognitive functions performed by neurons, e.g., learning and memory. The transformation is a highly nonlinear dynamical process that involves both pre- and post-synaptic mechanisms. The ability to separate and quantify the nonlinear dynamics of pre- and post-synaptic mechanism is needed to gain insights into this transformation. In this study, we developed a Volterra kernel based two-stage cascade model of synaptic transmission using synaptically-driven intracellular activities, to which broadband stimulation conditions were imposed. The first stage of the model represents the pre-synaptic mechanisms and describes the nonlinear dynamical transformation from pre-synaptic spike trains to transmitter vesicle release strengths. The vesicle release strengths were obtained from the intracellularly recorded excitatory post-synaptic currents (EPSCs). The second stage of the model represents the post-synaptic mechanisms and describes the nonlinear dynamical transformation from release strengths to excitatory post-synaptic potentials (EPSPs). One application of this cascade model is to analyze the pre- and post-synaptic mechanism change induced by long-term potentiation (LTP). This future application is expected to shed new light on the expression locus of LTP.

The Neurobiological Basis of Cognition: Identification by Multi-Input, Multioutput Nonlinear Dynamic Modeling: A method is proposed for measuring and modeling human long-term memory formation by mathematical analysis and computer simulation of nerve-cell dynamics

The successful development of neural prostheses requires an understanding of the neurobiological bases of cognitive processes, i.e., how the collective activity of populations of neurons results in a higher level process not predictable based on knowledge of the individual neurons and/or synapses alone. We have been studying and applying novel methods for representing nonlinear transformations of multiple spike train inputs (multiple time series of pulse train inputs) produced by synaptic and field interactions among multiple subclasses of neurons arrayed in multiple layers of incompletely connected units. We have been applying our methods to study of the hippocampus, a cortical brain structure that has been demonstrated, in humans and in animals, to perform the cognitive function of encoding new long-term (declarative) memories. Without their hippocampi, animals and humans retain a short-term memory (memory lasting approximately 1 min), and long-term memory for information learned prior to loss of hippocampal function. Results of more than 20 years of studies have demonstrated that both individual hippocampal neurons, and populations of hippocampal cells, e.g., the neurons comprising one of the three principal subsystems of the hippocampus, induce strong, higher order, nonlinear transformations of hippocampal inputs into hippocampal outputs. For one synaptic input or for a population of synchronously active synaptic inputs, such a transformation is represented by a sequence of action potential inputs being changed into a different sequence of action potential outputs. In other words, an incoming temporal pattern is transformed into a different, outgoing temporal pattern. For multiple, asynchronous synaptic inputs, such a transformation is represented by a spatiotemporal pattern of action potential inputs being changed into a different spatiotemporal pattern of action potential outputs. Our primary thesis is that the encoding of short-term memories into new, long-term memories represents the collective set of nonlinearities induced by the three or four principal subsystems of the hippocampus, i.e., entorhinal cortex-to-dentate gyrus, dentate gyrus-to-CA3 pyramidal cell region, CA3-to-CA1 pyramidal cell region, and CA1-to-subicular cortex. This hypothesis will be supported by studies using in vivo hippocampal multineuron recordings from animals performing memory tasks that require hippocampal function. The implications for this hypothesis will be discussed in the context of "cognitive prostheses"-neural prostheses for cortical brain regions believed to support cognitive functions, and that often are subject to damage due to stroke, epilepsy, dementia, and closed head trauma.

Nonlinear dynamic analyses of single hippocampal neurons before and after long-term potentiation

Long-term potentiation (LTP) has long been considered an important phenomenon involved in learning and memory. However, the current literature lacks systematical analyses of single neuron dynamics before and after LTP induction. In this report, we applied an up to 3rd-order Volterra kernel to analyze the dynamics of single hippocampal neurons before and after LTP induction. Broadband Poisson random impulse trains with a 2 Hz mean frequency, which included physiologically plausible patterns, were applied to stimulate CA1 pyramidal neurons through Schaffer collateral before and after LTP induction. Corresponding somatic sub-threshold excitatory postsynaptic potentials (EPSPs) were recorded from CA1 neurons using whole-cell patch-clamp recording. The result suggests that LTP increases linear responses and depresses nonlinear responses. The phenomenon can be explained with both presynaptic and postsynaptic hypotheses. Further comparisons of voltage-clamp and current-clamp recordings are needed to distinguish the changes of dynamics in presynaptic and/or postsynaptic mechanisms.

A method for decoding the neurophysiological spike-response transform

Many physiological responses elicited by neuronal spikes-intracellular calcium transients, synaptic potentials, muscle contractions-are built up of discrete, elementary responses to each spike. However, the spikes occur in trains of arbitrary temporal complexity, and each elementary response not only sums with previous ones, but can itself be modified by the previous history of the activity. A basic goal in system identification is to characterize the spike-response transform in terms of a small number of functions-the elementary response kernel and additional kernels or functions that describe the dependence on previous history-that will predict the response to any arbitrary spike train. Here we do this by developing further and generalizing the "synaptic decoding" approach of Sen et al. (1996). Given the spike times in a train and the observed overall response, we use least-squares minimization to construct the best estimated response and at the same time best estimates of the elementary response kernel and the other functions that characterize the spike-response transform. We avoid the need for any specific initial assumptions about these functions by using techniques of mathematical analysis and linear algebra that allow us to solve simultaneously for all of the numerical function values treated as independent parameters. The functions are such that they may be interpreted mechanistically. We examine the performance of the method as applied to synthetic data. We then use the method to decode real synaptic and muscle contraction transforms.

Nonlinear modeling of neural population dynamics for hippocampal prostheses

Developing a neural prosthesis for the damaged hippocampus requires restoring the transformation of population neural activities performed by the hippocampal circuitry. To bypass a damaged region, output spike trains need to be predicted from the input spike trains and then reinstated through stimulation. We formulate a multiple-input, multiple-output (MIMO) nonlinear dynamic model for the input-output transformation of spike trains. In this approach, a MIMO model comprises a series of physiologically-plausible multiple-input, single-output (MISO) neuron models that consist of five components each: (1) feedforward Volterra kernels transforming the input spike trains into the synaptic potential, (2) a feedback kernel transforming the output spikes into the spike-triggered after-potential, (3) a noise term capturing the system uncertainty, (4) an adder generating the pre-threshold potential, and (5) a threshold function generating output spikes. It is shown that this model is equivalent to a generalized linear model with a probit link function. To reduce model complexity and avoid overfitting, statistical model selection and cross-validation methods are employed to choose the significant inputs and interactions between inputs. The model is applied successfully to the hippocampal CA3-CA1 population dynamics. Such a model can serve as a computational basis for the development of hippocampal prostheses.

Nonlinear model of single hippocampal neurons with dynamical thresholds

Neurons transform a series of presynaptic spikes into a series of postsynaptic spikes through a number of nonlinear mechanisms. A nonlinear model with a dynamical threshold was built using a Volterra Laguerre kernel method to characterize the spike train to spike train transformations of hippocampal CA1 pyramidal neurons. Inputs of the model were broadband Poisson random impulse trains with a 2 Hz mean frequency, and outputs of the model were the corresponding evoked post-synaptic potential (PSP) and spike train data recorded from CA1 cell bodies using a whole-cell recording technique. The model consists of four major components, i.e., feedforward kernels representing the transformation of presynaptic spikes to PSPs; a dynamical threshold kernel determining threshold value based on output inter-spike-intervals (ISIs); a spike detector; and a feedback kernel representing the spike-triggered after-potentials.