Technical integration of hippocampus, Basal Ganglia and physical models for spatial navigation

From model specification to simulation of biologically constrained networks of spiking neurons

A declarative extensible markup language (SpineML) for describing the dynamics, network and experiments of large-scale spiking neural network simulations is described which builds upon the NineML standard. It utilises a level of abstraction which targets point neuron representation but addresses the limitations of existing tools by allowing arbitrary dynamics to be expressed. The use of XML promotes model sharing, is human readable and allows collaborative working. The syntax uses a high-level self explanatory format which allows straight forward code generation or translation of a model description to a native simulator format. This paper demonstrates the use of code generation in order to translate, simulate and reproduce the results of a benchmark model across a range of simulators. The flexibility of the SpineML syntax is highlighted by reproducing a pre-existing, biologically constrained model of a neural microcircuit (the striatum). The SpineML code is open source and is available at http://bimpa.group.shef.ac.uk/SpineML .

Modeling the contributions of Basal ganglia and Hippocampus to spatial navigation using reinforcement learning

A computational neural model that describes the competing roles of Basal Ganglia and Hippocampus in spatial navigation is presented. Model performance is evaluated on a simulated Morris water maze explored by a model rat. Cue-based and place-based navigational strategies, thought to be subserved by the Basal ganglia and Hippocampus respectively, are described. In cue-based navigation, the model rat learns to directly head towards a visible target, while in place-based navigation the target position is represented in terms of spatial context provided by an array of poles placed around the pool. Learning is formulated within the framework of Reinforcement Learning, with the nigrostriatal dopamine signal playing the role of Temporal Difference Error. Navigation inherently involves two apparently contradictory movements: goal oriented movements vs. random, wandering movements. The model hypothesizes that while the goal-directedness is determined by the gradient in Value function, randomness is driven by the complex activity of the SubThalamic Nucleus (STN)-Globus Pallidus externa (GPe) system. Each navigational system is associated with a Critic, prescribing actions that maximize value gradients for the corresponding system. In the integrated system, that incorporates both cue-based and place-based forms of navigation, navigation at a given position is determined by the system whose value function is greater at that position. The proposed model describes the experimental results of [1], a lesion-study that investigates the competition between cue-based and place-based navigational systems. The present study also examines impaired navigational performance under Parkinsonian-like conditions. The integrated navigational system, operated under dopamine-deficient conditions, exhibits increased escape latency as was observed in experimental literature describing MPTP model rats navigating a water maze.

A circuit-level model of hippocampal place field dynamics modulated by entorhinal grid and suppression-generating cells

Hippocampal “place cells” and the precession of their extracellularly recorded spiking during traversal of a “place field” are well-established phenomena. More recent experiments describe associated entorhinal “grid cell” firing, but to date only conceptual models have been offered to explain the potential interactions among entorhinal cortex (EC) and hippocampus. To better understand not only spatial navigation, but mechanisms of episodic and semantic memory consolidation and reconsolidation, more detailed physiological models are needed to guide confirmatory experiments. Here, we report the results of a putative entorhinal-hippocampal circuit level model that incorporates recurrent asynchronous-irregular non-linear (RAIN) dynamics, in the context of recent in vivo findings showing specific intracellular–extracellular precession disparities and place field destabilization by entorhinal lesioning. In particular, during computer-simulated rodent maze navigation, our model demonstrate asymmetric ramp-like depolarization, increased theta power, and frequency (that can explain the phase precession disparity), and a role for STDP and K_AHP channels. Additionally, we propose distinct roles for two entorhinal cell populations projecting to hippocampus. Grid cell populations transiently trigger place field activity, while tonic “suppression-generating cell” populations minimize aberrant place cell activation, and limit the number of active place cells during traversal of a given field. Applied to place-cell RAIN networks, this tonic suppression explains an otherwise seemingly discordant association with overall increased firing. The findings of this circuit level model suggest in vivo and in vitro experiments that could refute or support the proposed mechanisms of place cell dynamics and modulating influences of EC.

The ventral basal ganglia, a selection mechanism at the crossroads of space, strategy, and reward

The basal ganglia are often conceptualised as three parallel domains that include all the constituent nuclei. The 'ventral domain' appears to be critical for learning flexible behaviours for exploration and foraging, as it is the recipient of converging inputs from amygdala, hippocampal formation and prefrontal cortex, putatively centres for stimulus evaluation, spatial navigation, and planning/contingency, respectively. However, compared to work on the dorsal domains, the rich potential for quantitative theories and models of the ventral domain remains largely untapped, and the purpose of this review is to provide the stimulus for this work. We systematically review the ventral domain's structures and internal organisation, and propose a functional architecture as the basis for computational models. Using a full schematic of the structure of inputs to the ventral striatum (nucleus accumbens core and shell), we argue for the existence of many identifiable processing channels on the basis of unique combinations of afferent inputs. We then identify the potential information represented in these channels by reconciling a broad range of studies from the hippocampal, amygdala and prefrontal cortex literatures with known properties of the ventral striatum from lesion, pharmacological, and electrophysiological studies. Dopamine's key role in learning is reviewed within the three current major computational frameworks; we also show that the shell-based basal ganglia sub-circuits are well placed to generate the phasic burst and dip responses of dopaminergic neurons. We detail dopamine's modulation of ventral basal ganglia's inputs by its actions on pre-synaptic terminals and post-synaptic membranes in the striatum, arguing that the complexity of these effects hint at computational roles for dopamine beyond current ideas. The ventral basal ganglia are revealed as a constellation of multiple functional systems for the learning and selection of flexible behaviours and of behavioural strategies, sharing the common operations of selection-by-disinhibition and of dopaminergic modulation.