A spiking model of basal ganglia dynamics in stopping behavior supported by arkypallidal neurons

Pallidal Deep Brain Stimulation Enhances Habitual Behavior in a Neuro-Computational Basal Ganglia Model During a Reward Reversal Learning Task

Deep brain stimulation (DBS) within the basal ganglia is a widely used therapeutic intervention for neurological disorders; however, its precise mechanisms of action remain unclear. This study investigates how DBS may affect decision-making processes through computational modeling of the basal ganglia. A rate-coded model incorporating direct, indirect, and hyperdirect pathways was utilized alongside a cortico-thalamic shortcut known for promoting habitual behavior. Simulations of a two-choice reward reversal learning task were conducted to replicate data from patients with dystonia in ON and OFF DBS conditions. We demonstrate that plasticity in the cortico-thalamic shortcut, which bypasses the basal ganglia, is crucial for reproducing the patients' behavioral data, emphasizing the role of habit formation. Simulated DBS increased habitual behavior following reward reversal. Integrating different DBS mechanisms revealed that suppression of stimulated neurons, stimulation of efferent axons, and a combined variant promoted habitual behavior. Analyses of thalamic inputs showed that, despite differing effects on the model's activity and plasticity, these DBS variants consistently reduced the influence of the basal ganglia while enhancing the role of the cortico-thalamic shortcut. Notably, the DBS variants were distinguishable by their divergent behavioral effects following discontinued stimulation. These findings underscore the potential multifaceted effects of DBS on decision-making processes. In particular, our model proposes that DBS modulates the balance between reward-guided and habitual behavior.

CBGTPy: An extensible cortico-basal ganglia-thalamic framework for modeling biological decision making

Here we introduce CBGTPy, a virtual environment for designing and testing goal-directed agents with internal dynamics that are modeled on the cortico-basal-ganglia-thalamic (CBGT) pathways in the mammalian brain. CBGTPy enables researchers to investigate the internal dynamics of the CBGT system during a variety of tasks, allowing for the formation of testable predictions about animal behavior and neural activity. The framework has been designed around the principle of flexibility, such that many experimental parameters in a decision making paradigm can be easily defined and modified. Here we demonstrate the capabilities of CBGTPy across a range of single and multi-choice tasks, highlighting the ease of set up and the biologically realistic behavior that it produces. We show that CBGTPy is extensible enough to apply to a range of experimental protocols and to allow for the implementation of model extensions with minimal developmental effort.

Rethinking the external globus pallidus and information flow in cortico-basal ganglia-thalamic circuits

For decades, the external globus pallidus (GPe) has been viewed as a passive way-station in the indirect pathway of the cortico-basal ganglia-thalamic (CBGT) circuit, sandwiched between striatal inputs and basal ganglia outputs. According to this model, one-way descending striatal signals in the indirect pathway amplify the suppression of downstream thalamic nuclei by inhibiting GPe activity. Here, we revisit this assumption, in light of new and emerging work on the cellular complexity, connectivity and functional role of the GPe in behaviour. We show how, according to this new circuit-level logic, the GPe is ideally positioned for relaying ascending and descending control signals within the basal ganglia. Focusing on the problem of inhibitory control, we illustrate how this bidirectional flow of information allows for the integration of reactive and proactive control mechanisms during action selection. Taken together, this new evidence points to the GPe as being a central hub in the CBGT circuit, participating in bidirectional information flow and linking multifaceted control signals to regulate behaviour.

CBGTPy: An extensible cortico-basal ganglia-thalamic framework for modeling biological decision making

Here we introduce CBGTPy, a virtual environment for designing and testing goal-directed agents with internal dynamics that are modeled on the cortico-basal-ganglia-thalamic (CBGT) pathways in the mammalian brain. CBGTPy enables researchers to investigate the internal dynamics of the CBGT system during a variety of tasks, allowing for the formation of testable predictions about animal behavior and neural activity. The framework has been designed around the principle of flexibility, such that many experimental parameters in a decision making paradigm can be easily defined and modified. Here we demonstrate the capabilities of CBGTPy across a range of single and multi-choice tasks, highlighting the ease of set up and the biologically realistic behavior that it produces. We show that CBGTPy is extensible enough to apply to a range of experimental protocols and to allow for the implementation of model extensions with minimal developmental effort.

Exploration behavior after reversals is predicted by STN-GPe synaptic plasticity in a basal ganglia model

Humans can quickly adapt their behavior to changes in the environment. Classical reversal learning tasks mainly measure how well participants can disengage from a previously successful behavior but not how alternative responses are explored. Here, we propose a novel 5-choice reversal learning task with alternating position-reward contingencies to study exploration behavior after a reversal. We compare human exploratory saccade behavior with a prediction obtained from a neuro-computational model of the basal ganglia. A new synaptic plasticity rule for learning the connectivity between the subthalamic nucleus (STN) and external globus pallidus (GPe) results in exploration biases to previously rewarded positions. The model simulations and human data both show that during experimental experience exploration becomes limited to only those positions that have been rewarded in the past. Our study demonstrates how quite complex behavior may result from a simple sub-circuit within the basal ganglia pathways.

Distinct cortico-striatal compartments drive competition between adaptive and automatized behavior

Cortical and basal ganglia circuits play a crucial role in the formation of goal-directed and habitual behaviors. In this study, we investigate the cortico-striatal circuitry involved in learning and the role of this circuitry in the emergence of inflexible behaviors such as those observed in addiction. Specifically, we develop a computational model of cortico-striatal interactions that performs concurrent goal-directed and habit learning. The model accomplishes this by distinguishing learning processes in the dorsomedial striatum (DMS) that rely on reward prediction error signals as distinct from the dorsolateral striatum (DLS) where learning is supported by salience signals. These striatal subregions each operate on unique cortical input: the DMS receives input from the prefrontal cortex (PFC) which represents outcomes, and the DLS receives input from the premotor cortex which determines action selection. Following an initial learning of a two-alternative forced choice task, we subjected the model to reversal learning, reward devaluation, and learning a punished outcome. Behavior driven by stimulus-response associations in the DLS resisted goal-directed learning of new reward feedback rules despite devaluation or punishment, indicating the expression of habit. We repeated these simulations after the impairment of executive control, which was implemented as poor outcome representation in the PFC. The degraded executive control reduced the efficacy of goal-directed learning, and stimulus-response associations in the DLS were even more resistant to the learning of new reward feedback rules. In summary, this model describes how circuits of the dorsal striatum are dynamically engaged to control behavior and how the impairment of executive control by the PFC enhances inflexible behavior.

Identifying control ensembles for information processing within the cortico-basal ganglia-thalamic circuit

In situations featuring uncertainty about action-reward contingencies, mammals can flexibly adopt strategies for decision-making that are tuned in response to environmental changes. Although the cortico-basal ganglia thalamic (CBGT) network has been identified as contributing to the decision-making process, it features a complex synaptic architecture, comprised of multiple feed-forward, reciprocal, and feedback pathways, that complicate efforts to elucidate the roles of specific CBGT populations in the process by which evidence is accumulated and influences behavior. In this paper we apply a strategic sampling approach, based on Latin hypercube sampling, to explore how variations in CBGT network properties, including subpopulation firing rates and synaptic weights, map to variability of parameters in a normative drift diffusion model (DDM), representing algorithmic aspects of information processing during decision-making. Through the application of canonical correlation analysis, we find that this relationship can be characterized in terms of three low-dimensional control ensembles within the CBGT network that impact specific qualities of the emergent decision policy: responsiveness (a measure of how quickly evidence evaluation gets underway, associated with overall activity in corticothalamic and direct pathways), pliancy (a measure of the standard of evidence needed to commit to a decision, associated largely with overall activity in components of the indirect pathway of the basal ganglia), and choice (a measure of commitment toward one available option, associated with differences in direct and indirect pathways across action channels). These analyses provide mechanistic predictions about the roles of specific CBGT network elements in tuning the way that information is accumulated and translated into decision-related behavior.

BOLD Monitoring in the Neural Simulator ANNarchy

Multi-scale network models that simultaneously simulate different measurable signals at different spatial and temporal scales, such as membrane potentials of single neurons, population firing rates, local field potentials, and blood-oxygen-level-dependent (BOLD) signals, are becoming increasingly popular in computational neuroscience. The transformation of the underlying simulated neuronal activity of these models to simulated non-invasive measurements, such as BOLD signals, is particularly relevant. The present work describes the implementation of a BOLD monitor within the neural simulator ANNarchy to allow an on-line computation of simulated BOLD signals from neural network models. An active research topic regarding the simulation of BOLD signals is the coupling of neural processes to cerebral blood flow (CBF) and cerebral metabolic rate of oxygen (CMRO2). The flexibility of ANNarchy allows users to define this coupling with a high degree of freedom and thus, not only allows to relate mesoscopic network models of populations of spiking neurons to experimental BOLD data, but also to investigate different hypotheses regarding the coupling between neural processes, CBF and CMRO2 with these models. In this study, we demonstrate how simulated BOLD signals can be obtained from a network model consisting of multiple spiking neuron populations. We first demonstrate the use of the Balloon model, the predominant model for simulating BOLD signals, as well as the possibility of using novel user-defined models, such as a variant of the Balloon model with separately driven CBF and CMRO2 signals. We emphasize how different hypotheses about the coupling between neural processes, CBF and CMRO2 can be implemented and how these different couplings affect the simulated BOLD signals. With the BOLD monitor presented here, ANNarchy provides a tool for modelers who want to relate their network models to experimental MRI data and for scientists who want to extend their studies of the coupling between neural processes and the BOLD signal by using modeling approaches. This facilitates the investigation and model-based analysis of experimental BOLD data and thus improves multi-scale understanding of neural processes in humans.

Dissociable Roles of Pallidal Neuron Subtypes in Regulating Motor Patterns

We have previously established that PV+ neurons and Npas1+ neurons are distinct neuron classes in the external globus pallidus (GPe): they have different topographical, electrophysiological, circuit, and functional properties. Aside from Foxp2+ neurons, which are a unique subclass within the Npas1+ class, we lack driver lines that effectively capture other GPe neuron subclasses. In this study, we examined the utility of Kcng4-Cre, Npr3-Cre, and Npy2r-Cre mouse lines (both males and females) for the delineation of GPe neuron subtypes. By using these novel driver lines, we have provided the most exhaustive investigation of electrophysiological studies of GPe neuron subtypes to date. Corroborating our prior studies, GPe neurons can be divided into two statistically distinct clusters that map onto PV+ and Npas1+ classes. By combining optogenetics and machine learning-based tracking, we showed that optogenetic perturbation of GPe neuron subtypes generated unique behavioral structures. Our findings further highlighted the dissociable roles of GPe neurons in regulating movement and anxiety-like behavior. We concluded that Npr3+ neurons and Kcng4+ neurons are distinct subclasses of Npas1+ neurons and PV+ neurons, respectively. Finally, by examining local collateral connectivity, we inferred the circuit mechanisms involved in the motor patterns observed with optogenetic perturbations. In summary, by identifying mouse lines that allow for manipulations of GPe neuron subtypes, we created new opportunities for interrogations of cellular and circuit substrates that can be important for motor function and dysfunction.SIGNIFICANCE STATEMENT Within the basal ganglia, the external globus pallidus (GPe) has long been recognized for its involvement in motor control. However, we lacked an understanding of precisely how movement is controlled at the GPe level as a result of its cellular complexity. In this study, by using transgenic and cell-specific approaches, we showed that genetically-defined GPe neuron subtypes have distinct roles in regulating motor patterns. In addition, the in vivo contributions of these neuron subtypes are in part shaped by the local, inhibitory connections within the GPe. In sum, we have established the foundation for future investigations of motor function and disease pathophysiology.