The cortico-basal ganglia-thalamocortical circuit with synaptic plasticity. I. Modification rules for excitatory and inhibitory synapses in the striatum

Dark brain energy: Toward an integrative model of spontaneous slow oscillations

Neural oscillations facilitate the functioning of the human brain in spatial and temporal dimensions at various frequencies. These oscillations feature a universal frequency architecture that is governed by brain anatomy, ensuring frequency specificity remains invariant across different measurement techniques. Initial magnetic resonance imaging (MRI) methodology constrained functional MRI (fMRI) investigations to a singular frequency range, thereby neglecting the frequency characteristics inherent in blood oxygen level-dependent oscillations. With advancements in MRI technology, it has become feasible to decode intricate brain activities via multi-band frequency analysis (MBFA). During the past decade, the utilization of MBFA in fMRI studies has surged, unveiling frequency-dependent characteristics of spontaneous slow oscillations (SSOs) believed to base dark energy in the brain. There remains a dearth of conclusive insights and hypotheses pertaining to the properties and functionalities of SSOs in distinct bands. We surveyed the SSO MBFA studies during the past 15 years to delineate the attributes of SSOs and enlighten their correlated functions. We further proposed a model to elucidate the hierarchical organization of multi-band SSOs by integrating their function, aimed at bridging theoretical gaps and guiding future MBFA research endeavors.

Central cholinergic transmission affects the compulsive-like behavior of mice in marble-burying test

The presence of the cholinergic system in the brain areas implicated in the precipitation of obsessive-compulsive behavior (OCB) has been reported but the exact role of the central cholinergic system therein is still unexplored. Therefore, the current study assessed the effect of cholinergic analogs on central administration on the marble-burying behavior (MBB) of mice, a behavior correlated with OCB. The result reveals that the enhancement of central cholinergic transmission in mice achieved by intracerebroventricular (i.c.v.) injection of acetylcholine (0.01 µg) (Subeffective: 0.1 and 0.5 µg), cholinesterase inhibitor, neostigmine (0.1, 0.3, 0.5 µg/mouse) and neuronal nicotinic acetylcholine receptor agonist, nicotine (0.1, 2 µg/mouse) significantly attenuated the number of marbles buried by mice in MBB test without affecting basal locomotor activity. Similarly, central injection of mAChR antagonist, atropine (0.1, 0.5, 5 µg/mouse), nAChR antagonist, mecamylamine (0.1, 0.5, 3 µg/mouse) per se also reduced the MBB in mice, indicative of anti-OCB like effect of all the tested cholinergic mAChR or nAChR agonist and antagonist. Surprisingly, i.c.v. injection of acetylcholine (0.01 µg), and neostigmine (0.1 µg) failed to elicit an anti-OCB-like effect in mice pre-treated (i.c.v.) with atropine (0.1 µg), or mecamylamine (0.1 µg). Thus, the findings of the present investigationdelineate the role of central cholinergic transmission in the compulsive-like behavior of mice probably via mAChR or nAChR stimulation.

Response Systems, Antagonistic Responses, and the Behavioral Repertoire

While response systems are often mentioned in the behavioral and physiological literature, an explicit discussion of what response systems are is lacking. Here we argue that response systems can be understood as an interaction between anatomically constrained behavioral topographies occasioned by currently present stimuli and a history of reinforcement. “New” response systems can develop during the lifetime as the organism gains instrumental control of new fine-grained topographies. Within this framework, antagonistic responses compete within each response system based on environmental stimulation, and competition is resolved at the striatum-thalamo-cortical loops level. While response systems can be by definition independent from one another, separate systems are often recruited at the same time to engage in complex responses, which themselves may be selected by reinforcement as functional units.

Bifurcation analyses and potential landscapes of a cortex-basal ganglia-thalamus model

The dynamics of cortical neuronal activity plays important roles in controlling body movement and is regulated by connection weights between neurons in a cortex–basal ganglia–thalamus (BGCT) loop. Beta‐band oscillation of cortical activity is closely associated with the movement disorder of Parkinson's disease, which is caused by an imbalance in the connection weights of direct and indirect pathways in the BGCT loop. In this study, the authors investigate how the dynamics of cortical activity are modulated by connection weights of direct and indirect pathways in the BGCT loop under low dopamine levels through bifurcation analyses and potential landscapes. The results reveal that cortical activity displays rich dynamics under different connection weights, including one, two, or three stable steady states, one or two stable limit cycles, and the coexistence of one stable limit cycle with one stable steady state or two stable ones. For a low dopamine level, cortical activity exhibits oscillation for larger connection weights of direct and indirect pathways. The stability of these stable dynamics is explored by the potential landscapes.

A Brain-Inspired Decision-Making Spiking Neural Network and Its Application in Unmanned Aerial Vehicle

Decision-making is a crucial cognitive function for various animal species surviving in nature, and it is also a fundamental ability for intelligent agents. To make a step forward in the understanding of the computational mechanism of human-like decision-making, this paper proposes a brain-inspired decision-making spiking neural network (BDM-SNN) and applies it to decision-making tasks on intelligent agents. This paper makes the following contributions: (1) A spiking neural network (SNN) is used to model human decision-making neural circuit from both connectome and functional perspectives. (2) The proposed model combines dopamine and spike-timing-dependent plasticity (STDP) mechanisms to modulate the network learning process, which indicates more biological inspiration. (3) The model considers the effects of interactions among sub-areas in PFC on accelerating the learning process. (4) The proposed model can be easily applied to decision-making tasks in intelligent agents, such as an unmanned aerial vehicle (UAV) flying through a window and a UAV avoiding an obstacle. The experimental results support the effectiveness of the model. Compared with traditional reinforcement learning and existing biologically inspired methods, our method contains more biologically-inspired mechanistic principles, has greater accuracy and is faster.

Quantification of motor network dynamics in Parkinson's disease by means of landscape and flux theory

The basal ganglia neural circuit plays an important role in motor control. Despite the significant efforts, the understanding of the principles and underlying mechanisms of this modulatory circuit and the emergence of abnormal synchronized oscillations in movement disorders is still challenging. Dopamine loss has been proved to be responsible for Parkinson's disease. We quantitatively described the dynamics of the basal ganglia-thalamo-cortical circuit in Parkinson's disease in terms of the emergence of both abnormal firing rates and firing patterns in the circuit. We developed a potential landscape and flux framework for exploring the modulatory circuit. The driving force of the circuit can be decomposed into a gradient of the potential, which is associated with the steady-state probability distributions, and the curl probability flux term. We uncovered the underlying potential landscape as a Mexican hat-shape closed ring valley where abnormal oscillations emerge due to dopamine depletion. We quantified the global stability of the network through the topography of the landscape in terms of the barrier height, which is defined as the potential difference between the maximum potential inside the ring and the minimum potential along the ring. Both a higher barrier and a larger flux originated from detailed balance breaking result in more stable oscillations. Meanwhile, more energy is consumed to support the increasing flux. Global sensitivity analysis on the landscape topography and flux indicates how changes in underlying neural network regulatory wirings and external inputs influence the dynamics of the system. We validated two of the main hypotheses(direct inhibition hypothesis and output activation hypothesis) on the therapeutic mechanism of deep brain stimulation (DBS). We found GPe appears to be another effective stimulated target for DBS besides GPi and STN. Our approach provides a general way to quantitatively explore neural networks and may help for uncovering more efficacious therapies for movement disorders.

A perspective on neural and cognitive mechanisms of error commission

Behavioral adaptation and cognitive control are crucial for goal-reaching behaviors. Every creature is ubiquitously faced with choices between behavioral alternatives. Common sense suggests that errors are an important source of information in the regulation of such processes. Several theories exist regarding cognitive control and the processing of undesired outcomes. However, most of these models focus on the consequences of an error, and less attention has been paid to the mechanisms that underlie the commissioning of an error. In this article, we present an integrative review of neuro-cognitive models that detail the determinants of the occurrence of response errors. The factors that may determine the likelihood of committing errors are likely related to the stability of task-representations in prefrontal networks, attentional selection mechanisms and mechanisms of action selection in basal ganglia circuits. An important conclusion is that the likelihood of committing an error is not stable over time but rather changes depending on the interplay of different functional neuro-anatomical and neuro-biological systems. We describe factors that might determine the time-course of cognitive control and the need to adapt behavior following response errors. Finally, we outline the mechanisms that may proof useful for predicting the outcomes of cognitive control and the emergence of response errors in future research.

The role of dopamine-dependent negative feedback in the hippocampus-basal ganglia-thalamus-hippocampus loop in the extinction of responses

A mechanism for the extinction of the responses of hippocampal and dopaminergic neurons to repeated sensory stimuli is proposed, based on dopamine-dependent negative feedback in the hippocampus-basal ganglia-thalamus-hippocampus loop. Activation of hippocampal neurons evoked by a new stimulus facilitates the appearance of responses in dopaminergic neurons as a result of disinhibition via striopallidal cells of the nucleus accumbens and ventral pallidum. However, increases in dopamine levels and activation of D2 receptors on striopallidal cells, facilitating depression of hippocampal inputs, prevent disinhibition of dopaminergic neurons, such that their responses start to decline. Subsequent reductions in actions on D1 receptors lead to decreases in the efficiency of excitation both of neurons in hippocampal field CA1 and strionigral cells in the nucleus accumbens. The direct pathway via the basal ganglia mediates disinhibition of the thalamic nucleus reuniens, exciting neurons in field CA1, which leads to extinction of the responses of hippocampal neurons, decreases in disinhibition of dopaminergic cells, and further extinction of their responses.

A hypothetical role of cortico-basal ganglia-thalamocortical loops in visual processing

The goal of the present work was to define the mechanisms underlying the contribution of sensory and limbic cortico-basal ganglia-thalamocortical loops to visual processing and its attentional modulation. We proposed that visual processing is promoted by dopamine-dependent long-term modifications of synaptic transmission in the basal ganglia that favour a selection of neocortical patterns representing a visual stimulus. This selection is the result of the opposite sign of modulation of strong and weak cortico-basal ganglia inputs and subsequent activity reorganization in each loop. Reorganization leads to disinhibition/inhibition of cortical neurons strongly/weakly excited by stimulus during dopamine release. Recruitment of the thalamo-basal ganglia-collicular pathway is proposed to be necessary for stimulus-evoked dopamine release that underlies bottom-up attentional effects. Visual excitation of the prefrontal cortex and hippocampus (via the thalamus), their cooperation in control of the basal ganglia and dopaminergic cell firing, and simultaneous modulation of activity in diverse cortico-basal ganglia-thalamocortical loops is proposed to underlie top-down attentional effects. It follows from our model that only those components of cortical responses can be modulated by attention, whose onset exceeds the latency of visual responses of dopaminergic cells (50-110 ms). This and other consequences of the model are in accordance with known experimental data.

Collateralization of the tectonigral projection with other major output pathways of superior colliculus in the rat

Dopaminergic (DA) neurons exhibit a short-latency, phasic response to unexpected, biologically salient stimuli. The superior colliculus (SC) is also sensitive to such stimuli and sends a projection directly to DA-containing regions of the ventral midbrain. Recent evidence suggests that the SC is a critical relay for transmitting short-latency visual information to DA neurons. An important question is whether the ventral midbrain is an exclusive target of tectonigral neurons, or whether the tectonigral projection is a collateral branch of other tectofugal pathways. Double-label retrograde anatomical tracing techniques were used to address this issue. Injections of either Diamidino Yellow or Fluorogold into substantia nigra pars compacta (SNc) were combined with larger injections of True Blue into one of the following efferent projections of the SC: 1) target regions of the ipsilateral ascending projection to the thalamus; 2) the crossed descending tecto-reticulo-spinal pathway; 3) target structures of the ipsilateral descending projection; and 4) the contralateral superior colliculus. Moderate numbers of double-labeled neurons were observed following combined injections into substantia nigra and individual nuclei in the thalamus (ventromedial nucleus, 21.3%; central lateral, 18.4%; parafasicular nucleus 6.0%). Much less double-labeling was associated with injections into either of the descending projections (crossed, 1.0-3.2%; uncrossed, 0.2-2.7%) or the contralateral SC (0.7-1.9%). These results suggest: i) the SC may provide a coordinated input concerning the occurrence of unpredicted sensory events to both the substantia nigra and striatum (via the thalamus); and ii) few gaze-related motor signals are simultaneously relayed to DA-containing regions of the ventral midbrain.

A possible mechanism for the effect of modifiable lateral inhibition in the striatum on the selection of conditioned reflex motor responses

A mechanism is proposed for the effects of striatal dopamine-modifiable lateral inhibition on the selection of conditioned reflex motor responses. According to this mechanism, activation of dopamine D1 (D2) receptors on strionigral (striopallidal) neurons facilitates long-term depression (potentiation) of the inhibitory inputs simultaneously with potentiation (depression) of the excitatory inputs, of sufficient strength to open NMDA channels. For " weak" excitation, insufficient to open NMDA channels, the modification rules were of the opposite sign. Activation of presynaptic D2 (D1) receptors leads to decreases (increases) in GABA release from strionigral (striopallidal) axon terminals innervating strionigral (striopallidal) cells. As a result, dopamine-modifiable lateral inhibition simultaneously increases both the potentiation (depression) of the excitatory inputs to "strongly" activated strionigral (striopallidal) neurons, increasing (decreasing) their activity, and increases the depression (potentiation) of the excitatory inputs to the "weakly" activated strionigral (striopallidal) neurons, decreasing (increasing) their activity. Subsequent reorganization of neuron activity in the cortex-basal ganglia-thalamus-cortex circuit facilitates selection of conditioned reflex motor responses by further increasing (decreasing) the activity of those motor cortex neurons which were "strongly" ("weakly") excited by the striatum in conditions of dopamine release in response to the conditioned stimulus.

Possible Mechanisms of the Involvement of Dopaminergic Cells and Cholinergic Interneurons in the Striatum in the Conditioned-Reflex Selection of Motor Activity

A possible mechanism for the involvement of cholinergic interneurons in the striatum and dopaminergic cells in the substantia nigra in the selection from among several types of motor activity during learning is proposed. Selection is triggered by simultaneous increases in the activity of dopaminergic neurons and a pause in the activity of cholinergic interneurons in response to the conditioned signal. The appearance of the pause may facilitate activation of GABAergic interneurons in the striatum and the action of dopamine on D2 receptors on cholinergic interneurons. Differently directed changes in dopamine and acetylcholine levels synergistically modulate the efficiency of corticostriatal inputs, such that the rules for modulation of the "strong" and "weak" inputs are opposite in sign. The subsequent reorganization of neuron activity in the cortex-basal ganglia-thalamus-cortex circuit leads to increased activity in those cortical neurons providing "strong" innervation to the striatum with simultaneous decreases in the activity of neurons providing "weak" innervation to the striatum, which may underlie the selection of the movement reaction, in which the neocortex is involved. It follows from this model that if the delay between the conditioned and unconditioned stimuli is not longer than the latent period of the reactions of dopaminergic and cholinergic cells (about 100 msec), selection of movement activity in response to the conditioned signal and learning is hindered.

A possible mechanism for the effect of neuromodulators and modifiable inhibition on long-term potentiation and depression of the excitatory inputs to hippocampal principal cells

A postsynaptic mechanism for the influences of various neuromodulators and modifiable disynaptic inhibition on long-term potentiation and depression of the excitatory inputs to granule and pyramidal neurons in the hippocampus is described. According to this mechanism, facilitation of the induction of long-term depression/potentiation at the excitatory input to the inhibitory interneuron induced by the action of a neuromodulator on a receptor bound to a G(i/0)/(Gs or G(q/11)) protein can lead to decreases/increases in GABA release, weakening/strengthening of the inhibitory action on the target cell, and improvement in the conditions for induction of long-term potentiation/depression of the excitatory input to this cell. In the absence of inhibition, the same neuromodulator, activating the same type of receptors on the target cell, would facilitate induction of long-term depression/potentiation in that cell. The resultant effect of the action of the neuromodulator on the target cell depends on the ratio of the "strengths" of the excitatory and inhibitory inputs to the cell, on the presence on the interneuron and the target cell of the same or different types of receptors sensitive to this neurumodulator, and on the concentration of the neurumodulator, because of its different affinities for the receptors through which its differently directed effects on postsynaptic processes are mediated. Predictions based on this mechanism are in agreement with known experimental data.

The involvement of dopamine in strengthening cortical signals activating NMDA receptors in the striatum (a hypothetical mechanism)

A possible mechanism is proposed for the enhancement/weakening of those cortical signals in the cortex-basal ganglia-thalamus-cortex neural network which induce/do not induce opening of NMDA channels in the spiny neurons of the striatum and which can be regarded as "strong"/"weak" in terms of this measure. The mechanism is based on the modulatory influences of dopamine on changes in the efficiency of corticostriatal inputs. In the absence of dopamine, relative increases in the intensity of "strong" ("weak") cortical signals can lead to the induction of long-term potentiation (depression) of corticostriatal synapses. In this case, because of the differently directed influences on thalamic cells of signals passing via strionigral and striopallidal cells, "strong" signals at the output of the thalamus are weakened, while "weak" signals are strengthened. Activation of dopamine D1 (D2) receptors on strionigral (striopallidal) neurons may facilitate increases in the extent of long-term potentiation/depression (decreases in the extent of long-term potentiation/depression or induction of long-term potentiation/depression). The consequence of this is that "strong" signals at the output of the thalamus can be strengthened synergistically, while "weak" signals can be weakened synergistically. Background cortical signals evoking tonic release of dopamine in the striatum can decrease strengthening because of weakening of the modulatory influence of dopamine on the modification of corticostriatal synapses.

The cortico-basal ganglia-thalamocortical circuit with synaptic plasticity. II. Mechanism of synergistic modulation of thalamic activity via the direct and indirect pathways through the basal ganglia

A possible mechanism underlying the modulatory role of dopamine, adenosine and acetylcholine in the modification of corticostriatal synapses, subsequent changes in signal transduction through the "direct" and "indirect" pathways in the basal ganglia and variations in thalamic and neocortical cell activity is proposed. According to this mechanism, simultaneous activation of dopamine D1/D2 receptors as well as inactivation of adenosine A1/A(2A) receptors or muscarinic M4/M1 receptors on striatonigral/striatopallidal inhibitory cells can promote the induction of long-term potentiation/depression in the efficacy of excitatory cortical inputs to these cells. Subsequently augmented inhibition of the activity of inhibitory neurons of the output nuclei of the basal ganglia through the "direct" pathway together with reduced disinhibition of these nuclei through the "indirect" pathway synergistically increase thalamic and neocortical cell firing. The proposed mechanism can underlie such well known effects as "excitatory" and "inhibitory" influence of dopamine on striatonigral and striatopallidal cells, respectively; the opposite action of dopamine and adenosine on these cells; antiparkinsonic effects of dopamine receptor agonists and adenosine or acetylcholine muscarinic receptor antagonists.