1
|
de Bartolomeis A, Ciccarelli M, De Simone G, Mazza B, Barone A, Vellucci L. Canonical and Non-Canonical Antipsychotics' Dopamine-Related Mechanisms of Present and Next Generation Molecules: A Systematic Review on Translational Highlights for Treatment Response and Treatment-Resistant Schizophrenia. Int J Mol Sci 2023; 24:ijms24065945. [PMID: 36983018 PMCID: PMC10051989 DOI: 10.3390/ijms24065945] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2023] [Revised: 03/15/2023] [Accepted: 03/17/2023] [Indexed: 03/30/2023] Open
Abstract
Schizophrenia is a severe psychiatric illness affecting almost 25 million people worldwide and is conceptualized as a disorder of synaptic plasticity and brain connectivity. Antipsychotics are the primary pharmacological treatment after more than sixty years after their introduction in therapy. Two findings hold true for all presently available antipsychotics. First, all antipsychotics occupy the dopamine D2 receptor (D2R) as an antagonist or partial agonist, even if with different affinity; second, D2R occupancy is the necessary and probably the sufficient mechanism for antipsychotic effect despite the complexity of antipsychotics' receptor profile. D2R occupancy is followed by coincident or divergent intracellular mechanisms, implying the contribution of cAMP regulation, β-arrestin recruitment, and phospholipase A activation, to quote some of the mechanisms considered canonical. However, in recent years, novel mechanisms related to dopamine function beyond or together with D2R occupancy have emerged. Among these potentially non-canonical mechanisms, the role of Na2+ channels at the dopamine at the presynaptic site, dopamine transporter (DAT) involvement as the main regulator of dopamine concentration at synaptic clefts, and the putative role of antipsychotics as chaperones for intracellular D2R sequestration, should be included. These mechanisms expand the fundamental role of dopamine in schizophrenia therapy and may have relevance to considering putatively new strategies for treatment-resistant schizophrenia (TRS), an extremely severe condition epidemiologically relevant and affecting almost 30% of schizophrenia patients. Here, we performed a critical evaluation of the role of antipsychotics in synaptic plasticity, focusing on their canonical and non-canonical mechanisms of action relevant to the treatment of schizophrenia and their subsequent implication for the pathophysiology and potential therapy of TRS.
Collapse
Affiliation(s)
- Andrea de Bartolomeis
- Section of Psychiatry, Laboratory of Translational and Molecular Psychiatry and Unit of Treatment-Resistant Psychosis, Department of Neuroscience, Reproductive Sciences and Dentistry, University Medical School of Naples "Federico II", 80131 Naples, Italy
| | - Mariateresa Ciccarelli
- Section of Psychiatry, Laboratory of Translational and Molecular Psychiatry and Unit of Treatment-Resistant Psychosis, Department of Neuroscience, Reproductive Sciences and Dentistry, University Medical School of Naples "Federico II", 80131 Naples, Italy
| | - Giuseppe De Simone
- Section of Psychiatry, Laboratory of Translational and Molecular Psychiatry and Unit of Treatment-Resistant Psychosis, Department of Neuroscience, Reproductive Sciences and Dentistry, University Medical School of Naples "Federico II", 80131 Naples, Italy
| | - Benedetta Mazza
- Section of Psychiatry, Laboratory of Translational and Molecular Psychiatry and Unit of Treatment-Resistant Psychosis, Department of Neuroscience, Reproductive Sciences and Dentistry, University Medical School of Naples "Federico II", 80131 Naples, Italy
| | - Annarita Barone
- Section of Psychiatry, Laboratory of Translational and Molecular Psychiatry and Unit of Treatment-Resistant Psychosis, Department of Neuroscience, Reproductive Sciences and Dentistry, University Medical School of Naples "Federico II", 80131 Naples, Italy
| | - Licia Vellucci
- Section of Psychiatry, Laboratory of Translational and Molecular Psychiatry and Unit of Treatment-Resistant Psychosis, Department of Neuroscience, Reproductive Sciences and Dentistry, University Medical School of Naples "Federico II", 80131 Naples, Italy
| |
Collapse
|
2
|
Mandali A, Rengaswamy M, Chakravarthy VS, Moustafa AA. A spiking Basal Ganglia model of synchrony, exploration and decision making. Front Neurosci 2015; 9:191. [PMID: 26074761 PMCID: PMC4444758 DOI: 10.3389/fnins.2015.00191] [Citation(s) in RCA: 44] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2014] [Accepted: 05/12/2015] [Indexed: 12/31/2022] Open
Abstract
To make an optimal decision we need to weigh all the available options, compare them with the current goal, and choose the most rewarding one. Depending on the situation an optimal decision could be to either “explore” or “exploit” or “not to take any action” for which the Basal Ganglia (BG) is considered to be a key neural substrate. In an attempt to expand this classical picture of BG function, we had earlier hypothesized that the Indirect Pathway (IP) of the BG could be the subcortical substrate for exploration. In this study we build a spiking network model to relate exploration to synchrony levels in the BG (which are a neural marker for tremor in Parkinson's disease). Key BG nuclei such as the Sub Thalamic Nucleus (STN), Globus Pallidus externus (GPe) and Globus Pallidus internus (GPi) were modeled as Izhikevich spiking neurons whereas the Striatal output was modeled as Poisson spikes. The model is cast in reinforcement learning framework with the dopamine signal representing reward prediction error. We apply the model to two decision making tasks: a binary action selection task (similar to one used by Humphries et al., 2006) and an n-armed bandit task (Bourdaud et al., 2008). The model shows that exploration levels could be controlled by STN's lateral connection strength which also influenced the synchrony levels in the STN-GPe circuit. An increase in STN's lateral strength led to a decrease in exploration which can be thought as the possible explanation for reduced exploratory levels in Parkinson's patients. Our simulations also show that on complete removal of IP, the model exhibits only Go and No-Go behaviors, thereby demonstrating the crucial role of IP in exploration. Our model provides a unified account for synchronization, action section, and explorative behavior.
Collapse
Affiliation(s)
- Alekhya Mandali
- Computational Neuroscience Lab, Department of Biotechnology, Bhupat and Mehta School of BioSciences, Indian Institute of Technology Madras Chennai, India
| | - Maithreye Rengaswamy
- Computational Neuroscience Lab, Department of Biotechnology, Bhupat and Mehta School of BioSciences, Indian Institute of Technology Madras Chennai, India
| | - V Srinivasa Chakravarthy
- Computational Neuroscience Lab, Department of Biotechnology, Bhupat and Mehta School of BioSciences, Indian Institute of Technology Madras Chennai, India
| | - Ahmed A Moustafa
- Marcs Institute for Brain and Behaviour and School of Social Sciences and Psychology, University of Western Sydney Sydney, NSW, Australia
| |
Collapse
|
3
|
Medeiros P, Viana M, Barbosa-Silva R, Tonelli L, Melo-Thomas L. Glutamatergic neurotransmission in the inferior colliculus influences intrastriatal haloperidol-induced catalepsy. Behav Brain Res 2014; 268:8-13. [DOI: 10.1016/j.bbr.2014.03.027] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2014] [Revised: 03/13/2014] [Accepted: 03/15/2014] [Indexed: 12/23/2022]
|
4
|
Muralidharan V, Balasubramani PP, Chakravarthy VS, Lewis SJG, Moustafa AA. A computational model of altered gait patterns in parkinson's disease patients negotiating narrow doorways. Front Comput Neurosci 2014; 7:190. [PMID: 24409137 PMCID: PMC3885812 DOI: 10.3389/fncom.2013.00190] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2013] [Accepted: 12/21/2013] [Indexed: 11/30/2022] Open
Abstract
We present a computational model of altered gait velocity patterns in Parkinson's Disease (PD) patients. PD gait is characterized by short shuffling steps, reduced walking speed, increased double support time and sometimes increased cadence. The most debilitating symptom of PD gait is the context dependent cessation in gait known as freezing of gait (FOG). Cowie et al. (2010) and Almeida and Lebold (2010) investigated FOG as the changes in velocity profiles of PD gait, as patients walked through a doorway with variable width. The former reported a sharp dip in velocity, a short distance from the doorway that was greater for narrower doorways. They compared the gait performance in PD freezers at ON and OFF dopaminergic medication. In keeping with this finding, the latter also reported the same for ON medicated PD freezers and non-freezers. In the current study, we sought to simulate these gait changes using a computational model of Basal Ganglia based on Reinforcement Learning, coupled with a spinal rhythm mimicking central pattern generator (CPG) model. In the model, a simulated agent was trained to learn a value profile over a corridor leading to the doorway by repeatedly attempting to pass through the doorway. Temporal difference error in value, associated with dopamine signal, was appropriately constrained in order to reflect the dopamine-deficient conditions of PD. Simulated gait under PD conditions exhibited a sharp dip in velocity close to the doorway, with PD OFF freezers showing the largest decrease in velocity compared to PD ON freezers and controls. PD ON and PD OFF freezers both showed sensitivity to the doorway width, with narrow door producing the least velocity/ stride length. Step length variations were also captured with PD freezers producing smaller steps and larger step-variability than PD non-freezers and controls. In addition this model is the first to explain the non-dopamine dependence for FOG giving rise to several other possibilities for its etiology.
Collapse
Affiliation(s)
- Vignesh Muralidharan
- Department of Biotechnology, Indian Institute of Technology Madras Chennai, India
| | | | | | - Simon J G Lewis
- Parkinson's Disease Research Clinic, Brain and Mind Research Institute, The University of Sydney Sydney, NSW, Australia
| | - Ahmed A Moustafa
- Marcs Institute for Brain and Behaviour and School of Social Sciences and Psychology, University of Western Sydney Sydney, NSW, Australia
| |
Collapse
|
5
|
Why social attachment and oxytocin protect against addiction and stress: Insights from the dynamics between ventral and dorsal corticostriatal systems. Pharmacol Biochem Behav 2013; 119:39-48. [PMID: 23916423 DOI: 10.1016/j.pbb.2013.07.015] [Citation(s) in RCA: 114] [Impact Index Per Article: 9.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/26/2013] [Revised: 06/29/2013] [Accepted: 07/22/2013] [Indexed: 12/14/2022]
Abstract
The present article advances a neurobiological model of the reciprocal associations between social attachment and drug abuse, and social attachment and chronic stress, as overlapping systems are involved in stress coping and social attachment. In terms of coping, responding to a novel stressor or challenge involves initial novelty processing and activation of learning mechanisms that allow habituation to the stressor through familiarization. Similarly, social attachments are initially formed by being attracted by rewarding properties of an as-yet novel individual, and subsequently developing feelings of attachment towards the familiarized individual. Attachment and familiarization increase the availability of "internal working models" for the control of behavior and emotion, which may explain why secure attachments are associated with increased resilience in the face of stress, accompanied by less reactive reward responding (i.e., increased resilience against drug addiction). The present article seeks to illuminate the role of the neuropeptide oxytocin, which may be involved in the overlapping mechanisms of stable attachment formation and stress coping by shifting processing from novelty and reward seeking to appreciation of familiarity. Oxytocin may accomplish this by facilitating a ventral-to-dorsal shift in activation in corticostriatal loops, which produces a shift from a reactive reward drive (wanting) to stable appreciation of familiar social aspects ("liking" or "loving"). The authors suggest that through dopaminergic, serotonergic and endogenous opioid mechanisms, oxytocin is involved in shifting the balance between wanting and liking in corticostriatal loops by facilitating consolidation of social information from ventral reactive reward systems to dorsal internal working models that aid in prospectively selecting optimal actions in the future, increasing resilience in the face of stress and addiction.
Collapse
|
6
|
Krishnan R, Ratnadurai S, Subramanian D, Chakravarthy VS, Rengaswamy M. Modeling the role of basal ganglia in saccade generation: is the indirect pathway the explorer? Neural Netw 2011; 24:801-13. [PMID: 21726978 DOI: 10.1016/j.neunet.2011.06.002] [Citation(s) in RCA: 18] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2010] [Revised: 04/25/2011] [Accepted: 06/02/2011] [Indexed: 11/28/2022]
Abstract
We model the role played by the Basal Ganglia (BG) in the generation of voluntary saccadic eye movements. The BG model explicitly represents key nuclei like the striatum (caudate), Substantia Nigra pars reticulata (SNr) and compata (SNc), the Subthalamic Nucleus (STN), the two pallidal nuclei and Superior Colliculus. The model is cast within the Reinforcement Learning (RL) framework, with the dopamine representing the temporal difference error, the striatum serving as the critic, and the indirect pathway playing the role of the explorer. Performance of the model is evaluated on a set of tasks such as feature and conjunction searches, directional selectivity and a successive saccade task. Behavioral phenomena such as independence of search time on number of distractors in feature search and linear increase in search time with number of distractors in conjunction search are observed. It is also seen that saccadic reaction times are longer and search efficiency is impaired on diminished BG contribution, which corroborates with reported data obtained from Parkinson's Disease (PD) patients.
Collapse
Affiliation(s)
- R Krishnan
- Indian Institute of Management, Ahmedabad, India
| | | | | | | | | |
Collapse
|
7
|
Joseph D, Gangadhar G, Srinivasa Chakravarthy V. ACE (Actor–Critic–Explorer) paradigm for reinforcement learning in basal ganglia: Highlighting the role of subthalamic and pallidal nuclei. Neurocomputing 2010. [DOI: 10.1016/j.neucom.2010.03.001] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
8
|
Chakravarthy VS, Joseph D, Bapi RS. What do the basal ganglia do? A modeling perspective. BIOLOGICAL CYBERNETICS 2010; 103:237-253. [PMID: 20644953 DOI: 10.1007/s00422-010-0401-y] [Citation(s) in RCA: 124] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/03/2009] [Accepted: 07/01/2010] [Indexed: 05/29/2023]
Abstract
Basal ganglia (BG) constitute a network of seven deep brain nuclei involved in a variety of crucial brain functions including: action selection, action gating, reward based learning, motor preparation, timing, etc. In spite of the immense amount of data available today, researchers continue to wonder how a single deep brain circuit performs such a bewildering range of functions. Computational models of BG have focused on individual functions and fail to give an integrative picture of BG function. A major breakthrough in our understanding of BG function is perhaps the insight that activities of mesencephalic dopaminergic cells represent some form of 'reward' to the organism. This insight enabled application of tools from 'reinforcement learning,' a branch of machine learning, in the study of BG function. Nevertheless, in spite of these bright spots, we are far from the goal of arriving at a comprehensive understanding of these 'mysterious nuclei.' A comprehensive knowledge of BG function has the potential to radically alter treatment and management of a variety of BG-related neurological disorders (Parkinson's disease, Huntington's chorea, etc.) and neuropsychiatric disorders (schizophrenia, obsessive compulsive disorder, etc.) also. In this article, we review the existing modeling literature on BG and hypothesize an integrative picture of the function of these nuclei.
Collapse
Affiliation(s)
- V S Chakravarthy
- Department of Biotechnology, Indian Institute of Technology, Madras, Chennai 600036, India.
| | | | | |
Collapse
|
9
|
Haloperidol induces higher Homer1a expression than risperidone, olanzapine and sulpiride in striatal sub-regions. Psychiatry Res 2010; 177:255-60. [PMID: 20304506 DOI: 10.1016/j.psychres.2010.02.009] [Citation(s) in RCA: 34] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/19/2009] [Revised: 02/09/2010] [Accepted: 02/11/2010] [Indexed: 11/21/2022]
Abstract
Homer1a and Yotiao are two post-synaptic density proteins at the crossroad of dopamine-glutamate neurotransmission. Homer1a has been implicated in the pathophysiology of schizophrenia and is differentially induced by typical and atypical antipsychotics, perhaps according to their dopaminergic profile. Yotiao has been involved in glutamate and dopamine post-synaptic signalling. Here, we seek to determine whether Homer1a and Yotiao might be implicated in post-synaptic response to antipsychotics with affinity to different dopamine D(2) receptors: haloperidol (0.8mg kg(-1)), risperidone (3mg kg(-1)), olanzapine (2.5mg kg(-1)) and (-)-sulpiride (50mg kg(-1)). Homer1a expression was significantly induced by haloperidol compared to vehicle and to atypical antipsychotics in almost all striatal sub-regions. Atypical antipsychotics induced the gene in the lateral putamen and in the core of the accumbens only. All antipsychotics, with the exclusion of sulpiride, elicited a dorsolateral-to-ventromedial distribution pattern of Homer1a expression. No significant induction was detected for Yotiao. These results suggest that the quantitative and topographical pattern of Homer1a expression may putatively be related to antipsychotics affinity and/or occupancy at dopamine D(2) receptors.
Collapse
|
10
|
Differential effects of methamphetamine and SCH23390 on the expression of members of IEG families of transcription factors in the rat striatum. Brain Res 2010; 1318:1-10. [PMID: 20059987 DOI: 10.1016/j.brainres.2009.12.083] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2009] [Revised: 12/28/2009] [Accepted: 12/29/2009] [Indexed: 11/21/2022]
Abstract
Methamphetamine (METH) is a psychostimulant that can cause long-lasting neurodegenerative effects in humans and animals. These toxic effects appear to occur, in part, via activation of dopamine (DA) D1 receptors. This paper assessed the possibility that the DA D1 receptor antagonist, SCH23390, might inhibit METH-induced changes in the expression of several members of immediate early genes (IEGs) which are known to control more delayed expression of other genes. We found that injections of METH (4x10 mg/kg, given at 2 h intervals) caused significant increases in c-fos and fra-2 expression which lasted from 30 min to 4 h. Pre-treatment with SCH23390, given 30 min before each METH injection, completely blocked METH-induced expression of c-fos, but only partially inhibited fra-2 mRNA expression. These results were confirmed by Western blot analysis which showed METH-induced changes in c-Fos protein expression that were blocked by pretreatment with SCH23390. There were also delayed METH-induced DA D1 receptor-dependent effects on fosB mRNA expression. Even though fra-1 expression was not affected by pretreatment with METH alone, the repeated injections of SCH23390 caused substantial decreases in fra-1 mRNA expression in both the presence and absence of METH. The repeated injections of METH caused no changes in the mRNAs for c-jun, junB or junD. However, there were significant increases in the phosphorylation of c-Jun protein (ser63). Phosphorylation of c-Jun occurred in a delayed fashion (16 and 24 h after the last METH injections) and was attenuated by SCH23390 pretreatment. Interestingly, SCH23390 given alone caused significant decreases in phospho-c-Jun at all time-points. The METH injections also caused delayed induction in the expression of members of the Egr family of transcription factors in a DA D1 receptor-dependent fashion. Repeated injections of SCH23390 caused substantial suppression of basal striatal egr-1 and egr-2 mRNA expression but not of that of egr-3. Both crem and arc mRNA levels were induced by METH in a SCH23390-sensitive fashion. Moreover, multiple injections of SCH23390 given alone caused marked inhibition of basal arc expression. These results show that multiple injections of METH can differentially affect the expression of several IEGs, some of which occurred in a DA D1 receptor dependent fashion. The SCH23390-mediated suppression of basal fra-1, egr-1, and egr-2 mRNA levels suggests that their basal expression in the striatum might be dependent on tonic stimulation of the DA D1 receptor.
Collapse
|
11
|
Wickens JR. Synaptic plasticity in the basal ganglia. Behav Brain Res 2008; 199:119-28. [PMID: 19026691 DOI: 10.1016/j.bbr.2008.10.030] [Citation(s) in RCA: 87] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2008] [Revised: 10/23/2008] [Accepted: 10/25/2008] [Indexed: 02/05/2023]
Abstract
Activity-dependent synaptic plasticity occurs in several parts of the basal ganglia. Increasing evidence supports the hypothesis that activity-dependent plasticity underlies the acquisition, maintenance, and extinction of certain types of learning in the basal ganglia. This review focuses on synaptic plasticity in the corticostriatal pathway. As in other systems, both long-term potentiation and long-term depression have been described, and intracellular calcium signalling plays an important role in the induction of plasticity. However, intracellular calcium levels do not appear to be the dominating control factor. Dopamine, via intracellular signalling cascades, also plays a crucial role in determining the magnitude and direction of plasticity, and in modulating the requirements for induction. Endocannabinoids also play an important role in mediating presynaptic expression of synaptic depression. Recent studies have highlighted spike-timing dependent plasticity phenomena, which also involve dopamine and endocannabinoid signalling. Despite significant progress in recent years, many important questions remain unanswered, especially in relation to long-term potentiation. Of particular interest is the question of how to link the molecular and cellular mechanisms of synaptic plasticity to learning operations at the systems level, which are expressed behaviourally as reinforcement-related learning.
Collapse
Affiliation(s)
- Jeffery R Wickens
- Neurobiology Research Unit, Okinawa Institute of Science and Technology, Initial Research Project, 12-22 Suzaki, Uruma, Okinawa 904-2234, Japan.
| |
Collapse
|
12
|
Hubert GW, Kuhar MJ. Colocalization of CART with substance P but not enkephalin in the rat nucleus accumbens. Brain Res 2005; 1050:8-14. [PMID: 15978559 DOI: 10.1016/j.brainres.2005.05.025] [Citation(s) in RCA: 28] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2005] [Revised: 04/29/2005] [Accepted: 05/03/2005] [Indexed: 11/15/2022]
Abstract
CART peptide is a novel neurotransmitter that, due to its distribution in the brain and its modulation of dopamine systems, may be involved in aspects of reward and drug abuse. In the nucleus accumbens (NAcc), CART peptide immunoreactivity (IR) is colocalized with substance P-IR in neurons. Approximately 86% of CART-IR cells colocalize with substance P, while only 19% of substance P-IR neurons contain CART. CART peptide does not colocalize with enkephalin-IR in this region. The substance P-CART colocalization exists in a rostro-caudal gradient with more colocalization in rostral regions. The presence of CART in substance P NAcc neurons suggests that CART neurons may be a subset of the basal ganglia direct pathway or that CART neurons are involved in limbic projections of the NAcc, such as to the ventral pallidum.
Collapse
Affiliation(s)
- George W Hubert
- Division of Neuroscience, Rm 3115 Yerkes National Research Center, 954 Gatewood Road, Atlanta, GA 30329, USA.
| | | |
Collapse
|
13
|
Wörgötter F, Porr B. Temporal sequence learning, prediction, and control: a review of different models and their relation to biological mechanisms. Neural Comput 2005; 17:245-319. [PMID: 15720770 DOI: 10.1162/0899766053011555] [Citation(s) in RCA: 147] [Impact Index Per Article: 7.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
In this review, we compare methods for temporal sequence learning (TSL) across the disciplines machine-control, classical conditioning, neuronal models for TSL as well as spike-timing-dependent plasticity (STDP). This review introduces the most influential models and focuses on two questions: To what degree are reward-based (e.g., TD learning) and correlation-based (Hebbian) learning related? and How do the different models correspond to possibly underlying biological mechanisms of synaptic plasticity? We first compare the different models in an open-loop condition, where behavioral feedback does not alter the learning. Here we observe that reward-based and correlation-based learning are indeed very similar. Machine control is then used to introduce the problem of closed-loop control (e.g., actor-critic architectures). Here the problem of evaluative (rewards) versus nonevaluative (correlations) feedback from the environment will be discussed, showing that both learning approaches are fundamentally different in the closed-loop condition. In trying to answer the second question, we compare neuronal versions of the different learning architectures to the anatomy of the involved brain structures (basal-ganglia, thalamus, and cortex) and the molecular biophysics of glutamatergic and dopaminergic synapses. Finally, we discuss the different algorithms used to model STDP and compare them to reward-based learning rules. Certain similarities are found in spite of the strongly different timescales. Here we focus on the biophysics of the different calcium-release mechanisms known to be involved in STDP.
Collapse
Affiliation(s)
- Florentin Wörgötter
- Department of Psychology, University of Stirling, Stirling FK9 4LA, Scotland.
| | | |
Collapse
|
14
|
Wickens J, Arbuthnott G. Chapter IV Structural and functional interactions in the striatum at the receptor level. HANDBOOK OF CHEMICAL NEUROANATOMY 2005. [DOI: 10.1016/s0924-8196(05)80008-9] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
|
15
|
Abstract
Knowledge of the effect of dopamine on corticostriatal synaptic plasticity has advanced rapidly over the last 5 years. We consider this new knowledge in relation to three factors proposed earlier to describe the rules for synaptic plasticity in the corticostriatal pathway. These factors are a phasic increase in dopamine release, presynaptic activity and postsynaptic depolarisation. A function is proposed which relates the amount of dopamine release in the striatum to the modulation of corticostriatal synaptic efficacy. It is argued that this function, and the experimental data from which it arises, are compatible with existing models which associate the reward-related firing of dopamine neurons with changes in corticostriatal synaptic efficacy.
Collapse
Affiliation(s)
- John N J Reynolds
- The Neuroscience Research Centre, University of Otago, Dunedin, New Zealand
| | | |
Collapse
|
16
|
Abstract
This paper presents a computational theory on the roles of the ascending neuromodulatory systems from the viewpoint that they mediate the global signals that regulate the distributed learning mechanisms in the brain. Based on the review of experimental data and theoretical models, it is proposed that dopamine signals the error in reward prediction, serotonin controls the time scale of reward prediction, noradrenaline controls the randomness in action selection, and acetylcholine controls the speed of memory update. The possible interactions between those neuromodulators and the environment are predicted on the basis of computational theory of metalearning.
Collapse
Affiliation(s)
- Kenji Doya
- ATR Human Information Science Laboratories, CREST, Japan Science and Technology Corporation, Kyoto.
| |
Collapse
|
17
|
Russell VA, de Villiers AS, Sagvolden T, Lamm MC, Taljaard JJ. Methylphenidate affects striatal dopamine differently in an animal model for attention-deficit/hyperactivity disorder--the spontaneously hypertensive rat. Brain Res Bull 2000; 53:187-92. [PMID: 11044595 DOI: 10.1016/s0361-9230(00)00324-5] [Citation(s) in RCA: 43] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/18/2022]
Abstract
The spontaneously hypertensive rat (SHR) is used as a model for attention-deficit/hyperactivity disorder (ADHD) because it has behavioural characteristics (hyperactivity, impulsiveness, poorly sustained attention) similar to those of ADHD. ADHD children have been shown to have reduced striatal activation in certain tasks. SHR have reduced striatal dopamine release in response to electrical stimulation. The present study set out to investigate possible long-term effects of methylphenidate treatment on dopaminergic function in striatal slices of SHR compared to their normotensive Wistar-Kyoto (WKY) control rats. Methylphenidate treatment (3 mg/kg daily for 14 days) did not normalize the decreased electrically-stimulated release of [(3)H]dopamine from SHR caudate-putamen slices nor did it affect postsynaptic D(2) receptor function. However, the second electrical stimulus caused a relatively greater release of [(3)H]dopamine from caudate-putamen slices of methylphenidate-treated SHR than from vehicle-treated SHR, suggesting that presynaptic mechanisms controlling dopamine release had been altered. Interestingly, [(3)H]dopamine release from WKY caudate-putamen slices in response to D(2) autoreceptor blockade by the antagonist, sulpiride, was selectively increased by methylphenidate treatment. This effect was not seen in SHR possibly because D(2) autoreceptor function had already been up-regulated. The results show that methylphenidate is unable to enhance D(2) autoreceptor function in SHR.
Collapse
Affiliation(s)
- V A Russell
- Department of Physiology, Faculty of Health Sciences, University of Cape Town, Cape Town, South Africa.
| | | | | | | | | |
Collapse
|
18
|
Xu SG, Prasad C, Smith DE. Neurons exhibiting dopamine D2 receptor immunoreactivity in the substantia nigra of the mutant weaver mouse. Neuroscience 1999; 89:191-207. [PMID: 10051229 DOI: 10.1016/s0306-4522(98)00286-3] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/28/2022]
Abstract
Neurons exhibiting D2 receptor-like immunoreactivity were investigated in the substantia nigra pars compacta of weaver mice at the light and electron microscope levels using immunocytochemical techniques. At the light microscope level, there was significant loss of D2-like immunoreactive cells in weaver mice and the remaining labeled cells exhibited less intense immunoreactivity. At the ultrastructural level, there was a decrease in the number of immunoreactive profiles and fewer synapses were observed abutting labeled dendritic profiles. In addition, degenerative changes were noted in some of the D2 receptor-like immunoreactive profiles. Double labeling with D2 and tyrosine hydroxylase indicated that the majority of the labeled profiles were double labeled. Eight-week-old homozygous weavers were paired with wild-type littermates as controls and perfused with a buffered solution of acrolein/paraformadehyde. Midbrain sections were reacted immunocytochemically either with an antiserum to D2 or with antisera to D2 and tyrosine hydroxylase, using a double-labeling technique. Sections were processed for light and electron microscopy by standard methods. The results of this study confirm the autoreceptor-like activity of D2 receptors on nigral dopamine neurons. The cell degeneration, down-regulation of D2 receptors, and decreased dendritic and synaptic components in the neuropil suggest that the synaptic integrity of the substantia nigra has been compromised, which in turn would affect the functional efficacy of the basal ganglia circuitry. This altered circuity is expressed in the Parkinson-like symptoms displayed by this mutant mouse.
Collapse
Affiliation(s)
- S G Xu
- Department of Cell Biology and Anatomy, LSU Medical Center, New Orleans, LA 70112, USA
| | | | | |
Collapse
|
19
|
Russell V, de Villiers A, Sagvolden T, Lamm M, Taljaard J. Differences between electrically-, ritalin- and D-amphetamine-stimulated release of [3H]dopamine from brain slices suggest impaired vesicular storage of dopamine in an animal model of Attention-Deficit Hyperactivity Disorder. Behav Brain Res 1998; 94:163-71. [PMID: 9708847 DOI: 10.1016/s0166-4328(97)00177-0] [Citation(s) in RCA: 119] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
The spontaneously hypertensive rat (SHR) has behavioural characteristics which make it a suitable animal model for Attention-Deficit Hyperactivity Disorder (ADHD). The drugs of choice in the treatment of ADHD are methylphenidate and D-amphetamine. Using an in vitro superfusion system, we showed that both drugs released [3H]dopamine (DA) (and metabolites) from prefrontal cortex, nucleus accumbens and caudate-putamen slices, but methylphenidate was from 7- to 17-fold less potent than D-amphetamine. The similarity in the drug effects on SHR and WKY [3H]DA release is in accordance with the fact that there is no 'paradoxical effect' of psychomotor stimulants on ADHD behaviour. Methylphenidate released significantly less [3H]DA from nucleus accumbens slices obtained from SHR than from their normotensive Wistar-Kyoto (WKY) controls. Electrical stimulation released less [3H]DA from prefrontal cortex and caudate-putamen slices of SHR, while D-amphetamine, in contrast to methylphenidate, released more [3H]DA from prefrontal cortex, nucleus accumbens and caudate-putamen slices of SHR compared to WKY. Inhibition of the DA uptake carrier by low concentrations of methylphenidate increased the electrically-stimulated release of [3H]DA to the same extent in SHR and WKY tissue, suggesting that the DA transporter was not responsible for the differences between SHR and WKY. The present results suggest that SHR may have impaired vesicular storage of DA causing leakage of DA into the cytoplasm, since SHR released less [3H]DA from vesicular stores in response to methylphenidate or electrical stimulation and released more [3H]DA from cytoplasmic stores via the uptake carrier in response to D-amphetamine. Methylphenidate might be the drug of choice in the treatment of ADHD because it releases DA from vesicular stores only and is less potent than D-amphetamine, thus making it possible to adjust the dose and thereby 'normalise' reduced DA function more precisely than is possible with D-amphetamine. There was no difference between SHR and WKY with respect to D-amphetamine-stimulated release of [14C]acetylcholine (ACh) or methylphenidate-induced inhibition of the electrically-stimulated release of [14C]ACh from nucleus accumbens or caudate-putamen slices, suggesting that there is no major change in cholinergic transmission in SHR.
Collapse
Affiliation(s)
- V Russell
- Department of Chemical Pathology, University of Stellenbosch, Tygerberg, South Africa.
| | | | | | | | | |
Collapse
|
20
|
Pundt LL, Narang N, Kondoh T, Low WC. Localization of dopamine receptors and associated mRNA in transplants of human fetal striatal tissue in rodents with experimental Huntington's disease. Neurosci Res 1997; 27:305-15. [PMID: 9152043 DOI: 10.1016/s0168-0102(96)01163-7] [Citation(s) in RCA: 11] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
Huntington's Disease (HD) is characterized by deficits in motor and cognitive functions. This neurodegenerative disease shows an extensive loss of medium-sized spiny projection neurons (GABAergic) within the neostriatum. With the loss of these neurons, there is a concomitant loss of associated receptors, such as those for GABA, glutamate, and dopamine. In the present study, we have addressed the question of whether dopamine receptors are re-established in the lesioned rodent striatum following the transplantation of human striatal cells. Human striatal cell suspension or saline (transplant controls) was injected into the striatum of rats previously lesioned with quinolinic acid (QA). Three nine months following transplantation, the animals were sacrificed and the brains were processed for receptor autoradiography and in situ hybridization of dopamine D1 and D2 receptor subtypes. Our results demonstrate that animals transplanted with human striatal cells show a significant increase in D1 receptors following transplantation when compared to the lesion area in control animals, while D1 receptor mRNA remains unchanged. In contrast to D1 receptor binding, D2 receptor levels are not increased in the lesioned and transplanted area of the striatum when compared to controls; however, D2 receptor mRNA levels are significantly increased. These results demonstrate that at the times the animals were examined, D1 and D2 receptors were differentially regulated. Our results further indicate that human striatal primordium will survive following transplantation and will express D1 receptors and D2 receptor mRNA that are depleted in the QA lesioned rodent striatum. This study compliments and extends previous findings on human striatal cell transplantation in rodent models of HD.
Collapse
Affiliation(s)
- L L Pundt
- Department of Neurosurgery, University of Minnesota Medical School, Minneapolis 55455, USA
| | | | | | | |
Collapse
|
21
|
Rots NY, Cools AR, Bérod A, Voorn P, Rostène W, de Kloet ER. Rats bred for enhanced apomorphine susceptibility have elevated tyrosine hydroxylase mRNA and dopamine D2-receptor binding sites in nigrostriatal and tuberoinfundibular dopamine systems. Brain Res 1996; 710:189-96. [PMID: 8963658 DOI: 10.1016/0006-8993(95)01379-2] [Citation(s) in RCA: 37] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
From a Wistar population two rat lines were generated using as criterion the behavioral response to the dopamine agonist apomorphine. Rats of the apomorphine-susceptible (apo-sus) line revealed a vigorous gnawing response to apomorphine administration while the other rat line, the apomorphine-unsusceptible (apo-unsus) line, was selected for lack of response to the drug. In the present study using the 12th and 13th generation of these genetically selected lines, we have investigated whether this difference in apomorphine responsiveness was correlated with changes in dopamine neurochemistry. Therefore, we measured tyrosine hydroxylase (TH), the rate limiting enzyme in dopamine synthesis, as well as dopamine D1 and D2 receptor mRNA levels in discrete brain regions by in situ hybridization. Dopamine (D2/D3) receptor binding was assessed with [125I]iodosulpride in a membrane binding assay and by quantitative autoradiography on tissue sections. [3H]SCH 23390 was used to analyze D1 receptor binding. Apo-sus rats displayed significantly higher TH mRNA levels in the A9 cell group of the substantia nigra pars compacta and in the A12 cell group of the arcuate nucleus. No difference was found in the A10 cell group of the VTA and the A6 cell group of the locus coeruleus. The density of D2/3 binding sites as well as D1 receptor mRNA levels in the striatal projection area of the A9 substantia nigra neurons, were significantly elevated in apo-sus rats. Dopamine D2 receptor mRNA and D1 receptor binding levels in caudate putamen and nucleus accumbens, however, were similar in rats of both lines. In conclusion, high apomorphine susceptibility is related to a potentially enhanced dopamine responsiveness selective for the nigrostriatal and tuberoinfundibular pathways.
Collapse
Affiliation(s)
- N Y Rots
- Division of Medical Pharmacology, Leiden/Amsterdam Center for Drug Research, University of Leiden, The Netherlands
| | | | | | | | | | | |
Collapse
|
22
|
Lucas LR, Harlan RE. Cholinergic regulation of tachykinin- and enkephalin-gene expression in the rat striatum. BRAIN RESEARCH. MOLECULAR BRAIN RESEARCH 1995; 30:181-95. [PMID: 7637570 DOI: 10.1016/0169-328x(94)00288-p] [Citation(s) in RCA: 19] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/26/2023]
Abstract
Ninety-five percent of the neurons in the corpus striatum of the rat are medium spiny projection neurons, which contain tachykinins such as substance P, neurokinin A, and neurokinin B and the opiate peptides, enkephalin and dynorphin. The remaining 5% consist of interneurons, of which a small but significant proportion are cholinergic. The influence of these cholinergic interneurons on the neuropeptidergic projection systems in the striatum is poorly understood at this time. The present study explores the relationship between cholinergic receptor activation or muscarinic blockade on striatal neuropeptide gene expression. Adult male Sprague-Dawley rats were treated chronically either with a cholinergic agonist (physostigmine: 0.5 mg/kg/3 x day), a muscarinic antagonist (scopolamine HCl: 0.4 mg/kg/3 x day), or vehicle (PBS: 0.1 ml/100 g) administered for 6 days (s.c.). In situ hybridization was performed with probes directed against mRNAs for beta-preprotachykinin (a transcript containing substance P, neurokinin A, and other tachykinins), neurokinin B and preproenkephalin. Physostigmine administration resulted in a 12% decrease in the dorsolateral caudate-putamen and a 27% increase in the core of the nucleus accumbens in substance P/neurokinin A mRNA; and a 29% increase in the caudate-putamen and an 11% increase in the core of the nucleus accumbens in preproenkephalin mRNA levels. Scopolamine treatment resulted in a 28% and 48% decrease, respectively, in the caudate-putamen and in the shell of the nucleus accumbens in substance P/neurokinin A mRNA levels. Neurokinin B mRNA levels were increased by 50% in the shell of the accumbens after scopolamine. Preproenkephalin mRNA levels increased by 24% in the caudate-putamen and decreased by 20% in the core of the nucleus accumbens. From these results we tentatively conclude that cholinoceptive neuropeptidergic neurons are segregated along dorsoventral and mediolateral axes in the striatum, thus giving rise to non-homogenous responses upon cholinergic receptor activation or muscarinic blockade.
Collapse
Affiliation(s)
- L R Lucas
- Laboratory of Neuroendocrinology, Rockefeller University, New York, NY 10021, USA
| | | |
Collapse
|
23
|
Russell V, de Villiers A, Sagvolden T, Lamm M, Taljaard J. Altered dopaminergic function in the prefrontal cortex, nucleus accumbens and caudate-putamen of an animal model of attention-deficit hyperactivity disorder--the spontaneously hypertensive rat. Brain Res 1995; 676:343-51. [PMID: 7614004 DOI: 10.1016/0006-8993(95)00135-d] [Citation(s) in RCA: 149] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/26/2023]
Abstract
The spontaneously hypertensive rat (SHR) has been proposed as an animal model for Attention-Deficit Hyperactivity Disorder (ADHD). The behavioural problems of ADHD have been suggested to be secondary to altered reinforcement mechanisms resulting from dysfunction of the mesolimbic and mesocortical dopaminergic systems. The present study therefore investigated whether there are regional differences in dopamine (DA) and acetylcholine (ACh) release and DA D2-receptor function in SHR compared to their normotensive Wistar-Kyoto (WKY) controls. The DA D2-receptor agonist, quinpirole, caused significantly greater inhibition of DA release from caudate-putamen but not from nucleus accumbens or prefrontal cortex slices of SHR relative to WKY. DA D2-receptor blockade by the antagonist, sulpiride, caused a significantly greater increase in DA release from nucleus accumbens slices of SHR compared to WKY suggesting increased efficacy of DA autoreceptors at low endogenous agonist concentrations in the nucleus accumbens of SHR. The electrically-stimulated release of DA was significantly lower in caudate-putamen and prefrontal cortex slices of SHR than in slices of WKY. This could be attributed to increased autoreceptor-mediated inhibition of DA release in caudate-putamen slices but not in the prefrontal cortex. No difference was observed between SHR and WKY with respect to DA D2-receptor-mediated inhibition of ACh release from caudate-putamen or nucleus accumbens slices, suggesting that postsynaptic DA D2-receptor function is not altered in SHR relative to WKY.
Collapse
Affiliation(s)
- V Russell
- Department of Chemical Pathology, University of Stellenbosch, Tygerberg, South Africa
| | | | | | | | | |
Collapse
|
24
|
Jackson DM, Westlind-Danielsson A. Dopamine receptors: molecular biology, biochemistry and behavioural aspects. Pharmacol Ther 1994; 64:291-370. [PMID: 7878079 DOI: 10.1016/0163-7258(94)90041-8] [Citation(s) in RCA: 319] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/27/2023]
Abstract
The description of new dopamine (DA) receptor subtypes, D1-(D1 and D5) and D2-like (D2A, D2B, D3, D4), has given an impetus to DA research. While selective agonists and antagonists are not generally available yet, the receptor distribution in the brain suggests that they could be new targets for drug development. Binding characteristics and second messenger coupling has been explored in cell lines expressing the new cloned receptors. The absence of selective ligands has meant that in vivo studies have lagged behind. However, progress has been made in understanding the function of DA-containing discrete brain nuclei and the functional consequence of the DA's interaction with other neurotransmitters. This review explores some of the latest advances in these various areas.
Collapse
Affiliation(s)
- D M Jackson
- Department of Behavioural, Pharmacology, Astra Arcus AB, Södertälje, Sweden
| | | |
Collapse
|