Dopamine D2 receptors in discrimination learning and spine enlargement

3'-Deoxyadenosin alleviates methamphetamine-induced aberrant synaptic plasticity and seeking behavior by inhibiting the NLRP3 inflammasome

JOURNAL/nrgr/04.03/01300535-202410000-00028/figure1/v/2024-02-06T055622Z/r/image-tiff Methamphetamine addiction is a brain disorder characterized by persistent drug-seeking behavior, which has been linked with aberrant synaptic plasticity. An increasing body of evidence suggests that aberrant synaptic plasticity is associated with the activation of the NOD-like receptor family pyrin domain containing-3 (NLRP3) inflammasome. 3'-Deoxyadenosin, an active component of the Chinese fungus Cordyceps militaris, has strong anti-inflammatory effects. However, whether 3'-deoxyadenosin attenuates methamphetamine-induced aberrant synaptic plasticity via an NLRP3-mediated inflammatory mechanism remains unclear. We first observed that 3'-deoxyadenosin attenuated conditioned place preference scores in methamphetamine-treated mice and decreased the expression of c-fos in hippocampal neurons. Furthermore, we found that 3'-deoxyadenosin reduced the aberrant potentiation of glutamatergic transmission and restored the methamphetamine-induced impairment of synaptic plasticity. We also found that 3'-deoxyadenosin decreased the expression of NLRP3 and neuronal injury. Importantly, a direct NLRP3 deficiency reduced methamphetamine-induced seeking behavior, attenuated the impaired synaptic plasticity, and prevented neuronal damage. Finally, NLRP3 activation reversed the effect of 3'-deoxyadenosin on behavior and synaptic plasticity, suggesting that the anti-neuroinflammatory mechanism of 3'-deoxyadenosin on aberrant synaptic plasticity reduces methamphetamine-induced seeking behavior. Taken together, 3'-deoxyadenosin alleviates methamphetamine-induced aberrant synaptic plasticity and seeking behavior by inhibiting the NLRP3 inflammasome.

Reward perseveration is shaped by GABA A -mediated dopamine pauses

Extinction learning is an essential form of cognitive flexibility, which enables obsolete reward associations to be discarded. Its downregulation can lead to perseveration, a symptom seen in several neuropsychiatric disorders. This balance is regulated by dopamine from VTA DA (ventral tegmental area dopamine) neurons, which in turn are largely controlled by GABA (gamma amino-butyric acid) synapses. However, the causal relationship of these circuit elements to extinction and perseveration remain incompletely understood. Here, we employ an innovative drug-targeting technology, DART (drug acutely restricted by tethering), to selectively block GABA A receptors on VTA DA neurons as mice engage in Pavlovian learning. DART eliminated GABA A -mediated pauses-brief decrements in VTA DA activity canonically thought to drive extinction learning. However, contrary to the hypothesis that blocking VTA DA pauses should eliminate extinction learning, we observed the opposite-accelerated extinction learning. Specifically, DART eliminated the naturally occurring perseveration seen in half of control mice. We saw no impact on Pavlovian conditioning, nor on other aspects of VTA DA neural firing. These findings challenge canonical theories, recasting GABA A -mediated VTA DA pauses from presumed facilitators of extinction to drivers of perseveration. More broadly, this study showcases the merits of targeted synaptic pharmacology, while hinting at circuit interventions for pathological perseveration.

Optochemical control of slow-wave sleep in the nucleus accumbens of male mice by a photoactivatable allosteric modulator of adenosine A2A receptors

Optochemistry, an emerging pharmacologic approach in which light is used to selectively activate or deactivate molecules, has the potential to alleviate symptoms, cure diseases, and improve quality of life while preventing uncontrolled drug effects. The development of in-vivo applications for optochemistry to render brain cells photoresponsive without relying on genetic engineering has been progressing slowly. The nucleus accumbens (NAc) is a region for the regulation of slow-wave sleep (SWS) through the integration of motivational stimuli. Adenosine emerges as a promising candidate molecule for activating indirect pathway neurons of the NAc expressing adenosine A2A receptors (A2ARs) to induce SWS. Here, we developed a brain-permeable positive allosteric modulator of A2ARs (A2AR PAM) that can be rapidly photoactivated with visible light (λ > 400 nm) and used it optoallosterically to induce SWS in the NAc of freely behaving male mice by increasing the activity of extracellular adenosine derived from astrocytic and neuronal activity.

Stimulation of VTA dopamine inputs to LH upregulates orexin neuronal activity in a DRD2-dependent manner

Dopamine and orexins (hypocretins) play important roles in regulating reward-seeking behaviors. It is known that hypothalamic orexinergic neurons project to dopamine neurons in the ventral tegmental area (VTA), where they can stimulate dopaminergic neuronal activity. Although there are reciprocal connections between dopaminergic and orexinergic systems, whether and how dopamine regulates the activity of orexin neurons is currently not known. Here we implemented an opto-Pavlovian task in which mice learn to associate a sensory cue with optogenetic dopamine neuron stimulation to investigate the relationship between dopamine release and orexin neuron activity in the lateral hypothalamus (LH). We found that dopamine release can be evoked in LH upon optogenetic stimulation of VTA dopamine neurons and is also naturally evoked by cue presentation after opto-Pavlovian learning. Furthermore, orexin neuron activity could also be upregulated by local stimulation of dopaminergic terminals in the LH in a way that is partially dependent on dopamine D2 receptors (DRD2). Our results reveal previously unknown orexinergic coding of reward expectation and unveil an orexin-regulatory axis mediated by local dopamine inputs in the LH.

No-observed-adverse-effect-level (NOAEL) clothianidin, a neonicotinoid pesticide, impairs hippocampal memory and motor learning associated with alteration of gene expression in cerebellum

Neonicotinoid pesticides (NNs) have been associated with numerous neurobehavioral effects in rodents, raising concerns about their impact on cognitive function. Clothianidin (CLO), a type of NN, was orally administered to male mice (10 weeks old, C57BL/6N) at the no-observed-adverse-effect level (NOAEL) of 50 mg/kg/day as indicated in the pesticide risk assessment report. Behavioral tests (novel location recognition and rotarod tests) evaluated hippocampal memory and cerebellar motor learning. After each test, plasma monoamines (3-methoxytyramine, histamine, serotonin, tryptamine) were measured by LC-ESI/MS/MS (Liquid chromatography-electrospray ionization/tandem mass spectrometry), and cerebellar mRNA expression was quantified by microarray and qRT-PCR analyses. The NOAEL of CLO was found to impair hippocampal memory, leading to decreased spontaneous locomotor activity and motor function. We reported, for the first time, multiple alterations of gene expression in the cerebellum associated with motor dysfunction.

Opposing Motor Memories in the Direct and Indirect Pathways of the Basal Ganglia

Loss of dopamine neurons causes motor deterioration in Parkinson's disease patients. We have previously reported that in addition to acute motor impairment, the impaired motor behavior is encoded into long-term memory in an experience-dependent and task-specific manner, a phenomenon we refer to as aberrant inhibitory motor learning. Although normal motor learning and aberrant inhibitory learning oppose each other and this is manifested in apparent motor performance, in the present study, we found that normal motor memory acquired prior to aberrant inhibitory learning remains preserved in the brain, suggesting the existence of independent storage. To investigate the neuronal circuits underlying these two opposing memories, we took advantage of the RNA-binding protein YTHDF1, an m 6 A RNA methylation reader involved in the regulation of protein synthesis and learning/memory. Conditional deletion of Ythdf1 in either D1 or D2 receptor-expressing neurons revealed that normal motor memory is stored in the D1 (direct) pathway of the basal ganglia, while inhibitory memory is stored in the D2 (indirect) pathway. Furthermore, fiber photometry recordings of GCaMP signals from striatal D1 (dSPN) and D2 (iSPN) receptor-expressing neurons support the preservation of normal memory in the direct pathway after aberrant inhibitory learning, with activities of dSPN predictive of motor performance. Finally, a computational model based on activities of motor cortical neurons, dSPN and iSPN neurons, and their interactions through the basal ganglia loops supports the above observations. These findings have important implications for novel approaches in treating Parkinson's disease by reactivating preserved normal memory, and in treating hyperkinetic movement disorders such as chorea or tics by erasing aberrant motor memories.

How are overweight and obesity associated with reinforcement learning deficits? A systematic review

Reinforcement learning (RL) refers to the ability to learn stimulus-response or response-outcome associations relevant to the acquisition of behavioral repertoire and adaptation to the environment. Research data from correlational and case-control studies have shown that obesity is associated with impairments in RL. The aim of the present study was to systematically review how obesity and overweight are associated with RL performance. More specifically, the relationship between high body mass index (BMI) and task performance was explored through the analysis of specific RL processes associated with different physiological, computational, and behavioral manifestations. Our systematic analyses indicate that obesity might be associated with impairments in the use of aversive outcomes to change ongoing behavior, as revealed by results involving instrumental negative reinforcement and extinction/reversal learning, but further research needs to be conducted to confirm this association. Hypotheses regarding how obesity might be associated with altered RL were discussed.

A reinforcement learning model with choice traces for a progressive ratio schedule

The progressive ratio (PR) lever-press task serves as a benchmark for assessing goal-oriented motivation. However, a well-recognized limitation of the PR task is that only a single data point, known as the breakpoint, is obtained from an entire session as a barometer of motivation. Because the breakpoint is defined as the final ratio of responses achieved in a PR session, variations in choice behavior during the PR task cannot be captured. We addressed this limitation by constructing four reinforcement learning models: a simple Q-learning model, an asymmetric model with two learning rates, a perseverance model with choice traces, and a perseverance model without learning. These models incorporated three behavioral choices: reinforced and non-reinforced lever presses and void magazine nosepokes, because we noticed that male mice performed frequent magazine nosepokes during PR tasks. The best model was the perseverance model, which predicted a gradual reduction in amplitudes of reward prediction errors (RPEs) upon void magazine nosepokes. We confirmed the prediction experimentally with fiber photometry of extracellular dopamine (DA) dynamics in the ventral striatum of male mice using a fluorescent protein (genetically encoded GPCR activation-based DA sensor: GRABDA2m). We verified application of the model by acute intraperitoneal injection of low-dose methamphetamine (METH) before a PR task, which increased the frequency of magazine nosepokes during the PR session without changing the breakpoint. The perseverance model captured behavioral modulation as a result of increased initial action values, which are customarily set to zero and disregarded in reinforcement learning analysis. Our findings suggest that the perseverance model reveals the effects of psychoactive drugs on choice behaviors during PR tasks.

An opponent striatal circuit for distributional reinforcement learning

Machine learning research has achieved large performance gains on a wide range of tasks by expanding the learning target from mean rewards to entire probability distributions of rewards - an approach known as distributional reinforcement learning (RL)1. The mesolimbic dopamine system is thought to underlie RL in the mammalian brain by updating a representation of mean value in the striatum2,3, but little is known about whether, where, and how neurons in this circuit encode information about higher-order moments of reward distributions4. To fill this gap, we used high-density probes (Neuropixels) to acutely record striatal activity from well-trained, water-restricted mice performing a classical conditioning task in which reward mean, reward variance, and stimulus identity were independently manipulated. In contrast to traditional RL accounts, we found robust evidence for abstract encoding of variance in the striatum. Remarkably, chronic ablation of dopamine inputs disorganized these distributional representations in the striatum without interfering with mean value coding. Two-photon calcium imaging and optogenetics revealed that the two major classes of striatal medium spiny neurons - D1 and D2 MSNs - contributed to this code by preferentially encoding the right and left tails of the reward distribution, respectively. We synthesize these findings into a new model of the striatum and mesolimbic dopamine that harnesses the opponency between D1 and D2 MSNs5-15 to reap the computational benefits of distributional RL.

Nucleus accumbens local circuit for cue-dependent aversive learning

Response to threatening environmental stimuli requires detection and encoding of important environmental features that dictate threat. Aversive events are highly salient, which promotes associative learning about stimuli that signal this threat. The nucleus accumbens is uniquely positioned to process this salient, aversive information and promote motivated output, through plasticity on the major projection neurons in the brain area. We describe a nucleus accumbens core local circuit whereby excitatory plasticity facilitates learning and recall of discrete aversive cues. We demonstrate that putative nucleus accumbens substance P release and long-term excitatory plasticity on dopamine 2 receptor-expressing projection neurons are required for cue-dependent fear learning. Additionally, we find that fear learning and recall is dependent on distinct projection neuron subtypes. Our work demonstrates a critical role for nucleus accumbens substance P in cue-dependent aversive learning.

Subcortical volumetric alterations in four major psychiatric disorders: a mega-analysis study of 5604 subjects and a volumetric data-driven approach for classification

Differential diagnosis is sometimes difficult in practical psychiatric settings, in terms of using the current diagnostic system based on presenting symptoms and signs. The creation of a novel diagnostic system using objective biomarkers is expected to take place. Neuroimaging studies and others reported that subcortical brain structures are the hubs for various psycho-behavioral functions, while there are so far no neuroimaging data-driven clinical criteria overcoming limitations of the current diagnostic system, which would reflect cognitive/social functioning. Prior to the main analysis, we conducted a large-scale multisite study of subcortical volumetric and lateralization alterations in schizophrenia, bipolar disorder, major depressive disorder, and autism spectrum disorder using T1-weighted images of 5604 subjects (3078 controls and 2526 patients). We demonstrated larger lateral ventricles volume in schizophrenia, bipolar disorder, and major depressive disorder, smaller hippocampus volume in schizophrenia and bipolar disorder, and schizophrenia-specific smaller amygdala, thalamus, and accumbens volumes and larger caudate, putamen, and pallidum volumes. In addition, we observed a leftward alteration of lateralization for pallidum volume specifically in schizophrenia. Moreover, as our main objective, we clustered the 5,604 subjects based on subcortical volumes, and explored whether data-driven clustering results can explain cognitive/social functioning in the subcohorts. We showed a four-biotype classification, namely extremely (Brain Biotype [BB] 1) and moderately smaller limbic regions (BB2), larger basal ganglia (BB3), and normal volumes (BB4), being associated with cognitive/social functioning. Specifically, BB1 and BB2-3 were associated with severe and mild cognitive/social impairment, respectively, while BB4 was characterized by normal cognitive/social functioning. Our results may lead to the future creation of novel biological data-driven psychiatric diagnostic criteria, which may be expected to be useful for prediction or therapeutic selection.

Slow-rising and fast-falling dopaminergic dynamics jointly adjust negative prediction error in the ventral striatum

The greater the reward expectations are, the more different the brain's physiological response will be. Although it is well-documented that better-than-expected outcomes are encoded quantitatively via midbrain dopaminergic (DA) activity, it has been less addressed experimentally whether worse-than-expected outcomes are expressed quantitatively as well. We show that larger reward expectations upon unexpected reward omissions are associated with the preceding slower rise and following larger decrease (DA dip) in the DA concentration at the ventral striatum of mice. We set up a lever press task on a fixed ratio (FR) schedule requiring five lever presses as an effort for a food reward (FR5). The mice occasionally checked the food magazine without a reward before completing the task. The percentage of this premature magazine entry (PME) increased as the number of lever presses approached five, showing rising expectations with increasing proximity to task completion, and hence greater reward expectations. Fibre photometry of extracellular DA dynamics in the ventral striatum using a fluorescent protein (genetically encoded GPCR activation-based DA sensor: GRABDA2m ) revealed that the slow increase and fast decrease in DA levels around PMEs were correlated with the PME percentage, demonstrating a monotonic relationship between the DA dip amplitude and degree of expectations. Computational modelling of the lever press task implementing temporal difference errors and state transitions replicated the observed correlation between the PME frequency and DA dip amplitude in the FR5 task. Taken together, these findings indicate that the DA dip amplitude represents the degree of reward expectations monotonically, which may guide behavioural adjustment.

Distributed dopaminergic signaling in the basal ganglia and its relationship to motor disability in Parkinson's disease

The degeneration of mesencephalic dopaminergic neurons that innervate the basal ganglia is responsible for the cardinal motor symptoms of Parkinson's disease (PD). It has been thought that loss of dopaminergic signaling in one basal ganglia region - the striatum - was solely responsible for the network pathophysiology causing PD motor symptoms. While our understanding of dopamine (DA)'s role in modulating striatal circuitry has deepened in recent years, it also has become clear that it acts in other regions of the basal ganglia to influence movement. Underscoring this point, examination of a new progressive mouse model of PD shows that striatal dopamine DA depletion alone is not sufficient to induce parkinsonism and that restoration of extra-striatal DA signaling attenuates parkinsonian motor deficits once they appear. This review summarizes recent advances in the effort to understand basal ganglia circuitry, its modulation by DA, and how its dysfunction drives PD motor symptoms.

Activation of the Hippocampal DRD2 Alleviates Neuroinflammation, Synaptic Plasticity Damage and Cognitive Impairment After Sleep Deprivation

Sleep loss is commonplace nowadays and profoundly impacts cognition. Dopamine receptor D2 (DRD2) makes a specific contribution to cognition, although the precise mechanism underlying how DRD2 affects the cognitive process after sleep deprivation remains unclear. Herein, we observed cognitive impairment and impaired synaptic plasticity, including downregulation of synaptophysin and PSD95, decreased postsynaptic density thickness, neuron complexity, and spine density in chronic sleep restriction (CSR) mice. We also observed downregulated hippocampal DRD2 and Cryab expression in the CSR mice. Meanwhile, NF-κB translocation from the cytoplasm to the nucleus occurred, indicating that neuroinflammation ensued. However, hippocampal delivery of the DRD2 agonist quinpirole effectively rescued these changes. In vitro, quinpirole treatment significantly decreased the release of proinflammatory cytokines in microglial supernatant, indicating a potential anti-neuroinflammatory effect of Drd2/Cryab/NF-κB in CSR mice. Our study provided the evidence that activation of the Drd2 may relieve neuroinflammation and improve sleep deprivation-induced cognitive deficits.

Tonic dopamine and biases in value learning linked through a biologically inspired reinforcement learning model

A hallmark of various psychiatric disorders is biased future predictions. Here we examined the mechanisms for biased value learning using reinforcement learning models incorporating recent findings on synaptic plasticity and opponent circuit mechanisms in the basal ganglia. We show that variations in tonic dopamine can alter the balance between learning from positive and negative reward prediction errors, leading to biased value predictions. This bias arises from the sigmoidal shapes of the dose-occupancy curves and distinct affinities of D1- and D2-type dopamine receptors: changes in tonic dopamine differentially alters the slope of the dose-occupancy curves of these receptors, thus sensitivities, at baseline dopamine concentrations. We show that this mechanism can explain biased value learning in both mice and humans and may also contribute to symptoms observed in psychiatric disorders. Our model provides a foundation for understanding the basal ganglia circuit and underscores the significance of tonic dopamine in modulating learning processes.

Nigrostriatal dopamine modulates the striatal-amygdala pathway in auditory fear conditioning

The auditory striatum, a sensory portion of the dorsal striatum, plays an essential role in learning and memory. In contrast to its roles and underlying mechanisms in operant conditioning, however, little is known about its contribution to classical auditory fear conditioning. Here, we reveal the function of the auditory striatum in auditory-conditioned fear memory. We find that optogenetically inhibiting auditory striatal neurons impairs fear memory formation, which is mediated through the striatal-amygdala pathway. Using calcium imaging in behaving mice, we find that auditory striatal neuronal responses to conditioned tones potentiate across memory acquisition and expression. Furthermore, nigrostriatal dopaminergic projections plays an important role in modulating conditioning-induced striatal potentiation. Together, these findings demonstrate the existence of a nigro-striatal-amygdala circuit for conditioned fear memory formation and expression.

"World-Informed" Neuroscience for Diversity and Inclusion: An Organizational Change in Cognitive Sciences

By nature, humans are "tojisha (participating subjects/player-witnesses)" who encounter an unpredictable real world. An important characteristic of the relationship between the individual brain and the world is that it creates a loop of interaction and mutual formation. However, cognitive sciences have traditionally been based on a model that treats the world as a given constant. We propose incorporating the interaction loop into this model to create "world-informed neuroscience (WIN)". Based on co-productive research with people with minority characteristics that do not match the world, we hypothesize that the tojisha and the world interact in a two-dimensional way of rule-based and story-based. By defining the cognitive process of becoming tojisha in this way, it is possible to contribute to the various issues of the real world and diversity and inclusion through the integration of the humanities and sciences. The critical role of the brain dopamine system as a basis for brain-world interaction and the importance of research on urbanicity and adolescent development as examples of the application of WIN were discussed. The promotion of these studies will require bidirectional translation between human population science and animal cognitive neuroscience. We propose that the social model of disability should be incorporated into cognitive sciences, and that disability-informed innovation is needed to identify how social factors are involved in mismatches that are difficult to visualize. To promote WIN to ultimately contribute to a diverse and inclusive society, co-production of research from the initial stage of research design should be a baseline requirement.

Nucleus Accumbens Local Circuit for Cue-Dependent Aversive Learning

Response to threatening environmental stimuli requires detection and encoding of important environmental features that dictate threat. Aversive events are highly salient which promotes associative learning about stimuli that signal this threat. The nucleus accumbens is uniquely positioned to process this salient, aversive information and promote motivated output, through plasticity on the major projection neurons in the brain area. We uncovered a nucleus accumbens core local circuit whereby excitatory plasticity facilitates learning and recall of discrete aversive cues. We demonstrate that putative nucleus accumbens substance P release and long-term excitatory plasticity on dopamine 2 receptor expressing projection neurons is required for cue-dependent fear learning. Additionally, we found fear learning and recall were dependent on distinct projection-neuron subtypes. Our work demonstrates a critical role for Nucleus Accumbens substance P in cue-dependent aversive learning.

Striatal Dopamine Signals and Reward Learning

We are constantly bombarded by sensory information and constantly making decisions on how to act. In order to optimally adapt behavior, we must judge which sequences of sensory inputs and actions lead to successful outcomes in specific circumstances. Neuronal circuits of the basal ganglia have been strongly implicated in action selection, as well as the learning and execution of goal-directed behaviors, with accumulating evidence supporting the hypothesis that midbrain dopamine neurons might encode a reward signal useful for learning. Here, we review evidence suggesting that midbrain dopaminergic neurons signal reward prediction error, driving synaptic plasticity in the striatum underlying learning. We focus on phasic increases in action potential firing of midbrain dopamine neurons in response to unexpected rewards. These dopamine neurons prominently innervate the dorsal and ventral striatum. In the striatum, the released dopamine binds to dopamine receptors, where it regulates the plasticity of glutamatergic synapses. The increase of striatal dopamine accompanying an unexpected reward activates dopamine type 1 receptors (D1Rs) initiating a signaling cascade that promotes long-term potentiation of recently active glutamatergic input onto striatonigral neurons. Sensorimotor-evoked glutamatergic input, which is active immediately before reward delivery will thus be strengthened onto neurons in the striatum expressing D1Rs. In turn, these neurons cause disinhibition of brainstem motor centers and disinhibition of the motor thalamus, thus promoting motor output to reinforce rewarded stimulus-action outcomes. Although many details of the hypothesis need further investigation, altogether, it seems likely that dopamine signals in the striatum might underlie important aspects of goal-directed reward-based learning.

Enhancing reinforcement learning models by including direct and indirect pathways improves performance on striatal dependent tasks

A major advance in understanding learning behavior stems from experiments showing that reward learning requires dopamine inputs to striatal neurons and arises from synaptic plasticity of cortico-striatal synapses. Numerous reinforcement learning models mimic this dopamine-dependent synaptic plasticity by using the reward prediction error, which resembles dopamine neuron firing, to learn the best action in response to a set of cues. Though these models can explain many facets of behavior, reproducing some types of goal-directed behavior, such as renewal and reversal, require additional model components. Here we present a reinforcement learning model, TD2Q, which better corresponds to the basal ganglia with two Q matrices, one representing direct pathway neurons (G) and another representing indirect pathway neurons (N). Unlike previous two-Q architectures, a novel and critical aspect of TD2Q is to update the G and N matrices utilizing the temporal difference reward prediction error. A best action is selected for N and G using a softmax with a reward-dependent adaptive exploration parameter, and then differences are resolved using a second selection step applied to the two action probabilities. The model is tested on a range of multi-step tasks including extinction, renewal, discrimination; switching reward probability learning; and sequence learning. Simulations show that TD2Q produces behaviors similar to rodents in choice and sequence learning tasks, and that use of the temporal difference reward prediction error is required to learn multi-step tasks. Blocking the update rule on the N matrix blocks discrimination learning, as observed experimentally. Performance in the sequence learning task is dramatically improved with two matrices. These results suggest that including additional aspects of basal ganglia physiology can improve the performance of reinforcement learning models, better reproduce animal behaviors, and provide insight as to the role of direct- and indirect-pathway striatal neurons.

Past, present, and future of tools for dopamine detection

Dopamine (DA) is a critical neuromodulator involved in various brain functions. To understand how DA regulates neural circuits and behaviors in the physiological and pathological conditions, it is essential to have tools that enable the direct detection of DA dynamics in vivo. Recently, genetically encoded DA sensors based on G protein-coupled receptors revolutionized this field, as it allows us to track in vivo DA dynamic with unprecedented spatial-temporal resolution, high molecular specificity, and sub-second kinetics. In this review, we first summarize traditional DA detection methods. Then we focus on the development of genetically encoded DA sensors and feature its significance to understanding dopaminergic neuromodulation across diverse behaviors and species. Finally, we present our perspectives about the future direction of the next-generation DA sensors and extend their potential applications. Overall, this review offers a comprehensive perspective on the past, present, and future of DA detection tools, with important implications for the study of DA functions in health and disease.

Dissociable control of motivation and reinforcement by distinct ventral striatal dopamine receptors

Dopamine release in striatal circuits, including the nucleus accumbens (NAc), tracks separable features of reward such as motivation and reinforcement. However, the cellular and circuit mechanisms by which dopamine receptors transform dopamine release into distinct constructs of reward remain unclear. Here, we show that dopamine D3 receptor (D3R) signaling in the NAc drives motivated behavior by regulating local NAc microcircuits. Furthermore, D3Rs co-express with dopamine D1 receptors (D1Rs), which regulate reinforcement, but not motivation. Paralleling dissociable roles in reward function, we report non-overlapping physiological actions of D3R and D1R signaling in NAc neurons. Our results establish a novel cellular framework wherein dopamine signaling within the same NAc cell type is physiologically compartmentalized via actions on distinct dopamine receptors. This structural and functional organization provides neurons in a limbic circuit with the unique ability to orchestrate dissociable aspects of reward-related behaviors that are relevant to the etiology of neuropsychiatric disorders.

Rethinking the network determinants of motor disability in Parkinson's disease

For roughly the last 30 years, the notion that striatal dopamine (DA) depletion was the critical determinant of network pathophysiology underlying the motor symptoms of Parkinson's disease (PD) has dominated the field. While the basal ganglia circuit model underpinning this hypothesis has been of great heuristic value, the hypothesis itself has never been directly tested. Moreover, studies in the last couple of decades have made it clear that the network model underlying this hypothesis fails to incorporate key features of the basal ganglia, including the fact that DA acts throughout the basal ganglia, not just in the striatum. Underscoring this point, recent work using a progressive mouse model of PD has shown that striatal DA depletion alone is not sufficient to induce parkinsonism and that restoration of extra-striatal DA signaling attenuates parkinsonian motor deficits once they appear. Given the broad array of discoveries in the field, it is time for a new model of the network determinants of motor disability in PD.

Opponent learning with different representations in the cortico-basal ganglia pathways can develop obsession-compulsion cycle

Obsessive-compulsive disorder (OCD) has been suggested to be associated with impairment of model-based behavioral control. Meanwhile, recent work suggested shorter memory trace for negative than positive prediction errors (PEs) in OCD. We explored relations between these two suggestions through computational modeling. Based on the properties of cortico-basal ganglia pathways, we modeled human as an agent having a combination of successor representation (SR)-based system that enables model-based-like control and individual representation (IR)-based system that only hosts model-free control, with the two systems potentially learning from positive and negative PEs in different rates. We simulated the agent's behavior in the environmental model used in the recent work that describes potential development of obsession-compulsion cycle. We found that the dual-system agent could develop enhanced obsession-compulsion cycle, similarly to the agent having memory trace imbalance in the recent work, if the SR- and IR-based systems learned mainly from positive and negative PEs, respectively. We then simulated the behavior of such an opponent SR+IR agent in the two-stage decision task, in comparison with the agent having only SR-based control. Fitting of the agents' behavior by the model weighing model-based and model-free control developed in the original two-stage task study resulted in smaller weights of model-based control for the opponent SR+IR agent than for the SR-only agent. These results reconcile the previous suggestions about OCD, i.e., impaired model-based control and memory trace imbalance, raising a novel possibility that opponent learning in model(SR)-based and model-free controllers underlies obsession-compulsion. Our model cannot explain the behavior of OCD patients in punishment, rather than reward, contexts, but it could be resolved if opponent SR+IR learning operates also in the recently revealed non-canonical cortico-basal ganglia-dopamine circuit for threat/aversiveness, rather than reward, reinforcement learning, and the aversive SR + appetitive IR agent could actually develop obsession-compulsion if the environment is modeled differently.

Mesolimbic dopamine release precedes actively sought aversive stimuli in mice

In some models, animals approach aversive stimuli more than those housed in an enriched environment. Here, we found that male mice in an impoverished and unstimulating (i.e., boring) chamber without toys sought aversive air puffs more often than those in an enriched chamber. Using this animal model, we identified the insular cortex as a regulator of aversion-seeking behavior. Activation and inhibition of the insular cortex increased and decreased the frequencies of air-puff self-stimulation, respectively, and the firing patterns of insular neuron ensembles predicted the self-stimulation timing. Dopamine levels in the ventrolateral striatum decreased with passive air puffs but increased with actively sought puffs. Around 20% of mice developed intense self-stimulation despite being offered toys, which was prevented by administering opioid receptor antagonists. This study establishes a basis for comprehending the neural underpinnings of usually avoided stimulus-seeking behaviors.

Error-related signaling in nucleus accumbens D2 receptor-expressing neurons guides inhibition-based choice behavior in mice

Learned associations between environmental cues and the outcomes they predict (cue-outcome associations) play a major role in behavioral control, guiding not only which responses we should perform, but also which we should inhibit, in order to achieve a specific goal. The encoding of such cue-outcome associations, as well as the performance of cue-guided choice behavior, is thought to involve dopamine D1 and D2 receptor-expressing medium spiny neurons (D1-/D2-MSNs) of the nucleus accumbens (NAc). Here, using a visual discrimination task in male mice, we assessed the role of NAc D1-/D2-MSNs in cue-guided inhibition of inappropriate responding. Cell-type specific neuronal silencing and in-vivo imaging revealed NAc D2-MSNs to contribute to inhibiting behavioral responses, with activation of NAc D2-MSNs following response errors playing an important role in optimizing future choice behavior. Our findings indicate that error-signaling by NAc D2-MSNs contributes to the ability to use environmental cues to inhibit inappropriate behavior.

Insulin and Disorders of Behavioural Flexibility

Behavioural inflexibility is a symptom of neuropsychiatric and neurodegenerative disorders such as Obsessive-Compulsive Disorder, Autism Spectrum Disorder and Alzheimer's Disease, encompassing the maintenance of a behaviour even when no longer appropriate. Recent evidence suggests that insulin signalling has roles apart from its regulation of peripheral metabolism and mediates behaviourally-relevant central nervous system (CNS) functions including behavioural flexibility. Indeed, insulin resistance is reported to generate anxious, perseverative phenotypes in animal models, with the Type 2 diabetes medication metformin proving to be beneficial for disorders including Alzheimer's Disease. Structural and functional neuroimaging studies of Type 2 diabetes patients have highlighted aberrant connectivity in regions governing salience detection, attention, inhibition and memory. As currently available therapeutic strategies feature high rates of resistance, there is an urgent need to better understand the complex aetiology of behaviour and develop improved therapeutics. In this review, we explore the circuitry underlying behavioural flexibility, changes in Type 2 diabetes, the role of insulin in CNS outcomes and mechanisms of insulin involvement across disorders of behavioural inflexibility.

Dopamine error signal to actively cope with lack of expected reward

To obtain more of a particular uncertain reward, animals must learn to actively overcome the lack of reward and adjust behavior to obtain it again. The neural mechanisms underlying such coping with reward omission remain unclear. Here, we developed a task in rats to monitor active behavioral switch toward the next reward after no reward. We found that some dopamine neurons in the ventral tegmental area exhibited increased responses to unexpected reward omission and decreased responses to unexpected reward, following the opposite responses of the well-known dopamine neurons that signal reward prediction error (RPE). The dopamine increase reflected in the nucleus accumbens correlated with behavioral adjustment to actively overcome unexpected no reward. We propose that these responses signal error to actively cope with lack of expected reward. The dopamine error signal thus cooperates with the RPE signal, enabling adaptive and robust pursuit of uncertain reward to ultimately obtain more reward.

Cellular bases for reward-related dopamine actions

Dopamine neurons exhibit transient increases and decreases in their firing rate upon reward and punishment for learning. This bidirectional modulation of dopamine dynamics occurs on the order of hundreds of milliseconds, and it is sensitively detected to reinforce the preceding sensorimotor events. These observations indicate that the mechanisms of dopamine detection at the projection sites are of remarkable precision, both in time and concentration. A major target of dopamine projection is the striatum, including the ventral region of the nucleus accumbens, which mainly comprises dopamine D1 and D2 receptor (D1R and D2R)-expressing spiny projection neurons. Although the involvement of D1R and D2R in dopamine-dependent learning has been suggested, the exact cellular bases for detecting transient dopamine signaling remain unclear. This review discusses recent cellular studies on the novel synaptic mechanisms for detecting dopamine transient signals associated with learning. Analyses of behavior based on these mechanisms have further revealed new behavioral aspects that are closely associated with these synaptic mechanisms. Thus, it is gradually possible to mechanistically explain behavioral learning via synaptic and cellular bases in rodents.

Unraveling the dynamics of dopamine release and its actions on target cells

The neuromodulator dopamine (DA) is essential for regulating learning, motivation, and movement. Despite its importance, however, the mechanisms by which DA influences the activity of target cells to alter behavior remain poorly understood. In this review, we describe recent methodological advances that are helping to overcome challenges that have historically hindered the field. We discuss how the employment of these methods is shedding light on the complex dynamics of extracellular DA in the brain, as well as how DA signaling alters the electrical, biochemical, and population activity of target neurons in vivo. These developments are generating novel hypotheses about the mechanisms through which DA release modifies behavior.

Ventral Subiculum Inputs to Nucleus Accumbens Medial Shell Preferentially Innervate D2R Medium Spiny Neurons and Contain Calcium Permeable AMPARs

Ventral subiculum (vSUB) is the major output region of ventral hippocampus (vHIPP) and sends major projections to nucleus accumbens medial shell (NAcMS). Hyperactivity of the vSUB-NAcMS circuit is associated with substance use disorders and the modulation of vSUB activity alters drug seeking and drug reinstatement behavior in rodents. However, to the best of our knowledge, the cell type-specific connectivity and synaptic transmission properties of the vSUB-NAcMS circuit have never been directly examined. Instead, previous functional studies have focused on total ventral hippocampal (vHIPP) output to NAcMS without distinguishing vSUB from other subregions of vHIPP, including ventral CA1 (vCA1). Using ex vivo electrophysiology, we systematically characterized the vSUB-NAcMS circuit with cell type- and synapse-specific resolution in male and female mice and found that vSUB output to dopamine receptor type-1 (D1R) and type-2 (D2R) expressing medium spiny neurons (MSNs) displays a functional connectivity bias for D2R MSNs. Furthermore, we found that vSUB-D1R and vSUB-D2R MSN synapses contain calcium-permeable AMPA receptors in drug-naive mice. Finally, we find that, distinct from other glutamatergic inputs, cocaine exposure selectively induces plasticity at vSUB-D2R synapses. Importantly, we directly compared vSUB and vCA1 output to NAcMS and found that vSUB synapses are functionally distinct and that vCA1 output recapitulated the synaptic properties previously ascribed to vHIPP. Our work highlights the need to consider the contributions of individual subregions of vHIPP to substance use disorders and represents an important first step toward understanding how the vSUB-NAcMS circuit contributes to the etiologies that underlie substance use disorders.SIGNIFICANCE STATEMENT Inputs to nucleus accumbens (NAc) dopamine receptor type 1 (D1R) and D2R medium spiny neurons (MSNs) are critically involved in reward seeking behavior. Ventral subiculum (vSUB) provides robust synaptic input to nucleus accumbens medial shell (NAcMS) and activity of this circuit is linked to substance use disorders. Despite the importance of the vSUB to nucleus accumbens circuit, the functional connectivity and synaptic transmission properties have not been tested. Here, we systematically interrogated these properties and found that basal connectivity and drug-induced plasticity are biased for D2R medium spiny neurons. Overall, we demonstrate that this circuit is distinct from synaptic inputs from other brain regions, which helps to explain how vSUB dysfunction contributes to the etiologies that underlie substance use disorders.

Cell-type specific synaptic plasticity in dorsal striatum is associated with punishment-resistance compulsive-like cocaine self-administration in mice

Addiction-related compulsion-like behavior can be modeled in rodents with drug self-administration (SA) despite harmful consequences. Recent studies suggest that the potentiation of glutamatergic transmission at the orbitofrontal cortex (OFC) to dorsal striatum (DS) synapses drives the transition from controlled to compulsion-like SA. However, the timing of the induction of this synaptic plasticity remains elusive. Here, mice were first allowed to intravenously self-administer cocaine. When mice had to endure a risk of electrical foot shock, only a fraction persevered in cocaine SA. In these persevering mice, we recorded high A/N ratios (AMPA-R/NMDA-R: α-amino-3hydroxy-5-methyl-4-isoxazolepropionic acid receptor/N-methyl-D-aspartate receptor) in both types of spiny projection neurons (i.e., D1 and D2 dopamine receptor-expressing SPNs). By contrast, when we prepared slices at the end of the acquisition period, in all mice, the A/N was high in D1R- but not D2R-SPNs. These results indicate that the transition to compulsion-like cocaine SA emerges during the punishment sessions, where synapses onto D2R-SPNs are strengthened. In renouncing individuals, the cocaine-evoked strengthening in D1R-SPNs is lost. Our study thus reveals the cell-type specific sequence of the induction of plasticity that eventually may cause compulsion-like SA.

Genes and pathways associated with fear discrimination identified by genome-wide DNA methylation and RNA-seq analyses in nucleus accumbens in mice

Fear memory is critical for individual survival. However, the maladaptive fear response is one of the hallmarks of fear-related disorders, which is characterized by the failure to discriminate threatening signals from neutral or safe cues. The biological mechanisms of fear discrimination remain to be clarified. In this study, we found that the nucleus accumbens (NAc) was indispensable for the formation of cued fear memory in mice, during which the expression of DNA methyltransferase 3a gene (DNMT3a) increased. Injection of Zebularine, a nonspecific DNMT inhibitor, into NAc immediately after conditioning induced a maladaptive fear response to neutral cue (CS^-). Using whole-genome bisulfite sequencing (WGBS), differentially methylated sites and methylated regions (DMRs) were investigated. 16,226 DMRs in the genenome were identified, in which, 214 genes with significant differences in their methylation levels and mRNA expression profiles were identified through correlation analysis. Notably, 15 genes were synaptic function-related and 8 genes were enriched in the cGMP-PKG signaling pathway. Moreover, inhibition of PKG impaired fear discrimination. Together, our results revealed the profile and role of genome-wide DNA methylation in NAc in the regulation of fear discrimination.

Opponent Learning with Different Representations in the Cortico-Basal Ganglia Circuits

The direct and indirect pathways of the basal ganglia (BG) have been suggested to learn mainly from positive and negative feedbacks, respectively. Since these pathways unevenly receive inputs from different cortical neuron types and/or regions, they may preferentially use different state/action representations. We explored whether such a combined use of different representations, coupled with different learning rates from positive and negative reward prediction errors (RPEs), has computational benefits. We modeled animal as an agent equipped with two learning systems, each of which adopted individual representation (IR) or successor representation (SR) of states. With varying the combination of IR or SR and also the learning rates from positive and negative RPEs in each system, we examined how the agent performed in a dynamic reward navigation task. We found that combination of SR-based system learning mainly from positive RPEs and IR-based system learning mainly from negative RPEs could achieve a good performance in the task, as compared with other combinations. In such a combination of appetitive SR-based and aversive IR-based systems, both systems show activities of comparable magnitudes with opposite signs, consistent with the suggested profiles of the two BG pathways. Moreover, the architecture of such a combination provides a novel coherent explanation for the functional significance and underlying mechanism of diverse findings about the cortico-BG circuits. These results suggest that particularly combining different representations with appetitive and aversive learning could be an effective learning strategy in certain dynamic environments, and it might actually be implemented in the cortico-BG circuits.

Unraveling the mysteries of dendritic spine dynamics: Five key principles shaping memory and cognition

Recent research extends our understanding of brain processes beyond just action potentials and chemical transmissions within neural circuits, emphasizing the mechanical forces generated by excitatory synapses on dendritic spines to modulate presynaptic function. From in vivo and in vitro studies, we outline five central principles of synaptic mechanics in brain function: P1: Stability - Underpinning the integral relationship between the structure and function of the spine synapses. P2: Extrinsic dynamics - Highlighting synapse-selective structural plasticity which plays a crucial role in Hebbian associative learning, distinct from pathway-selective long-term potentiation (LTP) and depression (LTD). P3: Neuromodulation - Analyzing the role of G-protein-coupled receptors, particularly dopamine receptors, in time-sensitive modulation of associative learning frameworks such as Pavlovian classical conditioning and Thorndike's reinforcement learning (RL). P4: Instability - Addressing the intrinsic dynamics crucial to memory management during continual learning, spotlighting their role in "spine dysgenesis" associated with mental disorders. P5: Mechanics - Exploring how synaptic mechanics influence both sides of synapses to establish structural traces of short- and long-term memory, thereby aiding the integration of mental functions. We also delve into the historical background and foresee impending challenges.

Positive allosteric adenosine A2A receptor modulation suppresses insomnia associated with mania- and schizophrenia-like behaviors in mice

Background: Insomnia is associated with psychiatric illnesses such as bipolar disorder or schizophrenia. Treating insomnia improves psychotic symptoms severity, quality of life, and functional outcomes. Patients with psychiatric disorders are often dissatisfied with the available therapeutic options for their insomnia. In contrast, positive allosteric modulation of adenosine A_2A receptors (A_2ARs) leads to slow-wave sleep without cardiovascular side effects in contrast to A_2AR agonists. Methods: We investigated the hypnotic effects of A_2AR positive allosteric modulators (PAMs) in mice with mania-like behavior produced by ablating GABAergic neurons in the ventral medial midbrain/pons area and in a mouse model of schizophrenia by knocking out of microtubule-associated protein 6. We also compared the properties of sleep induced by A_2AR PAMs in mice with mania-like behavior with those induced by DORA-22, a dual orexin receptor antagonist that improves sleep in pre-clinical models, and the benzodiazepine diazepam. Results: A_2AR PAMs suppress insomnia associated with mania- or schizophrenia-like behaviors in mice. A_2AR PAM-mediated suppression of insomnia in mice with mania-like behavior was similar to that mediated by DORA-22, and, unlike diazepam, did not result in abnormal sleep. Conclusion: A_2AR allosteric modulation may represent a new therapeutic avenue for sleep disruption associated with bipolar disorder or psychosis.

Introduction: What Are Dendritic Spines?

Dendritic spines are cellular specializations that greatly increase the connectivity of neurons and modulate the "weight" of most postsynaptic excitatory potentials. Spines are found in very diverse animal species providing neural networks with a high integrative and computational possibility and plasticity, enabling the perception of sensorial stimuli and the elaboration of a myriad of behavioral displays, including emotional processing, memory, and learning. Humans have trillions of spines in the cerebral cortex, and these spines in a continuum of shapes and sizes can integrate the features that differ our brain from other species. In this chapter, we describe (1) the discovery of these small neuronal protrusions and the search for the biological meaning of dendritic spines; (2) the heterogeneity of shapes and sizes of spines, whose structure and composition are associated with the fine-tuning of synaptic processing in each nervous area, as well as the findings that support the role of dendritic spines in increasing the wiring of neural circuits and their functions; and (3) within the intraspine microenvironment, the integration and activation of signaling biochemical pathways, the compartmentalization of molecules or their spreading outside the spine, and the biophysical properties that can affect parent dendrites. We also provide (4) examples of plasticity involving dendritic spines and neural circuits relevant to species survival and comment on (5) current research advancements and challenges in this exciting research field.

Regional gene expression patterns are associated with task-specific brain activation during reward and emotion processing measured with functional MRI

The exploration of the spatial relationship between gene expression profiles and task-evoked response patterns known to be altered in neuropsychiatric disorders, for example depression, can guide the development of more targeted therapies. Here, we estimated the correlation between human transcriptome data and two different brain activation maps measured with functional magnetic resonance imaging (fMRI) in healthy subjects. Whole-brain activation patterns evoked during an emotional face recognition task were associated with topological mRNA expression of genes involved in cellular transport. In contrast, fMRI activation patterns related to the acceptance of monetary rewards were associated with genes implicated in cellular localization processes, metabolism, translation, and synapse regulation. An overlap of these genes with risk genes from major depressive disorder genome-wide association studies revealed the involvement of the master regulators TCF4 and PAX6 in emotion and reward processing. Overall, the identification of stable relationships between spatial gene expression profiles and fMRI data may reshape the prospects for imaging transcriptomics studies.

Reward and aversion processing by input-defined parallel nucleus accumbens circuits in mice

The nucleus accumbens (NAc) is critical in mediating reward seeking and is also involved in negative emotion processing, but the cellular and circuitry mechanisms underlying such opposing behaviors remain elusive. Here, using the recently developed AAV1-mediated anterograde transsynaptic tagging technique in mice, we show that NAc neurons receiving basolateral amygdala inputs (NAc^BLA) promote positive reinforcement via disinhibiting dopamine neurons in the ventral tegmental area (VTA). In contrast, NAc neurons receiving paraventricular thalamic inputs (NAc^PVT) innervate GABAergic neurons in the lateral hypothalamus (LH) and mediate aversion. Silencing the synaptic output of NAc^BLA neurons impairs reward seeking behavior, while silencing of NAc^PVT or NAc^PVT→LH pathway abolishes aversive symptoms of opiate withdrawal. Our results elucidate the afferent-specific circuit architecture of the NAc in controlling reward and aversion.

Nigrostriatal dopamine pathway regulates auditory discrimination behavior

The auditory striatum, the tail portion of dorsal striatum in basal ganglia, is implicated in perceptual decision-making, transforming auditory stimuli to action outcomes. Despite its known connections to diverse neurological conditions, the dopaminergic modulation of sensory striatal neuronal activity and its behavioral influences remain unknown. We demonstrated that the optogenetic inhibition of dopaminergic projections from the substantia nigra pars compacta to the auditory striatum specifically impairs mouse choice performance but not movement in an auditory frequency discrimination task. In vivo dopamine and calcium imaging in freely behaving mice revealed that this dopaminergic projection modulates striatal tone representations, and tone-evoked striatal dopamine release inversely correlated with the evidence strength of tones. Optogenetic inhibition of D1-receptor expressing neurons and pharmacological inhibition of D1 receptors in the auditory striatum dampened choice performance accuracy. Our study uncovers a phasic mechanism within the nigrostriatal system that regulates auditory decisions by modulating ongoing auditory perception.

The auditory striatum, the tail portion of dorsal striatum, is implicated in decision-making. This study uncovers a phasic mechanism within the nigrostriatal system that regulates auditory decisions by modulating ongoing auditory perception.

Infralimbic medial prefrontal cortex signalling to calbindin 1 positive neurons in posterior basolateral amygdala suppresses anxiety- and depression-like behaviours

Generalization is a fundamental cognitive ability of organisms to deal with the uncertainty in real-world situations. Excessive fear generalization and impaired reward generalization are closely related to many psychiatric disorders. However, the neural circuit mechanism for reward generalization and its role in anxiety-like behaviours remain elusive. Here, we found a robust activation of calbindin 1-neurons (Calb 1) in the posterior basolateral amygdala (pBLA), simultaneous with reward generalization to an ambiguous cue after reward conditioning in mice. We identify the infralimbic medial prefrontal cortex (IL) to the pBLA^Calb1 (Calb 1 neurons in the pBLA) pathway as being involved in reward generalization for the ambiguity. Activating IL–pBLA inputs strengthens reward generalization and reduces chronic unpredictable mild stress-induced anxiety- and depression-like behaviours in a manner dependent on pBLA^Calb1 neuron activation. These findings suggest that the IL–pBLA^Calb1 circuit could be a target to promote stress resilience via reward generalization and consequently ameliorate anxiety- and depression-like behaviours.

The neural mechanisms for reward generalization are not fully understood. Here the authors investigate the role of posterior basolateral amygdala calbindin-expressing cells in modulating behavioural responses related to reward and aversion.

Dopamine Receptors: Is It Possible to Become a Therapeutic Target for Depression?

Dopamine and its receptors are currently recognized targets for the treatment of several neuropsychiatric disorders, including Parkinson’s disease, schizophrenia, some drug use addictions, as well as depression. Dopamine receptors are widely distributed in various regions of the brain, but their role and exact contribution to neuropsychiatric diseases has not yet been thoroughly studied. Based on the types of dopamine receptors and their distribution in different brain regions, this paper reviews the current research status of the molecular, cellular and circuit mechanisms of dopamine and its receptors involved in depression. Multiple lines of investigation of these mechanisms provide a new future direction for understanding the etiology and treatment of depression and potential new targets for antidepressant treatments.

Cocaine induces input and cell-type-specific synaptic plasticity in ventral pallidum-projecting nucleus accumbens medium spiny neurons

Cocaine use and abstinence induce long-term synaptic alterations in the excitatory input to nucleus accumbens (NAc) medium spiny neurons (MSNs). The NAc regulates reward-related behaviors through two parallel projections to the ventral pallidum (VP)-originating in D1 or D2-expressing MSNs (D1-MSNs_→VP; D2-MSNs_→VP). The activity of these projections depends on their excitatory synaptic inputs, but it is not known whether and how abstinence from cocaine affects the excitatory transmission to D1-MSNs_→VP and D2-MSNs_→VP. Here we examined different forms of cocaine-induced synaptic plasticity in the inputs from the basolateral amygdala (BLA) and medial prefrontal cortex (mPFC) to NAc D1-MSNs_→VP and putative D2-MSNs_→VP (pD2-MSNs_→VP) in the core and shell subcompartments of the NAc. We used the whole-cell patch-clamp technique to record excitatory postsynaptic currents from D1-tdTomato mice injected with ChR2 in either the BLA or the mPFC and retrograde tracer (RetroBeads) in the VP. We found that cocaine conditioned place preference (CPP) followed by abstinence potentiated the excitatory input from the BLA and mPFC to both D1-MSNs_→VP and pD2-MSNs_→VP. Interestingly, while the strengthening of the inputs to D1-MSNs_→VP was of postsynaptic origin and manifested as increased AMPA to NMDA ratio, in pD2-MSNs_→VP plasticity was predominantly presynaptic and was detected as changes in the paired-pulse ratio and coefficient of variation. Lastly, some of the changes were sex-specific. Overall our data show that abstinence from cocaine changes the excitatory inputs to both D1-MSNs_→VP and pD2-MSNs_→VP but with different mechanisms. This may help understand how circuits converging into the VP change after cocaine exposure.

Deep Brain Stimulation for Addictive Disorders-Where Are We Now?

In the face of a global epidemic of drug addiction, neglecting to develop new effective therapies will perpetuate the staggering human and economic costs of substance use. This review aims to summarize and evaluate the preclinical and clinical studies of deep brain stimulation (DBS) as a novel therapy for refractory addiction, in hopes to engage and inform future research in this promising novel treatment avenue. An electronic database search (MEDLINE, EMBASE, Cochrane library) was performed using keywords and predefined inclusion criteria between 1974 and 6/18/2021 (registered on Open Science Registry). Selected articles were reviewed in full text and key details were summarized and analyzed to understand DBS' therapeutic potential and possible mechanisms of action. The search yielded 25 animal and 22 human studies. Animal studies showed that DBS of targets such as nucleus accumbens (NAc), insula, and subthalamic nucleus reduces drug use and seeking. All human studies were case series/reports (level 4/5 evidence), mostly targeting the NAc with generally positive outcomes. From the limited evidence in the literature, DBS, particularly of the NAc, appears to be a reasonable last resort option for refractory addictive disorders. We propose that future research in objective electrophysiological (e.g., local field potentials) and neurochemical (e.g., extracellular dopamine levels) biomarkers would assist monitoring the progress of treatment and developing a closed-loop DBS system. Preclinical literature also highlighted the prefrontal cortex as a promising DBS target, which should be explored in human research.

Action suppression reveals opponent parallel control via striatal circuits

The direct and indirect pathways of the basal ganglia are classically thought to promote and suppress action, respectively¹. However, the observed co-activation of striatal direct and indirect medium spiny neurons² (dMSNs and iMSNs, respectively) has challenged this view. Here we study these circuits in mice performing an interval categorization task that requires a series of self-initiated and cued actions and, critically, a sustained period of dynamic action suppression. Although movement produced the co-activation of iMSNs and dMSNs in the sensorimotor, dorsolateral striatum (DLS), fibre photometry and photo-identified electrophysiological recordings revealed signatures of functional opponency between the two pathways during action suppression. Notably, optogenetic inhibition showed that DLS circuits were largely engaged to suppress-and not promote-action. Specifically, iMSNs on a given hemisphere were dynamically engaged to suppress tempting contralateral action. To understand how such regionally specific circuit function arose, we constructed a computational reinforcement learning model that reproduced key features of behaviour, neural activity and optogenetic inhibition. The model predicted that parallel striatal circuits outside the DLS learned the action-promoting functions, generating the temptation to act. Consistent with this, optogenetic inhibition experiments revealed that dMSNs in the associative, dorsomedial striatum, in contrast to those in the DLS, promote contralateral actions. These data highlight how opponent interactions between multiple circuit- and region-specific basal ganglia processes can lead to behavioural control, and establish a critical role for the sensorimotor indirect pathway in the proactive suppression of tempting actions.

Distinct representation of cue-outcome association by D1 and D2 neurons in the ventral striatum's olfactory tubercle

Positive and negative associations acquired through olfactory experience are thought to be especially strong and long-lasting. The conserved direct olfactory sensory input to the ventral striatal olfactory tubercle (OT) and its convergence with dense dopaminergic input to the OT could underlie this privileged form of associative memory, but how this process occurs is not well understood. We imaged the activity of the two canonical types of striatal neurons, expressing D1- or D2-type dopamine receptors, in the OT at cellular resolution while mice learned odor-outcome associations ranging from aversive to rewarding. D1 and D2 neurons both responded to rewarding and aversive odors. D1 neurons in the OT robustly and bidirectionally represented odor valence, responding similarly to odors predicting similar outcomes regardless of odor identity. This valence representation persisted even in the absence of a licking response to the odors and in the absence of the outcomes, indicating a true transformation of odor sensory information by D1 OT neurons. In contrast, D2 neuronal representation of the odor-outcome associations was weaker, contingent on a licking response by the mouse, and D2 neurons were more selective for odor identity than valence. Stimulus valence coding in the OT was modality-sensitive, with separate sets of D1 neurons responding to odors and sounds predicting the same outcomes, suggesting that integration of multimodal valence information happens downstream of the OT. Our results point to distinct representation of identity and valence of odor stimuli by D1 and D2 neurons in the OT.

Cholinergic interneurons mediate cocaine extinction in male mice through plasticity across medium spiny neuron subtypes

Cholinergic interneurons (ChINs) in the nucleus accumbens (NAc) have been implicated in the extinction of drug associations, as well as related plasticity in medium spiny neurons (MSNs). However, since most previous work relied on artificial manipulations, whether endogenous acetylcholine signaling relates to drug associations is unclear. Moreover, despite great interest in the opposing effects of dopamine on MSN subtypes, whether ChIN-mediated effects vary by MSN subtype is also unclear. Here, we find that high endogenous acetylcholine event frequency correlates with greater extinction of cocaine-context associations across male mice. Additionally, extinction is associated with a weakening of glutamatergic synapses across MSN subtypes. Manipulating ChIN activity bidirectionally controls both the rate of extinction and the associated plasticity at MSNs. Our findings indicate that NAc ChINs mediate drug-context extinction by reducing glutamatergic synaptic strength across MSN subtypes, and that natural variation in acetylcholine signaling may contribute to individual differences in extinction.

Fleming et al. show that individual differences in nucleus accumbens (NAc) acetylcholine signaling correlate with extinction of a cocaine-context association. Manipulations of NAc cholinergic interneuron activity support a model where acetylcholine release weakens glutamatergic presynaptic strength at NAc D1R and D2R medium spiny neurons, promoting cocaine-context extinction.

The Absence of Caspase-8 in the Dopaminergic System Leads to Mild Autism-like Behavior

In the last decade, new non-apoptotic roles have been ascribed to apoptotic caspases. This family of proteins plays an important role in the sculpting of the brain in the early stages of development by eliminating excessive and nonfunctional synapses and extra cells. Consequently, impairments in this process can underlie many neurological and mental illnesses. This view is particularly relevant to dopamine because it plays a pleiotropic role in motor control, motivation, and reward processing. In this study, we analyze the effects of the elimination of caspase-8 (CASP8) on the development of catecholaminergic neurons using neurochemical, ultrastructural, and behavioral tests. To do this, we selectively delete the CASP8 gene in cells that express tyrosine hydroxylase with the help of recombination through the Cre-loxP system. Our results show that the number of dopaminergic neurons increases in the substantia nigra. In the striatum, the basal extracellular level of dopamine and potassium-evoked dopamine release decreased significantly in mice lacking CASP8, clearly showing the low dopamine functioning in tissues innervated by this neurotransmitter. This view is supported by electron microscopy analysis of striatal synapses. Interestingly, behavioral analysis demonstrates that mice lacking CASP8 show changes reminiscent of autism spectrum disorders (ASD). Our research reactivates the possible role of dopamine transmission in the pathogenesis of ASD and provides a mild model of autism.

A whole brain probabilistic generative model: Toward realizing cognitive architectures for developmental robots

Building a human-like integrative artificial cognitive system, that is, an artificial general intelligence (AGI), is the holy grail of the artificial intelligence (AI) field. Furthermore, a computational model that enables an artificial system to achieve cognitive development will be an excellent reference for brain and cognitive science. This paper describes an approach to develop a cognitive architecture by integrating elemental cognitive modules to enable the training of the modules as a whole. This approach is based on two ideas: (1) brain-inspired AI, learning human brain architecture to build human-level intelligence, and (2) a probabilistic generative model (PGM)-based cognitive architecture to develop a cognitive system for developmental robots by integrating PGMs. The proposed development framework is called a whole brain PGM (WB-PGM), which differs fundamentally from existing cognitive architectures in that it can learn continuously through a system based on sensory-motor information. In this paper, we describe the rationale for WB-PGM, the current status of PGM-based elemental cognitive modules, their relationship with the human brain, the approach to the integration of the cognitive modules, and future challenges. Our findings can serve as a reference for brain studies. As PGMs describe explicit informational relationships between variables, WB-PGM provides interpretable guidance from computational sciences to brain science. By providing such information, researchers in neuroscience can provide feedback to researchers in AI and robotics on what the current models lack with reference to the brain. Further, it can facilitate collaboration among researchers in neuro-cognitive sciences as well as AI and robotics.