Opposite initialization to novel cues in dopamine signaling in ventral and posterior striatum in mice

Dopaminergic action prediction errors serve as a value-free teaching signal

Choice behaviour of animals is characterized by two main tendencies: taking actions that led to rewards and repeating past actions1,2. Theory suggests that these strategies may be reinforced by different types of dopaminergic teaching signals: reward prediction error to reinforce value-based associations and movement-based action prediction errors to reinforce value-free repetitive associations3-6. Here we use an auditory discrimination task in mice to show that movement-related dopamine activity in the tail of the striatum encodes the hypothesized action prediction error signal. Causal manipulations reveal that this prediction error serves as a value-free teaching signal that supports learning by reinforcing repeated associations. Computational modelling and experiments demonstrate that action prediction errors alone cannot support reward-guided learning, but when paired with the reward prediction error circuitry they serve to consolidate stable sound-action associations in a value-free manner. Together we show that there are two types of dopaminergic prediction errors that work in tandem to support learning, each reinforcing different types of association in different striatal areas.

Dopamine induces fear extinction by activating the reward-responding amygdala neurons

The extinction of conditioned fear responses is crucial for adaptive behavior, and its impairment is a hallmark of anxiety disorders such as posttraumatic stress disorder. Fear extinction takes place when animals form a new memory that suppresses the original fear memory. In the case of context-dependent fear memory, the new memory is formed within the reward-responding posterior subset of basolateral amygdala (BLA) that is genetically marked by Ppp1r1b+ neurons. These memory engram cells suppress the activity of the original fear-responding Rspo2+ engram cells present in the anterior BLA, hence fear extinction. However, the neurological nature of the teaching signal that instructs the formation of fear extinction memory in the Ppp1r1b+ neurons is unknown. Here, we demonstrate that ventral tegmental area (VTA) dopaminergic signaling drives fear extinction in distinct BLA neuronal populations. We show that BLA fear and extinction neuronal populations receive topographically divergent inputs from VTA dopaminergic neurons via differentially expressed dopamine receptors. Fiber photometry recordings of dopaminergic activity in the BLA reveal that dopamine (DA) activity is time-locked to freezing cessation in BLA fear extinction neurons, but not BLA fear neurons. Furthermore, this dopaminergic activity in BLA fear extinction neurons correlates with extinction learning. Finally, using projection-specific optogenetic manipulation, we find that activation of the VTA DA projections to BLA reward and fear neurons accelerated or impaired fear extinction, respectively. Together, this work demonstrates that dopaminergic activity bidirectionally controls fear extinction by distinct patterns of activity at BLA fear and extinction neurons.

The devilish details affecting TDRL models in dopamine research

Over recent decades, temporal difference reinforcement learning (TDRL) models have successfully explained much dopamine (DA) activity. This success has invited heightened scrutiny of late, with many studies challenging the validity of TDRL models of DA function. Yet, when evaluating the validity of these models, the devil is truly in the details. TDRL is a broad class of algorithms sharing core ideas but differing greatly in implementation and predictions. Thus, it is important to identify the defining aspects of the TDRL framework being tested and to use state spaces and model architectures that capture the known complexity of the behavioral representations and neural systems involved. Here, we discuss several examples that illustrate the importance of these considerations.

Dopamine in the tail of the striatum facilitates avoidance in threat-reward conflicts

Responding appropriately to potential threats before they materialize is critical to avoiding disastrous outcomes. Here we examine how threat-coping behavior is regulated by the tail of the striatum (TS) and its dopamine input. Mice were presented with a potential threat (a moving object) while pursuing rewards. Initially, the mice failed to obtain rewards but gradually improved in later trials. We found that dopamine in TS promoted avoidance of the threat, even at the expense of reward acquisition. Furthermore, the activity of dopamine D1 receptor-expressing neurons promoted threat avoidance and prediction. In contrast, D2 neurons suppressed threat avoidance and facilitated overcoming the potential threat. Dopamine axon activation in TS not only potentiated the responses of dopamine D1 receptor-expressing neurons to novel sensory stimuli but also boosted them acutely. These results demonstrate that an opponent interaction of D1 and D2 neurons in the TS, modulated by dopamine, dynamically regulates avoidance and overcoming potential threats.

Dopamine prediction error signaling in a unique nigrostriatal circuit is critical for associative fear learning

Learning by experience that certain cues in the environment predict danger is crucial for survival. How dopamine (DA) circuits drive this form of associative learning is not fully understood. Here, in male mice, we demonstrate that DA neurons projecting to a unique subregion of the dorsal striatum, the posterior tail of the striatum (TS), encode a prediction error (PE) signal during associative fear learning. These DA neurons are necessary specifically during acquisition of fear learning, but not once the fear memory is formed, and are not required for forming cue-reward associations. Notably, temporally-precise inhibition or excitation of DA terminals in TS impairs or enhances fear learning, respectively. Furthermore, neuronal activity in TS is crucial for the acquisition of associative fear learning and learning-induced activity patterns in TS critically depend on DA input. Together, our results reveal that DA PE signaling in a non-canonical nigrostriatal circuit is important for driving associative fear learning.

Dopamine and acetylcholine correlations in the nucleus accumbens depend on behavioral task states

Dopamine release in the nucleus accumbens (NAcc) changes quickly in response to errors in predicting events like reward delivery1,2,3 but also slowly ramps up when animals are moving toward a goal.4,5,6,7,8,9,10 This ramping has attracted much recent attention, as there is controversy regarding its computational role5,7,9,11 and whether they are driven by dopamine neuron firing7,8,9 or local circuit mechanisms.5,6 If the latter is true, cholinergic transmission would be a prime candidate mechanism,12,13,14 and acetylcholine and dopamine signals should be positively correlated during behavior, particularly during motivated approach. However, in the dorsal striatum, striatal cholinergic interneurons typically "dip" their activity when reward or associated cues are presented, in opposition to dopamine,15,16,17,18 and acetylcholine and dopamine release is generally anti-correlated in vivo.19,20 Furthermore, acetylcholine and dopamine have opposing effects on downstream striatal projection neurons (SPNs),21,22 which suggests that cholinergic dips create a permissive window for dopamine to drive plasticity.23 These studies therefore suggest that dopamine and acetylcholine should be anti-correlated during behavior. We tested between these hypotheses by simultaneously recording accumbal dopamine and acetylcholine signals in rats executing a task involving motivated approach. We found that dopamine ramps were not coincidental with changes in acetylcholine. Instead, acetylcholine was positively, negatively, or uncorrelated with dopamine depending on the task phase. Our results suggest that accumbal dopamine and acetylcholine dynamics are largely independent but may combine to engage different postsynaptic mechanisms depending on task demands.

A corticostriatal learning mechanism linking excess striatal dopamine and auditory hallucinations

Auditory hallucinations are linked to elevated striatal dopamine, but their underlying computational mechanisms have been obscured by regional heterogeneity in striatal dopamine signaling. To address this, we developed a normative circuit model in which corticostriatal plasticity in the ventral striatum is modulated by reward prediction errors to drive reinforcement learning while that in the sensory-dorsal striatum is modulated by sensory prediction errors derived from internal belief to drive self-supervised learning. We then validate the key predictions of this model using dopamine recordings across striatal regions in mice, as well as human behavior in a hybrid learning task. Finally, we find that changes in learning resulting from optogenetic stimulation of the sensory striatum in mice and individual variability in hallucination proneness in humans are best explained by selectively enhancing dopamine levels in the model sensory striatum. These findings identify plasticity mechanisms underlying biased learning of sensory expectations as a biologically plausible link between excess dopamine and hallucinations.

Mice Born to Mothers Fed a Diet High in Omega-6 Fatty Acids and Low in Omega-3 Fatty Acids During Pregnancy Exhibit Various Behavioral Changes Including Impaired Social Behaviors and Enhanced Recognition Memory

BACKGROUND

Modern dietary trends have led to an increase in foods that are relatively high in n-6 PUFAs and low in n-3 PUFAs. We previously reported that the offspring of mother mice that consumed a diet high in n-6 linoleic acid (LA) and low in n-3 α-linolenic acid (ALA), hereinafter called the LAhigh/ALAlow diet, exhibited behavioral abnormalities related to anxiety and feeding.

OBJECTIVES

We currently lack a comprehensive overview of the behavioral abnormalities in these offspring, which was investigated in this study.

METHODS

C57BL/6J virgin female mice at 11 wk of age were fed either a control diet or the LAhigh/ALAlow diet, mated at 13 wk of age, and maintained on their respective diet throughout gestation. At birth, the lactating mothers' diet was replaced with standard laboratory feed pellets. After weaning, the offspring continued to receive standard laboratory feed pellets, and both male and female offspring at 1-63 wk of age were analyzed using a comprehensive behavioral test battery (n = 6-14 offspring/group and offspring in each group were derived from ≥3 independent litters).

RESULTS

Both male and female offspring exposed in utero to the LAhigh/ALAlow diet exhibited impaired social behaviors, including the lower number of contacts with novel mice in the social interaction test [diet, F(1,15) = 9.807, P = 0.007, 2-way analysis of variance (ANOVA)], and also showed enhanced recognition memory in the object location test (diet, F(1,36) = 6.779, P = 0.013, 2-way ANOVA) compared with offspring exposed in utero to the control diet. In addition, compared with sex-matched controls, female offspring displayed hyperactivity in the open field test (F(1,36) = 6.097, P = 0.018, simple main effect analysis).

CONCLUSIONS

The maternal balance between dietary n-6 and n-3 PUFAs during pregnancy can have significant effects on the offspring's behaviors, lasting well into adulthood.

Establishing functionally segregated dopaminergic circuits

Despite accounting for only ~0.001% of all neurons in the human brain, midbrain dopaminergic neurons control numerous behaviors and are associated with many neuropsychiatric disorders that affect our physical and mental health. Dopaminergic neurons form various anatomically and functionally segregated pathways. Having such defined dopaminergic pathways is key to controlling varied sets of brain functions; therefore, segregated dopaminergic pathways must be properly and uniquely formed during development. How are these segregated pathways established? The three key developmental stages that dopaminergic neurons go through are cell migration, axon guidance, and synapse formation. In each stage, dopaminergic neurons and their processes receive unique molecular cues to guide the formation of specific dopaminergic pathways. Here, we outline the molecular mechanisms underlying the establishment of segregated dopaminergic pathways during each developmental stage in the mouse brain, focusing on the formation of the three major dopaminergic pathways: the nigrostriatal, mesolimbic, and mesocortical pathways. We propose that multiple stage-specific molecular gradients cooperate to establish functionally segregated dopaminergic circuits.

Cell-type-specific auditory responses in the striatum are shaped by feedforward inhibition

The posterior "tail" region of the striatum receives dense innervation from sensory brain regions and is important for behaviors that require sensorimotor integration. The output neurons of the striatum, D1 and D2 striatal projection neurons (SPNs), which make up the direct and indirect pathways, are thought to play distinct functional roles, although it remains unclear if these neurons show cell-type-specific differences in their response to sensory stimuli. Here, we examine the strength of synaptic inputs onto D1 and D2 SPNs following the stimulation of upstream auditory pathways. We report that auditory-evoked depolarizations onto D1 SPN responses are stronger and faster. This is due to differences in feedforward inhibition, with fast-spiking interneurons forming stronger synapses onto D2 SPNs. Our results support a model in which differences in feedforward inhibition enable the preferential recruitment of D1 SPNs by auditory stimuli, positioning the direct pathway to initiate sound-driven actions.

Dopaminergic signaling to ventral striatum neurons initiates sniffing behavior

Sniffing is a motivated behavior displayed by nearly all terrestrial vertebrates. While sniffing is associated with acquiring and processing odors, sniffing is also intertwined with affective and motivated states. The systems which influence the display of sniffing are unclear. Here, we report that dopamine release into the ventral striatum in mice is coupled with bouts of sniffing and that stimulation of dopaminergic terminals in these regions drives increases in respiratory rate to initiate sniffing whereas inhibition of these terminals reduces respiratory rate. Both the firing of individual neurons and the activity of post-synaptic D1 and D2 dopamine receptor-expressing neurons are coupled with sniffing and local antagonism of D1 and D2 receptors squelches sniffing. Together, these results support a model whereby sniffing can be initiated by dopamine's actions upon ventral striatum neurons. The nature of sniffing being integral to both olfaction and motivated behaviors implicates this circuit in a wide array of functions.

Dopaminergic circuits controlling threat and safety learning

The ability to learn from experience that certain cues and situations are associated with threats or safety is crucial for survival and adaptive behavior. Understanding the neural substrates of threat and safety learning has high clinical significance because deficits in these forms of learning characterize anxiety disorders. Traditionally, dopamine neurons were thought to uniformly support reward learning by signaling reward prediction errors. However, the dopamine system is functionally more diverse than was initially appreciated and is also critical for processing threat and safety. In this review, I highlight recent studies demonstrating that dopamine neurons generate prediction errors for threat and safety, and describe how dopamine projections to the amygdala, medial prefrontal cortex (mPFC), and striatum regulate associative threat and safety learning.

Pre-existing visual responses in a projection-defined dopamine population explain individual learning trajectories

A key challenge of learning a new task is that the environment is high dimensional-there are many different sensory features and possible actions, with typically only a small reward-relevant subset. Although animals can learn to perform complex tasks that involve arbitrary associations between stimuli, actions, and rewards,1,2,3,4,5,6 a consistent and striking result across varied experimental paradigms is that in initially acquiring such tasks, large differences between individuals are apparent in the learning process.7,8,9,10,11,12 What neural mechanisms contribute to initial task acquisition, and why do some individuals learn a new task much more quickly than others? To address these questions, we recorded longitudinally from dopaminergic (DA) axon terminals in mice learning a visual decision-making task.7 Across striatum, DA responses tracked idiosyncratic and side-specific learning trajectories, consistent with widespread reward prediction error coding across DA terminals. However, even before any rewards were delivered, contralateral-side-specific visual responses were present in DA terminals, primarily in the dorsomedial striatum (DMS). These pre-existing responses predicted the extent of learning for contralateral stimuli. Moreover, activation of these terminals improved contralateral performance. Thus, the initial conditions of a projection-specific and feature-specific DA signal help explain individual learning trajectories. More broadly, this work suggests that functional heterogeneity across DA projections may serve to bias target regions toward learning about different subsets of task features, providing a potential mechanism to address the dimensionality of the initial task learning problem.

Hunger modulates exploration through suppression of dopamine signaling in the tail of striatum

Caloric depletion leads to behavioral changes that help an animal find food and restore its homeostatic balance. Hunger increases exploration and risk-taking behavior, allowing an animal to forage for food despite risks; however, the neural circuitry underlying this change is unknown. Here, we characterize how hunger restructures an animal's spontaneous behavior as well as its directed exploration of a novel object. We show that hunger-induced changes in exploration are accompanied by and result from modulation of dopamine signaling in the tail of the striatum (TOS). Dopamine signaling in the TOS is modulated by internal hunger state through the activity of agouti-related peptide (AgRP) neurons, putative "hunger neurons" in the arcuate nucleus of the hypothalamus. These AgRP neurons are poly-synaptically connected to TOS-projecting dopaminergic neurons through the lateral hypothalamus, the central amygdala, and the periaqueductal grey. We thus delineate a hypothalamic-midbrain circuit that coordinates changes in exploration behavior in the hungry state.

Corticonigral projections recruit substantia nigra pars lateralis dopaminergic neurons for auditory threat memories

Dopaminergic neurons (DANs) in the lateral substantia nigra project to the tail of striatum (TS), which is involved in threat conditioning. Auditory cortex also contributes to threatening behaviors, but whether it directly interacts with midbrain DANs and how these interactions might influence threat conditioning remain unclear. Here, functional mapping revealed robust excitatory input from auditory and temporal association cortexes to substantia nigra pars lateralis (SNL) DANs, but not to pars compacta (SNc) DANs. SNL DANs exhibited unique firing patterns, with irregular pacemaking and higher maximal firing, reflecting different channel complements than SNc DANs. Behaviorally, inhibiting cortex to SNL projections impaired memory retrieval during auditory threat conditioning. Thus, we demonstrate robust corticonigral projections to SNL DANs, contrasting with previous observations of sparse cortical input to substantia nigra DANs. These findings distinguish SNL DANs from other nigral populations, highlighting their role in threatening behaviors and expanding knowledge of cortex to midbrain interactions.

Shifting attention to orient or avoid: a unifying account of the tail of the striatum and its dopaminergic inputs

The tail of the striatum (TS) is increasingly recognized as a unique subdivision of the striatum, characterized by its dense sensory inputs and projections received from a distinct group of dopamine neurons. Separate lines of research have characterized the functional role of TS, and TS-projecting dopamine neurons, in three realms: saccadic eye movement towards valuable visual stimuli; tone-guided choice between two options; and defensive responses to threatening stimuli. We propose a framework for reconciling these diverse roles as varied implementations of a conserved response to salient stimuli, with dopamine in TS providing a teaching signal to promote quick attentional shifts that facilitate stimulus-driven orientation and/or avoidance.

Reward timescale controls the rate of behavioural and dopaminergic learning

Learning the causes of rewards is necessary for survival. Thus, it is critical to understand the mechanisms of such a vital biological process. Cue-reward learning is controlled by mesolimbic dopamine and improves with spacing of cue-reward pairings. However, whether a mathematical rule governs such improvements in learning rate, and if so, whether a unifying mechanism captures this rule and dopamine dynamics during learning remain unknown. Here, we investigate the behavioral, algorithmic, and dopaminergic mechanisms governing cue-reward learning rate. Across a range of conditions in mice, we show a strong, mathematically proportional relationship between both behavioral and dopaminergic learning rates and the duration between rewards. Due to this relationship, removing up to 19 out of 20 cue-reward pairings over a fixed duration has no influence on overall learning. These findings are explained by a dopamine-based model of retrospective learning, thereby providing a unified account of the biological mechanisms of learning.

Explaining dopamine through prediction errors and beyond

The most influential account of phasic dopamine holds that it reports reward prediction errors (RPEs). The RPE-based interpretation of dopamine signaling is, in its original form, probably too simple and fails to explain all the properties of phasic dopamine observed in behaving animals. This Perspective helps to resolve some of the conflicting interpretations of dopamine that currently exist in the literature. We focus on the following three empirical challenges to the RPE theory of dopamine: why does dopamine (1) ramp up as animals approach rewards, (2) respond to sensory and motor features and (3) influence action selection? We argue that the prediction error concept, once it has been suitably modified and generalized based on an analysis of each computational problem, answers each challenge. Nonetheless, there are a number of additional empirical findings that appear to demand fundamentally different theoretical explanations beyond encoding RPE. Therefore, looking forward, we discuss the prospects for a unifying theory that respects the diversity of dopamine signaling and function as well as the complex circuitry that both underlies and responds to dopaminergic transmission.

Dopamine Release in the Nucleus Accumbens Core Encodes the General Excitatory Components of Learning

Dopamine release in the nucleus accumbens core (NAcC) is generally considered to be a proxy for phasic firing of the ventral tegmental area dopamine (VTADA) neurons. Thus, dopamine release in NAcC is hypothesized to reflect a unitary role in reward prediction error signaling. However, recent studies reveal more diverse roles of dopamine neurons, which support an emerging idea that dopamine regulates learning differently in distinct circuits. To understand whether the NAcC might regulate a unique component of learning, we recorded dopamine release in NAcC while male rats performed a backward conditioning task where a reward is followed by a neutral cue. We used this task because we can delineate different components of learning, which include sensory-specific inhibitory and general excitatory components. Furthermore, we have shown that VTADA neurons are necessary for both the specific and general components of backward associations. Here, we found that dopamine release in NAcC increased to the reward across learning while reducing to the cue that followed as it became more expected. This mirrors the dopamine prediction error signal seen during forward conditioning and cannot be accounted for temporal-difference reinforcement learning. Subsequent tests allowed us to dissociate these learning components and revealed that dopamine release in NAcC reflects the general excitatory component of backward associations, but not their sensory-specific component. These results emphasize the importance of examining distinct functions of different dopamine projections in reinforcement learning.

Sniffing can be initiated by dopamine's actions on ventral striatum neurons

Sniffing is a motivated behavior displayed by nearly all terrestrial vertebrates. While sniffing is associated with acquiring and processing odors, sniffing is also intertwined with affective and motivated states. The neuromodulatory systems which influence the display of sniffing are unclear. Here, we report that dopamine release into the ventral striatum is coupled with bouts of sniffing and that stimulation of dopaminergic terminals in these regions drives increases in respiratory rate to initiate sniffing whereas inhibition of these terminals reduces respiratory rate. Both the firing of individual neurons and the activity of post-synaptic D1 and D2 receptor-expressing neurons in the ventral striatum are also coupled with sniffing and local antagonism of D1 and D2 receptors squelches sniffing. Together, these results support a model whereby sniffing can be initiated by dopamine's actions upon ventral striatum neurons. The nature of sniffing being integral to both olfaction and motivated behaviors implicates this circuit in a wide array of functions.

Regional heterogeneity in the membrane properties of mouse striatal neurons

The cytoarchitecture of the striatum is remarkably homogeneous, in contrast to the regional variation in striatal functions. Whether differences in the intrinsic membrane properties of striatal neurons contribute to regional heterogeneity has not been addressed systematically. We made recordings throughout the young adult mouse striatum under identical conditions, with synaptic input blocked, from four major striatal neuron types, namely, the two subtypes of spiny projection neurons (SPNs), cholinergic interneurons (ChIs), and fast-spiking GABAergic interneurons (FSIs), sampling at least 100 cells per cell type. Regional variation manifested across all cell types. All cell types in the nucleus accumbens (NAc) shell had higher input impedance and increased excitability. Cells in the NAc core were differentiated from the caudate-putamen (CPu) for both SPN subtypes by smaller action potentials and increased excitability. Similarity between the two SPN subtypes showed regional variation, differing more in the NAc than in the CPu. So, in the Str, both the intrinsic properties of interneurons and projection neurons are regionally heterogeneous, with the greatest difference between the NAc and CPu; greater excitability of NAc shell neurons may make the region more susceptible to activity-dependent plasticity.

Rethinking dopamine-guided action sequence learning

As opposed to those requiring a single action for reward acquisition, tasks necessitating action sequences demand that animals learn action elements and their sequential order and sustain the behaviour until the sequence is completed. With repeated learning, animals not only exhibit precise execution of these sequences but also demonstrate enhanced smoothness and efficiency. Previous research has demonstrated that midbrain dopamine and its major projection target, the striatum, play crucial roles in these processes. Recent studies have shown that dopamine from the substantia nigra pars compacta (SNc) and the ventral tegmental area (VTA) serve distinct functions in action sequence learning. The distinct contributions of dopamine also depend on the striatal subregions, namely the ventral, dorsomedial and dorsolateral striatum. Here, we have reviewed recent findings on the role of striatal dopamine in action sequence learning, with a focus on recent rodent studies.

Functional diversity of dopamine axons in prefrontal cortex during classical conditioning

Midbrain dopamine neurons impact neural processing in the prefrontal cortex (PFC) through mesocortical projections. However, the signals conveyed by dopamine projections to the PFC remain unclear, particularly at the single-axon level. Here, we investigated dopaminergic axonal activity in the medial PFC (mPFC) during reward and aversive processing. By optimizing microprism-mediated two-photon calcium imaging of dopamine axon terminals, we found diverse activity in dopamine axons responsive to both reward and aversive stimuli. Some axons exhibited a preference for reward, while others favored aversive stimuli, and there was a strong bias for the latter at the population level. Long-term longitudinal imaging revealed that the preference was maintained in reward- and aversive-preferring axons throughout classical conditioning in which rewarding and aversive stimuli were paired with preceding auditory cues. However, as mice learned to discriminate reward or aversive cues, a cue activity preference gradually developed only in aversive-preferring axons. We inferred the trial-by-trial cue discrimination based on machine learning using anticipatory licking or facial expressions, and found that successful discrimination was accompanied by sharper selectivity for the aversive cue in aversive-preferring axons. Our findings indicate that a group of mesocortical dopamine axons encodes aversive-related signals, which are modulated by both classical conditioning across days and trial-by-trial discrimination within a day.

Cell-type specific auditory responses in the striatum are shaped by feed forward inhibition

The posterior "tail" region of the striatum receives dense innervation from sensory brain regions and has been demonstrated to play a role in behaviors that require sensorimotor integration including discrimination 1,2 , avoidance 3 and defense 4 responses. The output neurons of the striatum, the D1 and D2 striatal projection neurons (SPNs) that make up the direct and indirect pathways, respectively, are thought to play differential roles in these behavioral responses, although it remains unclear if or how these neurons display differential responsivity to sensory stimuli. Here, we used whole-cell recordings in vivo and ex vivo to examine the strength of excitatory and inhibitory synaptic inputs onto D1 and D2 SPNs following the stimulation of upstream auditory pathways. While D1 and D2 SPNs both displayed stimulus-evoked depolarizations, D1 SPN responses were stronger and faster for all stimuli tested in vivo as well as in brain slices. This difference did not arise from differences in the strength of excitatory inputs but from differences in the strength of feed forward inhibition. Indeed, fast spiking interneurons, which are readily engaged by auditory afferents exerted stronger inhibition onto D2 SPNs compared to D1 SPNs. Our results support a model in which differences in feed forward inhibition enable the preferential recruitment of the direct pathway in response to auditory stimuli, positioning this pathway to initiate sound-driven actions.

Dopamine and acetylcholine correlations in the nucleus accumbens depend on behavioral task states

Dopamine in the nucleus accumbens ramps up as animals approach desired goals. These ramps have received intense scrutiny because they seem to violate long-held hypotheses on dopamine function. Furthermore, it has been proposed that they are driven by local acetylcholine release, i.e., that they are mechanistically separate from dopamine signals related to reward prediction errors. Here, we tested this hypothesis by simultaneously recording accumbal dopamine and acetylcholine signals in rats executing a task involving motivated approach. Contrary to recent reports, we found that dopamine ramps were not coincidental with changes in acetylcholine. Instead, we found that acetylcholine could be positively, negatively, or uncorrelated with dopamine depending on whether the task phase was determined by a salient cue, reward prediction error, or active approach, respectively. Our results suggest that accumbal dopamine and acetylcholine are largely independent but may combine to engage different postsynaptic mechanisms depending on the behavioral task states.

Striatal dopamine signals reflect perceived cue-action-outcome associations in mice

Striatal dopamine drives associative learning by acting as a teaching signal. Much work has focused on simple learning paradigms, including Pavlovian and instrumental learning. However, higher cognition requires that animals generate internal concepts of their environment, where sensory stimuli, actions and outcomes become flexibly associated. Here, we performed fiber photometry dopamine measurements across the striatum of male mice as they learned cue-action-outcome associations based on implicit and changing task rules. Reinforcement learning models of the behavioral and dopamine data showed that rule changes lead to adjustments of learned cue-action-outcome associations. After rule changes, mice discarded learned associations and reset outcome expectations. Cue- and outcome-triggered dopamine signals became uncoupled and dependent on the adopted behavioral strategy. As mice learned the new association, coupling between cue- and outcome-triggered dopamine signals and task performance re-emerged. Our results suggest that dopaminergic reward prediction errors reflect an agent's perceived locus of control.

Targeted micro-fiber arrays for measuring and manipulating localized multi-scale neural dynamics over large, deep brain volumes during behavior

Neural population dynamics relevant to behavior vary over multiple spatial and temporal scales across three-dimensional volumes. Current optical approaches lack the spatial coverage and resolution necessary to measure and manipulate naturally occurring patterns of large-scale, distributed dynamics within and across deep brain regions such as the striatum. We designed a new micro-fiber array approach capable of chronically measuring and optogenetically manipulating local dynamics across over 100 targeted locations simultaneously in head-fixed and freely moving mice, enabling the investigation of cell-type- and neurotransmitter-specific signals over arbitrary 3D volumes at a spatial resolution and coverage previously inaccessible. We applied this method to resolve rapid dopamine release dynamics across the striatum, revealing distinct, modality-specific spatiotemporal patterns in response to salient sensory stimuli extending over millimeters of tissue. Targeted optogenetics enabled flexible control of neural signaling on multiple spatial scales, better matching endogenous signaling patterns, and the spatial localization of behavioral function across large circuits.

Glutamate inputs send prediction error of reward, but not negative value of aversive stimuli, to dopamine neurons

Midbrain dopamine neurons are thought to signal reward prediction errors (RPEs), but the mechanisms underlying RPE computation, particularly the contributions of different neurotransmitters, remain poorly understood. Here, we used a genetically encoded glutamate sensor to examine the pattern of glutamate inputs to dopamine neurons in mice. We found that glutamate inputs exhibit virtually all of the characteristics of RPE rather than conveying a specific component of RPE computation, such as reward or expectation. Notably, whereas glutamate inputs were transiently inhibited by reward omission, they were excited by aversive stimuli. Opioid analgesics altered dopamine negative responses to aversive stimuli into more positive responses, whereas excitatory responses of glutamate inputs remained unchanged. Our findings uncover previously unknown synaptic mechanisms underlying RPE computations; dopamine responses are shaped by both synergistic and competitive interactions between glutamatergic and GABAergic inputs to dopamine neurons depending on valences, with competitive interactions playing a role in responses to aversive stimuli.

Enhanced Punishment Responses in Patients With Schizophrenia: An Event-Related Potential Study

It is well known that abnormal reward processing is a characteristic feature of various psychopathologies including schizophrenia. Reduced reward anticipation has been suggested as a core symptom of schizophrenia. The Monetary Incentive Delay Task (MID) is frequently used to detect reward anticipation. The present study aims to evaluate the amplitude and latency of event-related potential (ERP) P300 in patients with schizophrenia (SCH) compared to healthy controls during the MID task. Twenty patients with SCH and 21 demographically matched healthy controls (HC) were included in the study. ERP P300 amplitude and latency values were compared between groups using an MID task in which reward and loss cues were presented. Relations between P300 and clinical facets were investigated in the patient group. SCH group had enhanced mean P300 amplitudes and delayed peak latency in the punishment condition compared with HC. These higher responses were also associated with negative symptoms. SCH group showed altered reward processing as being more sensitive to loss of reward conditions as firstly evidenced by electrophysiological methods, possibly due to abnormality in various systems including social withdrawal, social defeat, and behavioral inhibition system.

65 years of research on dopamine's role in classical fear conditioning and extinction: A systematic review

Dopamine, a catecholamine neurotransmitter, has historically been associated with the encoding of reward, whereas its role in aversion has received less attention. Here, we systematically gathered the vast evidence of the role of dopamine in the simplest forms of aversive learning: classical fear conditioning and extinction. In the past, crude methods were used to augment or inhibit dopamine to study its relationship with fear conditioning and extinction. More advanced techniques such as conditional genetic, chemogenic and optogenetic approaches now provide causal evidence for dopamine's role in these learning processes. Dopamine neurons encode conditioned stimuli during fear conditioning and extinction and convey the signal via activation of D1-4 receptor sites particularly in the amygdala, prefrontal cortex and striatum. The coordinated activation of dopamine receptors allows for the continuous formation, consolidation, retrieval and updating of fear and extinction memory in a dynamic and reciprocal manner. Based on the reviewed literature, we conclude that dopamine is crucial for the encoding of classical fear conditioning and extinction and contributes in a way that is comparable to its role in encoding reward.

Curiosity: primate neural circuits for novelty and information seeking

For many years, neuroscientists have investigated the behavioural, computational and neurobiological mechanisms that support value-based decisions, revealing how humans and animals make choices to obtain rewards. However, many decisions are influenced by factors other than the value of physical rewards or second-order reinforcers (such as money). For instance, animals (including humans) frequently explore novel objects that have no intrinsic value solely because they are novel and they exhibit the desire to gain information to reduce their uncertainties about the future, even if this information cannot lead to reward or assist them in accomplishing upcoming tasks. In this Review, I discuss how circuits in the primate brain responsible for detecting, predicting and assessing novelty and uncertainty regulate behaviour and give rise to these behavioural components of curiosity. I also briefly discuss how curiosity-related behaviours arise during postnatal development and point out some important reasons for the persistence of curiosity across generations.

Heterogeneity of mesencephalic dopaminergic neurons: From molecular classifications, electrophysiological properties to functional connectivity

The mesencephalic dopamine (DA) system is composed of neuronal subtypes that are molecularly and functionally distinct, are responsible for specific behaviors, and are closely associated with numerous brain disorders. Existing research has made significant advances in identifying the heterogeneity of mesencephalic DA neurons, which is necessary for understanding their diverse physiological functions and disease susceptibility. Moreover, there is a conflict regarding the electrophysiological properties of the distinct subsets of midbrain DA neurons. This review aimed to elucidate recent developments in the heterogeneity of midbrain DA neurons, including subpopulation categorization, electrophysiological characteristics, and functional connectivity to provide new strategies for accurately identifying distinct subtypes of midbrain DA neurons and investigating the underlying mechanisms of these neurons in various diseases.

The role of prospective contingency in the control of behavior and dopamine signals during associative learning

Associative learning depends on contingency, the degree to which a stimulus predicts an outcome. Despite its importance, the neural mechanisms linking contingency to behavior remain elusive. Here we examined the dopamine activity in the ventral striatum - a signal implicated in associative learning - in a Pavlovian contingency degradation task in mice. We show that both anticipatory licking and dopamine responses to a conditioned stimulus decreased when additional rewards were delivered uncued, but remained unchanged if additional rewards were cued. These results conflict with contingency-based accounts using a traditional definition of contingency or a novel causal learning model (ANCCR), but can be explained by temporal difference (TD) learning models equipped with an appropriate inter-trial-interval (ITI) state representation. Recurrent neural networks trained within a TD framework develop state representations like our best 'handcrafted' model. Our findings suggest that the TD error can be a measure that describes both contingency and dopaminergic activity.

A multi-stage anticipated surprise model with dynamic expectation for economic decision-making

There are many modeling works that aim to explain people's behaviors that violate classical economic theories. However, these models often do not take into full account the multi-stage nature of real-life problems and people's tendency in solving complicated problems sequentially. In this work, we propose a descriptive decision-making model for multi-stage problems with perceived post-decision information. In the model, decisions are chosen based on an entity which we call the 'anticipated surprise'. The reference point is determined by the expected value of the possible outcomes, which we assume to be dynamically changing during the mental simulation of a sequence of events. We illustrate how our formalism can help us understand prominent economic paradoxes and gambling behaviors that involve multi-stage or sequential planning. We also discuss how neuroscience findings, like prediction error signals and introspective neuronal replay, as well as psychological theories like affective forecasting, are related to the features in our model. This provides hints for future experiments to investigate the role of these entities in decision-making.

An opponent striatal circuit for distributional reinforcement learning

Machine learning research has achieved large performance gains on a wide range of tasks by expanding the learning target from mean rewards to entire probability distributions of rewards - an approach known as distributional reinforcement learning (RL)1. The mesolimbic dopamine system is thought to underlie RL in the mammalian brain by updating a representation of mean value in the striatum2,3, but little is known about whether, where, and how neurons in this circuit encode information about higher-order moments of reward distributions4. To fill this gap, we used high-density probes (Neuropixels) to acutely record striatal activity from well-trained, water-restricted mice performing a classical conditioning task in which reward mean, reward variance, and stimulus identity were independently manipulated. In contrast to traditional RL accounts, we found robust evidence for abstract encoding of variance in the striatum. Remarkably, chronic ablation of dopamine inputs disorganized these distributional representations in the striatum without interfering with mean value coding. Two-photon calcium imaging and optogenetics revealed that the two major classes of striatal medium spiny neurons - D1 and D2 MSNs - contributed to this code by preferentially encoding the right and left tails of the reward distribution, respectively. We synthesize these findings into a new model of the striatum and mesolimbic dopamine that harnesses the opponency between D1 and D2 MSNs5-15 to reap the computational benefits of distributional RL.

Corticotropin-releasing factor-dopamine interactions in male and female macaque: Beyond the classic VTA

Dopamine (DA) is involved in stress and stress-related illnesses, including many psychiatric disorders. Corticotropin-releasing factor (CRF) plays a role in stress responses and targets the ventral midbrain DA system, which is composed of DA and non-DA cells, and divided into specific subregions. Although CRF inputs to the midline A10 nuclei ("classic VTA") are known, in monkeys, CRF-containing terminals are also highly enriched in the expanded A10 parabrachial pigmented nucleus (PBP) and in the A8 retrorubral field subregions. We characterized CRF-labeled synaptic terminals on DA (tyrosine hydroxylase, TH+) and non-DA (TH-) cell types in the PBP and A8 regions using immunoreactive electron microscopy (EM) in male and female macaques. CRF labeling was present mostly in axon terminals, which mainly contacted TH-negative dendrites in both subregions. Most CRF-positive terminals had symmetric profiles. In both PBP and A8, CRF symmetric (putative inhibitory) synapses onto TH-negative dendrites were significantly greater than asymmetric (putative excitatory) profiles. This overall pattern was similar in males and females, despite shifts in the size of these effects between regions depending on sex. Because stress and gonadal hormone shifts can influence CRF expression, we also did hormonal assays over a 6-month time period and found little variability in basal cortisol across similarly housed animals at the same age. Together our findings suggest that at baseline, CRF-positive synaptic terminals in the primate PBP and A8 are poised to regulate DA indirectly through synaptic contacts onto non-DA neurons.

Sensory Reinforced Corticostriatal Plasticity

BACKGROUND

Regional changes in corticostriatal transmission induced by phasic dopaminergic signals are an essential feature of the neural network responsible for instrumental reinforcement during discovery of an action. However, the timing of signals that are thought to contribute to the induction of corticostriatal plasticity is difficult to reconcile within the framework of behavioural reinforcement learning, because the reinforcer is normally delayed relative to the selection and execution of causally-related actions.

OBJECTIVE

While recent studies have started to address the relevance of delayed reinforcement signals and their impact on corticostriatal processing, our objective was to establish a model in which a sensory reinforcer triggers appropriately delayed reinforcement signals relayed to the striatum via intact neuronal pathways and to investigate the effects on corticostriatal plasticity.

METHODS

We measured corticostriatal plasticity with electrophysiological recordings using a light flash as a natural sensory reinforcer, and pharmacological manipulations were applied in an in vivo anesthetized rat model preparation.

RESULTS

We demonstrate that the spiking of striatal neurons evoked by single-pulse stimulation of the motor cortex can be potentiated by a natural sensory reinforcer, operating through intact afferent pathways, with signal timing approximating that required for behavioural reinforcement. The pharmacological blockade of dopamine receptors attenuated the observed potentiation of corticostriatal neurotransmission.

CONCLUSION

This novel in vivo model of corticostriatal plasticity offers a behaviourally relevant framework to address the physiological, anatomical, cellular, and molecular bases of instrumental reinforcement learning.

Functional architecture of dopamine neurons driving fear extinction learning

The ability to extinguish fear responses to stimuli that no longer predict danger is critical for adaptive behavior and increases the likelihood of survival. During fear extinction, dopamine (DA) neurons signal the absence of the expected aversive outcome, and this extinction prediction error (EPE) signal is crucial for initiating and driving extinction learning. However, the neural circuits underlying the EPE signal have remained elusive. Here, we investigate the input-output circuitry of EPE-encoding DA neurons in male mice. By employing projection-specific fiber photometry and optogenetics, we demonstrate that these neurons project to a restricted subregion of the nucleus accumbens. Comprehensive anatomical analyses, as well as projection-specific chemogenetic manipulations combined with recordings of DA biosensors, further uncover the dorsal raphe as one key input structure critical for generating the EPE signal. Together, our results reveal for the first time the functional architecture of EPE-encoding DA neurons crucial for driving fear extinction learning.

Curiosity-driven exploration: foundations in neuroscience and computational modeling

Curiosity refers to the intrinsic desire of humans and animals to explore the unknown, even when there is no apparent reason to do so. Thus far, no single, widely accepted definition or framework for curiosity has emerged, but there is growing consensus that curious behavior is not goal-directed but related to seeking or reacting to information. In this review, we take a phenomenological approach and group behavioral and neurophysiological studies which meet these criteria into three categories according to the type of information seeking observed. We then review recent computational models of curiosity from the field of machine learning and discuss how they enable integrating different types of information seeking into one theoretical framework. Combinations of behavioral and neurophysiological studies along with computational modeling will be instrumental in demystifying the notion of curiosity.

The influence of dopamine autoreceptors on temperament and addiction risk

As a major regulator of dopamine (DA), DA autoreceptors (DAARs) exert substantial influence over DA-mediated behaviors. This paper reviews the physiological and behavioral impact of DAARs. Individual differences in DAAR functioning influences temperamental traits such as novelty responsivity and impulsivity, both of which are associated with vulnerability to addictive behavior in animal models and a broad array of externalizing behaviors in humans. DAARs additionally impact the response to psychostimulants and other drugs of abuse. Human PET studies of D2-like receptors in the midbrain provide evidence for parallels to the animal literature. These data lead to the proposal that weak DAAR regulation is a risk factor for addiction and externalizing problems. The review highlights the potential to build translational models of the functional role of DAARs in behavior. It also draws attention to key limitations in the current literature that would need to be addressed to further advance a weak DAAR regulation model of addiction and externalizing risk.

Targeted micro-fiber arrays for measuring and manipulating localized multi-scale neural dynamics over large, deep brain volumes during behavior

Neural population dynamics relevant for behavior vary over multiple spatial and temporal scales across 3-dimensional volumes. Current optical approaches lack the spatial coverage and resolution necessary to measure and manipulate naturally occurring patterns of large-scale, distributed dynamics within and across deep brain regions such as the striatum. We designed a new micro-fiber array and imaging approach capable of chronically measuring and optogenetically manipulating local dynamics across over 100 targeted locations simultaneously in head-fixed and freely moving mice. We developed a semi-automated micro-CT based strategy to precisely localize positions of each optical fiber. This highly-customizable approach enables investigation of multi-scale spatial and temporal patterns of cell-type and neurotransmitter specific signals over arbitrary 3-D volumes at a spatial resolution and coverage previously inaccessible. We applied this method to resolve rapid dopamine release dynamics across the striatum volume which revealed distinct, modality specific spatiotemporal patterns in response to salient sensory stimuli extending over millimeters of tissue. Targeted optogenetics through our fiber arrays enabled flexible control of neural signaling on multiple spatial scales, better matching endogenous signaling patterns, and spatial localization of behavioral function across large circuits.

Deep learning-based image analysis identifies a DAT-negative subpopulation of dopaminergic neurons in the lateral Substantia nigra

Here we present a deep learning-based image analysis platform (DLAP), tailored to autonomously quantify cell numbers, and fluorescence signals within cellular compartments, derived from RNAscope or immunohistochemistry. We utilised DLAP to analyse subtypes of tyrosine hydroxylase (TH)-positive dopaminergic midbrain neurons in mouse and human brain-sections. These neurons modulate complex behaviour, and are differentially affected in Parkinson's and other diseases. DLAP allows the analysis of large cell numbers, and facilitates the identification of small cellular subpopulations. Using DLAP, we identified a small subpopulation of TH-positive neurons (~5%), mainly located in the very lateral Substantia nigra (SN), that was immunofluorescence-negative for the plasmalemmal dopamine transporter (DAT), with ~40% smaller cell bodies. These neurons were negative for aldehyde dehydrogenase 1A1, with a lower co-expression rate for dopamine-D2-autoreceptors, but a ~7-fold higher likelihood of calbindin-d28k co-expression (~70%). These results have important implications, as DAT is crucial for dopamine signalling, and is commonly used as a marker for dopaminergic SN neurons.

Glutamate inputs send prediction error of reward but not negative value of aversive stimuli to dopamine neurons

Midbrain dopamine neurons are thought to signal reward prediction errors (RPEs) but the mechanisms underlying RPE computation, particularly contributions of different neurotransmitters, remain poorly understood. Here we used a genetically-encoded glutamate sensor to examine the pattern of glutamate inputs to dopamine neurons. We found that glutamate inputs exhibit virtually all of the characteristics of RPE, rather than conveying a specific component of RPE computation such as reward or expectation. Notably, while glutamate inputs were transiently inhibited by reward omission, they were excited by aversive stimuli. Opioid analgesics altered dopamine negative responses to aversive stimuli toward more positive responses, while excitatory responses of glutamate inputs remained unchanged. Our findings uncover previously unknown synaptic mechanisms underlying RPE computations; dopamine responses are shaped by both synergistic and competitive interactions between glutamatergic and GABAergic inputs to dopamine neurons depending on valences, with competitive interactions playing a role in responses to aversive stimuli.

CHL1 depletion affects dopamine receptor D2-dependent modulation of mouse behavior

Introduction

The dopaminergic system plays a key role in the appropriate functioning of the central nervous system, where it is essential for emotional balance, arousal, reward, and motor control. The cell adhesion molecule close homolog of L1 (CHL1) contributes to dopaminergic system development, and CHL1 and the dopamine receptor D2 (D2R) are associated with mental disorders like schizophrenia, addiction, autism spectrum disorder and depression.

Methods

Here, we investigated how the interplay between CHL1 and D2R affects the behavior of young adult male and female wild-type (CHL+/+) and CHL1-deficient (CHL1-/-) mice, when D2R agonist quinpirole and antagonist sulpiride are applied.

Results

Low doses of quinpirole (0.02 mg/kg body weight) induced hypolocomotion of CHL1+/+ and CHL1-/- males and females, but led to a delayed response in CHL1-/- mice. Sulpiride (1 mg/kg body weight) affected locomotion of CHL1-/- females and social interaction of CHL1+/+ females as well as social interactions of CHL1-/- and CHL1+/+ males. Quinpirole increased novelty-seeking behavior of CHL1-/- males compared to CHL1+/+ males. Vehicle-treated CHL1-/- males and females showed enhanced working memory and reduced stress-related behavior.

Discussion

We propose that CHL1 regulates D2R-dependent functions in vivo. Deficiency of CHL1 leads to abnormal locomotor activity and emotionality, and to sex-dependent behavioral differences.

Striatum supports fast learning but not memory recall

Animals learn to carry out motor actions in specific sensory contexts to achieve goals. The striatum has been implicated in producing sensory-motor associations, yet its contribution to memory formation or recall is not clear. To investigate the contribution of striatum to these processes, mice were taught to associate a cue, consisting of optogenetic activation of striatum-projecting neurons in visual cortex, with forelimb reaches to access food pellets. As necessary to direct learning, striatal neural activity encoded both the sensory context and outcome of reaching. With training, the rate of cued reaching increased, but brief optogenetic inhibition of striatal activity arrested learning and prevented trial-to-trial improvements in performance. However, the same manipulation did not affect performance improvements already consolidated into short- (within an hour) or long-term (across days) memories. Hence, striatal activity is necessary for trial-to-trial improvements in task performance, leading to plasticity in other brain areas that mediate memory recall.

Unique functional responses differentially map onto genetic subtypes of dopamine neurons

Dopamine neurons are characterized by their response to unexpected rewards, but they also fire during movement and aversive stimuli. Dopamine neuron diversity has been observed based on molecular expression profiles; however, whether different functions map onto such genetic subtypes remains unclear. In this study, we established that three genetic dopamine neuron subtypes within the substantia nigra pars compacta, characterized by the expression of Slc17a6 (Vglut2), Calb1 and Anxa1, each have a unique set of responses to rewards, aversive stimuli and accelerations and decelerations, and these signaling patterns are highly correlated between somas and axons within subtypes. Remarkably, reward responses were almost entirely absent in the Anxa1+ subtype, which instead displayed acceleration-correlated signaling. Our findings establish a connection between functional and genetic dopamine neuron subtypes and demonstrate that molecular expression patterns can serve as a common framework to dissect dopaminergic functions.

Moving, fast and slow: behavioural insights into bradykinesia in Parkinson's disease

The debilitating symptoms of Parkinson's disease, including the hallmark slowness of movement, termed bradykinesia, were described more than 100 years ago. Despite significant advances in elucidating the genetic, molecular and neurobiological changes in Parkinson's disease, it remains conceptually unclear exactly why patients with Parkinson's disease move slowly. To address this, we summarize behavioural observations of movement slowness in Parkinson's disease and discuss these findings in a behavioural framework of optimal control. In this framework, agents optimize the time it takes to gather and harvest rewards by adapting their movement vigour according to the reward that is at stake and the effort that needs to be expended. Thus, slow movements can be favourable when the reward is deemed unappealing or the movement very costly. While reduced reward sensitivity, which makes patients less inclined to work for reward, has been reported in Parkinson's disease, this appears to be related mainly to motivational deficits (apathy) rather than bradykinesia. Increased effort sensitivity has been proposed to underlie movement slowness in Parkinson's disease. However, careful behavioural observations of bradykinesia are inconsistent with abnormal computations of effort costs due to accuracy constraints or movement energetic expenditure. These inconsistencies can be resolved when considering that a general disability to switch between stable and dynamic movement states can contribute to an abnormal composite effort cost related to movement in Parkinson's disease. This can account for paradoxical observations such as the abnormally slow relaxation of isometric contractions or difficulties in halting a movement in Parkinson's disease, both of which increase movement energy expenditure. A sound understanding of the abnormal behavioural computations mediating motor impairment in Parkinson's disease will be vital for linking them to their underlying neural dynamics in distributed brain networks and for grounding future experimental studies in well-defined behavioural frameworks.

Mesolimbic dopamine release precedes actively sought aversive stimuli in mice

In some models, animals approach aversive stimuli more than those housed in an enriched environment. Here, we found that male mice in an impoverished and unstimulating (i.e., boring) chamber without toys sought aversive air puffs more often than those in an enriched chamber. Using this animal model, we identified the insular cortex as a regulator of aversion-seeking behavior. Activation and inhibition of the insular cortex increased and decreased the frequencies of air-puff self-stimulation, respectively, and the firing patterns of insular neuron ensembles predicted the self-stimulation timing. Dopamine levels in the ventrolateral striatum decreased with passive air puffs but increased with actively sought puffs. Around 20% of mice developed intense self-stimulation despite being offered toys, which was prevented by administering opioid receptor antagonists. This study establishes a basis for comprehending the neural underpinnings of usually avoided stimulus-seeking behaviors.

Development, wiring and function of dopamine neuron subtypes

The midbrain dopamine (mDA) system is composed of molecularly and functionally distinct neuron subtypes that mediate specific behaviours and are linked to various brain diseases. Considerable progress has been made in identifying mDA neuron subtypes, and recent work has begun to unveil how these neuronal subtypes develop and organize into functional brain structures. This progress is important for further understanding the disparate physiological functions of mDA neurons and their selective vulnerability in disease, and will ultimately accelerate therapy development. This Review discusses recent advances in our understanding of molecularly defined mDA neuron subtypes and their circuits, ranging from early developmental events, such as neuron migration and axon guidance, to their wiring and function, and future implications for therapeutic strategies.