Transformation of valence signaling in a mouse striatopallidal circuit

Transformation of valence signaling in a mouse striatopallidal circuit

The ways in which sensory stimuli acquire motivational valence through association with other stimuli is one of the simplest forms of learning. Although we have identified many brain nuclei that play various roles in reward processing, a significant gap remains in understanding how valence encoding transforms through the layers of sensory processing. To address this gap, we carried out a comparative investigation of the mouse anteromedial olfactory tubercle (OT), and the ventral pallidum (VP) - 2 connected nuclei of the basal ganglia which have both been implicated in reward processing. First, using anterograde and retrograde tracing, we show that both D1 and D2 neurons of the anteromedial OT project primarily to the VP and minimally elsewhere. Using two-photon calcium imaging, we then investigated how the identity of the odor and reward contingency of the odor are differently encoded by neurons in either structure during a classical conditioning paradigm. We find that VP neurons robustly encode reward contingency, but not identity, in low-dimensional space. In contrast, the OT neurons primarily encode odor identity in high-dimensional space. Although D1 OT neurons showed larger responses to rewarded odors than other odors, consistent with prior findings, we interpret this as identity encoding with enhanced contrast. Finally, using a novel conditioning paradigm that decouples reward contingency and licking vigor, we show that both features are encoded by non-overlapping VP neurons. These results provide a novel framework for the striatopallidal circuit in which a high-dimensional encoding of stimulus identity is collapsed onto a low-dimensional encoding of motivational valence.

Control of innate olfactory valence by segregated cortical amygdala circuits

Animals exhibit innate behaviors that are stereotyped responses to specific evolutionarily relevant stimuli in the absence of prior learning or experience. These behaviors can be reduced to an axis of valence, whereby specific odors evoke approach or avoidance responses. The posterolateral cortical amygdala (plCoA) mediates innate attraction and aversion to odor. However, little is known about how this brain area gives rise to behaviors of opposing motivational valence. Here, we sought to define the circuit features of plCoA that give rise to innate attraction and aversion to odor. We characterized the physiology, gene expression, and projections of this structure, identifying a divergent, topographic organization that selectively controls innate attraction and avoidance to odor. First, we examined odor-evoked responses in these areas and found sparse encoding of odor identity, but not valence. We next considered a topographic organization and found that optogenetic stimulation of the anterior and posterior domains of plCoA elicits attraction and avoidance, respectively, suggesting a functional axis for valence. Using single cell and spatial RNA sequencing, we identified the molecular cell types in plCoA, revealing an anteroposterior gradient in cell types, whereby anterior glutamatergic neurons preferentially express VGluT2 and posterior neurons express VGluT1. Activation of these respective cell types recapitulates appetitive and aversive behaviors, and chemogenetic inhibition reveals partial necessity for responses to innate appetitive or aversive odors. Finally, we identified topographically organized circuits defined by projections, whereby anterior neurons preferentially project to medial amygdala, and posterior neurons preferentially project to nucleus accumbens, which are respectively sufficient and necessary for innate attraction and aversion. Together, these data advance our understanding of how the olfactory system generates stereotypic, hardwired attraction and avoidance, and supports a model whereby distinct, topographically distributed plCoA populations direct innate olfactory responses by signaling to divergent valence-specific targets, linking upstream olfactory identity to downstream valence behaviors, through a population code. This suggests a novel amygdala circuit motif in which valence encoding is represented not by the firing properties of individual neurons, but by population level identity encoding that is routed through divergent targets to mediate distinct behaviors of opposing appetitive and aversive responses.

An opponent striatal circuit for distributional reinforcement learning

Machine learning research has achieved large performance gains on a wide range of tasks by expanding the learning target from mean rewards to entire probability distributions of rewards - an approach known as distributional reinforcement learning (RL)1. The mesolimbic dopamine system is thought to underlie RL in the mammalian brain by updating a representation of mean value in the striatum2,3, but little is known about whether, where, and how neurons in this circuit encode information about higher-order moments of reward distributions4. To fill this gap, we used high-density probes (Neuropixels) to acutely record striatal activity from well-trained, water-restricted mice performing a classical conditioning task in which reward mean, reward variance, and stimulus identity were independently manipulated. In contrast to traditional RL accounts, we found robust evidence for abstract encoding of variance in the striatum. Remarkably, chronic ablation of dopamine inputs disorganized these distributional representations in the striatum without interfering with mean value coding. Two-photon calcium imaging and optogenetics revealed that the two major classes of striatal medium spiny neurons - D1 and D2 MSNs - contributed to this code by preferentially encoding the right and left tails of the reward distribution, respectively. We synthesize these findings into a new model of the striatum and mesolimbic dopamine that harnesses the opponency between D1 and D2 MSNs5-15 to reap the computational benefits of distributional RL.