Developments from Bulk Optogenetics to Single-Cell Strategies to Dissect the Neural Circuits that Underlie Aberrant Motivational States

Motivational states are regulated by complex networks across brain regions that are composed of genetically and functionally distinct neuronal populations. Disruption within these neural circuits leads to aberrant motivational states and are thought to be the root cause of psychiatric disorders related to reward processing and addiction. Critical technological advances in the field have revolutionized the study of neural systems by allowing the use of optical strategies to precisely control and visualize neural activity within genetically identified neural populations in the brain. This review will provide a brief introduction into the history of how technological advances in single-cell strategies have been applied to elucidate the neural circuits that underlie aberrant motivational states that often lead to dysfunction in reward processing and addiction.

Anhedonia and Hyperhedonia in Autism and Related Neurodevelopmental Disorders

Although autism spectrum disorder (ASD) is defined by impaired social communication and restricted and repetitive behaviors and interests, ASD is also characterized by impaired motivational processes. The "social motivation theory of autism" describes how social motivation disruptions in ASD in early childhood may impede the drive to engage in reciprocal social behaviors and ultimately interfere with the development of neural networks critical for social communication (Chevallier et al., Trends Cogn Sci 16:231-239, 2012b). Importantly, clinical studies and preclinical research using model organisms for ASD indicate that motivational impairments in ASD are not constrained to social rewards but are evident in response to a range of nonsocial rewards as well. Additionally, translational studies on certain genetically defined neurodevelopmental disorders associated with ASD indicate that these syndromic forms of ASD are also characterized by motivational deficits and mesolimbic dopamine impairments. In this chapter we summarize clinical and preclinical research relevant to reward processing impairments in ASD and related neurodevelopmental disorders. We also propose a nosology to describe reward processing impairments in these disorders that uses a three-axes model. In this triaxial nosology, the first axis defines the direction of the reward response (i.e., anhedonic, hyperhedonic); the second axis defines the construct of the reward process (e.g., reward liking, reward wanting); and the third axis defines the context of the reward response (e.g., social, nonsocial). A more precise nosology for describing reward processing impairments in ASD and related neurodevelopmental disorders will aid in the translation of preclinical research to clinical investigations which will ultimately help to speed up the development of interventions that target motivational systems for ASD and related neurodevelopmental disorders.

Cell-type diversity in the bed nucleus of the stria terminalis to regulate motivated behaviors

Over the past few decades, the bed nucleus of the stria terminalis (BNST) gained popularity as a unique brain region involved in regulating motivated behaviors related to neuropsychiatric disorders. The BNST, a component of the extended amygdala, consists of a variety of subnuclei and neuronal ensembles. Multiple studies have highlighted the BNST as playing a fundamental role in integrating information by interfacing with other brain regions to regulate distinct aspects of motivated behaviors associated with stress, anxiety, depression, and decision-making. However, due to the high molecular heterogeneity found within BNST neurons, the precise mechanisms by which this region regulates distinct motivational states remains largely unclear. Single-cell RNA sequencing data have revealed that the BNST consists of multiple genetically identifiable cell-type clusters. Contemporary tools can therefore be leveraged to target and study such cell-types and elucidate their precise functional role. In this review, we discuss the different subsets of neurons found in the BNST, their anatomical distribution, and what is currently known about BNST cell-types in regulating motivated behaviors.

Prepronociceptin-Expressing Neurons in the Extended Amygdala Encode and Promote Rapid Arousal Responses to Motivationally Salient Stimuli

Motivational states consist of cognitive, emotional, and physiological components controlled by multiple brain regions. An integral component of this neural circuitry is the bed nucleus of the stria terminalis (BNST). Here, we identify that neurons within BNST that express the gene prepronociceptin (Pnoc^BNST) modulate rapid changes in physiological arousal that occur upon exposure to motivationally salient stimuli. Using in vivo two-photon calcium imaging, we find that Pnoc^BNST neuronal responses directly correspond with rapid increases in pupillary size when mice are exposed to aversive and rewarding odors. Furthermore, optogenetic activation of these neurons increases pupillary size and anxiety-like behaviors but does not induce approach, avoidance, or locomotion. These findings suggest that excitatory responses in Pnoc^BNST neurons encode rapid arousal responses that modulate anxiety states. Further histological, electrophysiological, and single-cell RNA sequencing data reveal that Pnoc^BNST neurons are composed of genetically and anatomically identifiable subpopulations that may differentially tune rapid arousal responses to motivational stimuli.

Single-cell activity tracking reveals that orbitofrontal neurons acquire and maintain a long-term memory to guide behavioral adaptation

Learning to predict rewards based on environmental cues is essential for survival. The orbitofrontal cortex (OFC) contributes to such learning by conveying reward-related information to brain areas such as the ventral tegmental area (VTA). Despite this, how cue-reward memory representations form in individual OFC neurons and are modified based on new information is unknown. To address this, using in vivo two-photon calcium imaging in mice, we tracked the response evolution of thousands of OFC output neurons, including those projecting to VTA, through multiple days and stages of cue-reward learning. Collectively, we show that OFC contains several functional clusters of neurons distinctly encoding cue-reward memory representations, with only select responses routed downstream to VTA. Unexpectedly, these representations were stably maintained by the same neurons even after extinction of the cue-reward pairing, and supported behavioral learning and memory. Thus, OFC neuronal activity represents a long-term cue-reward associative memory to support behavioral adaptation.

Paraventricular Thalamus Projection Neurons Integrate Cortical and Hypothalamic Signals for Cue-Reward Processing

The paraventricular thalamus (PVT) is an interface for brain reward circuits, with input signals arising from structures, such as prefrontal cortex and hypothalamus, that are broadcast to downstream limbic targets. However, the precise synaptic connectivity, activity, and function of PVT circuitry for reward processing are unclear. Here, using in vivo two-photon calcium imaging, we find that PVT neurons projecting to the nucleus accumbens (PVT-NAc) develop inhibitory responses to reward-predictive cues coding for both cue-reward associative information and behavior. The multiplexed activity in PVT-NAc neurons is directed by opposing activity patterns in prefrontal and lateral hypothalamic afferent axons. Further, we find that prefrontal cue encoding may maintain accurate cue-reward processing, as optogenetic disruption of this encoding induced long-lasting effects on downstream PVT-NAc cue responses and behavioral cue discrimination. Together, these data reveal that PVT-NAc neurons act as an interface for reward processing by integrating relevant inputs to accurately inform reward-seeking behavior.

Active avoidance requires inhibitory signaling in the rodent prelimbic prefrontal cortex

Much is known about the neural circuits of conditioned fear and its relevance to understanding anxiety disorders, but less is known about other anxiety-related behaviors such as active avoidance. Using a tone-signaled, platform-mediated avoidance task, we observed that pharmacological inactivation of the prelimbic prefrontal cortex (PL) delayed avoidance. Surprisingly, optogenetic silencing of PL glutamatergic neurons did not delay avoidance. Consistent with this, inhibitory but not excitatory responses of rostral PL neurons were associated with avoidance training. To test the importance of these inhibitory responses, we optogenetically stimulated PL neurons to counteract the tone-elicited reduction in firing rate. Photoactivation of rostral (but not caudal) PL neurons at 4 Hz impaired avoidance. These findings suggest that inhibitory responses of rostral PL neurons signal the avoidability of a potential threat and underscore the importance of designing behavioral optogenetic studies based on neuronal firing responses.

Efficient and accurate extraction of in vivo calcium signals from microendoscopic video data

In vivo calcium imaging through microendoscopic lenses enables imaging of previously inaccessible neuronal populations deep within the brains of freely moving animals. However, it is computationally challenging to extract single-neuronal activity from microendoscopic data, because of the very large background fluctuations and high spatial overlaps intrinsic to this recording modality. Here, we describe a new constrained matrix factorization approach to accurately separate the background and then demix and denoise the neuronal signals of interest. We compared the proposed method against previous independent components analysis and constrained nonnegative matrix factorization approaches. On both simulated and experimental data recorded from mice, our method substantially improved the quality of extracted cellular signals and detected more well-isolated neural signals, especially in noisy data regimes. These advances can in turn significantly enhance the statistical power of downstream analyses, and ultimately improve scientific conclusions derived from microendoscopic data.

The habenula

The habenula is a tiny brain region the size of a pea in humans. This region is highly conserved across vertebrates and has been traditionally overlooked by neuroscientists. The name habenula is derived from the Latin word habena, meaning "little rein", because of its elongated shape. Originally its function was thought to be related to the regulation of the nearby pineal gland (which Rene Descartes described as the "principal seat of the soul"). More recent evidence, however, demonstrates that the habenula acts as a critical neuroanatomical hub that connects and regulates brain regions important for divergent motivational states and cognition. In this Primer, we will discuss the recent and converging evidence that points to the habenula as a key brain region for motivation and decision-making.

Circuit-Based Corticostriatal Homologies Between Rat and Primate

BACKGROUND

Understanding the neural mechanisms of psychiatric disorders requires the use of rodent models; however, frontal-striatal homologies between rodents and primates are unclear. In contrast, within the striatum, the shell of the nucleus accumbens, the hippocampal projection zone, and the amygdala projection zone (referred to as the striatal emotion processing network [EPN]) are conserved across species. We used the relationship between the EPN and projections from the anterior cingulate cortex (ACC) and orbitofrontal cortex (OFC) to assess network similarities across rats and monkeys.

METHODS

We first compared the location and extent of each major component of the EPN in rats and macaques. Next, we used anatomic cases with anterograde injections in ACC/OFC to determine the extent to which corticostriatal terminal fields overlapped with these components and with each other.

RESULTS

The location and size of each component of the EPN were similar across species, containing projections primarily from infralimbic cortex in rats and area 25 in monkeys. Other ACC/OFC terminals overlapped extensively with infralimbic cortex/area 25 projections, supporting cross-species similarities in OFC topography. However, dorsal ACC had different connectivity profiles across species. These results were used to segment the monkey and rat striata according to ACC/OFC inputs.

CONCLUSIONS

Based on connectivity with the EPN, and consistent with prior literature, the infralimbic cortex and area 25 are likely homologues. We also see evidence of OFC homologies. Along with segmenting the striatum and identifying striatal hubs of overlapping inputs, these results help to translate findings between rodent models and human pathology.

An Avoidance-Based Rodent Model of Exposure With Response Prevention Therapy for Obsessive-Compulsive Disorder

BACKGROUND

Obsessive-compulsive disorder is treated with exposure with response prevention (ERP) therapy, in which patients are repeatedly exposed to compulsive triggers but prevented from expressing their compulsions. Many compulsions are an attempt to avoid perceived dangers, and the intent of ERP is to extinguish compulsions. Patients failing ERP therapy are candidates for deep brain stimulation (DBS) of the ventral capsule/ventral striatum, which facilitates patients' response to ERP therapy. An animal model of ERP would be useful for understanding the neural mechanisms of extinction in obsessive-compulsive disorder.

METHODS

Using a platform-mediated signaled avoidance task, we developed a rodent model of ERP called extinction with response prevention (Ext-RP), in which avoidance-conditioned rats are given extinction trials while blocking access to the avoidance platform. Following 3 days of Ext-RP, rats were tested with the platform unblocked to evaluate persistent avoidance. We then assessed if pharmacologic inactivation of lateral orbitofrontal cortex (lOFC) or DBS of the ventral striatum reduced persistent avoidance.

RESULTS

Following Ext-RP training, most rats showed reduced avoidance at test (Ext-RP success), but a subset persisted in their avoidance (Ext-RP failure). Pharmacologic inactivation of lOFC eliminated persistent avoidance, as did DBS applied to the ventral striatum during Ext-RP.

CONCLUSIONS

DBS of ventral striatum has been previously shown to inhibit lOFC activity. Thus, activity in lOFC, which is known to be hyperactive in obsessive-compulsive disorder, may be responsible for impairing patients' response to ERP therapy.

Enhancement of fear extinction with deep brain stimulation: evidence for medial orbitofrontal involvement

Deep brain stimulation (DBS) of the ventral capsule/ventral striatum (VC/VS) reduces anxiety, fear, and compulsive symptoms in patients suffering from refractory obsessive-compulsive disorder. In a rodent model, DBS-like high-frequency stimulation of VS can either enhance or impair extinction of conditioned fear, depending on the location of electrodes within VS (dorsal vs ventral). As striatal DBS activates fibers descending from the cortex, we reasoned that the differing effects on extinction may reflect differences in cortical sources of fibers passing through dorsal-VS and ventral-VS. In agreement with prior anatomical studies, we found that infralimbic (IL) and anterior insular (AI) cortices project densely through ventral-VS, the site where DBS impaired extinction. Contrary to IL and AI, we found that medial orbitofrontal cortex (mOFC) projects densely through dorsal-VS, the site where DBS enhanced extinction. Furthermore, pharmacological inactivation of mOFC reduced conditioned fear and DBS of dorsal-VS-induced plasticity (pERK) in mOFC neurons. Our results support the idea that VS DBS modulates fear extinction by stimulating specific fibers descending from mOFC and prefrontal cortices.

Long-range GABAergic neurons in the prefrontal cortex modulate behavior

Cortical glutamatergic projections are extensively studied in behavioral neuroscience, whereas cortical GABAergic projections to downstream structures have been overlooked. A recent study by Lee and colleagues (Lee AT, Vogt D, Rubenstein JL, Sohal VS. J Neurosci 34: 11519-11525, 2014) used optogenetic and electrophysiological techniques to characterize a behavioral role for long-projecting GABAergic neurons in the medial prefrontal cortex. In this Neuro Forum, we discuss the potential implications of this study in several learning and memory models.

Deep brain stimulation of the ventral striatum increases BDNF in the fear extinction circuit

Deep brain stimulation (DBS) of the ventral capsule/ventral striatum (VC/VS) reduces the symptoms of treatment-resistant obsessive compulsive disorder (OCD), and improves response to extinction-based therapies. We recently reported that DBS-like stimulation of a rat homologue of VC/VS, the dorsal-VS, reduced conditioned fear and enhanced extinction memory (Rodriguez-Romaguera et al., 2012). In contrast, DBS of the ventral-VS had the opposite effects. To examine possible mechanisms of these effects, we assessed the effects of VS DBS on the expression of the neural activity marker Fos and brain-derived neurotrophic factor (BDNF), a key mediator of extinction plasticity in prefrontal-amygdala circuits. Consistent with decreased fear expression, DBS of dorsal-VS increased Fos expression in prelimbic and infralimbic prefrontal cortices and in the lateral division of the central nucleus of amygdala, an area that inhibits amygdala output. Consistent with improved extinction memory, we found that DBS of dorsal-VS, but not ventral-VS, increased neuronal BDNF expression in prelimbic and infralimbic prefrontal cortices. These rodent findings are consistent with the idea that clinical DBS of VC/VS may augment fear extinction through an increase in BDNF expression.

Altered processing of contextual information during fear extinction in PTSD: an fMRI study

Medial prefrontal cortical areas have been hypothesized to underlie altered contextual processing in posttraumatic stress disorder (PTSD). We investigated brain signaling of contextual information in this disorder. Eighteen PTSD subjects and 16 healthy trauma-exposed subjects underwent a two-day fear conditioning and extinction paradigm. On day 1, within visual context A, a conditioned stimulus (CS) was followed 60% of the time by an electric shock (conditioning). The conditioned response was then extinguished (extinction learning) in context B. On day 2, recall of the extinction memory was tested in context B. Skin conductance response (SCR) and functional magnetic resonance imaging (fMRI) data were collected during context presentations. There were no SCR group differences in any context presentation. Concerning fMRI data, during late conditioning, when context A signaled danger, PTSD subjects showed dorsal anterior cingulate cortical (dACC) hyperactivation. During early extinction, when context B had not yet fully acquired signal value for safety, PTSD subjects still showed dACC hyperactivation. During late extinction, when context B had come to signal safety, they showed ventromedial prefrontal cortex (vmPFC) hypoactivation. During early extinction recall, when context B signaled safety, they showed both vmPFC hypoactivation and dACC hyperactivation. These findings suggest that PTSD subjects show alterations in the processing of contextual information related to danger and safety. This impairment is manifest even prior to a physiologically-measured, cue-elicited fear response, and characterized by hypoactivation in vmPFC and hyperactivation in dACC.

Systemic propranolol acts centrally to reduce conditioned fear in rats without impairing extinction

BACKGROUND

Previous work has implicated noradrenergic beta-receptors in the consolidation and reconsolidation of conditioned fear. Less is known, however, about their role in fear expression and extinction. The beta-receptor blocker propranolol has been used clinically to reduce anxiety. With an auditory fear conditioning task in rats, we assessed the effects of systemic propranolol on the expression and extinction of two measures of conditioned fear: freezing and suppression of bar-pressing.

METHODS

One day after receiving auditory fear conditioning, rats were injected with saline, propranolol, or peripheral beta-receptor blocker sotalol (both 10 mg/kg, IP). Twenty minutes after injection, rats were given either 6 or 12 extinction trials and were tested for extinction retention the following day. The effect of propranolol on the firing rate of neurons in prelimbic (PL) prefrontal cortex was also assessed.

RESULTS

Propranolol reduced freezing by more than 50%, an effect that was evident from the first extinction trial. Suppression was also significantly reduced. Despite this, propranolol had no effect on the acquisition or retention of extinction. Unlike propranolol, sotalol did not affect fear expression, although both drugs significantly reduced heart rate. This suggests that propranolol acts centrally to reduce fear. Consistent with this, propranolol reduced the firing rate of PL neurons.

CONCLUSION

Propranolol reduced the expression of conditioned fear, without interfering with extinction learning. Reduced fear with intact extinction suggests a possible use for propranolol in reducing anxiety during extinction-based exposure therapies, without interfering with long-term clinical response.