A food-predictive cue attributed with incentive salience engages subcortical afferents and efferents of the paraventricular nucleus of the thalamus

A Pavlovian, conditioned-reinforcement approach to reducing impulsive choice

Persistent impulsive choice, preference for a smaller-sooner over a larger-later reward, is associated with consequential life outcomes. Procedures that reduce nonhuman impulsive choice often have long training durations that reduce their translational utility. This experiment sought to alter the behavioral function of the stimulus rats encountered during the delay to the larger-later reward. That putatively aversive delay-signaling stimulus was given an appetitive function through Pavlovian conditioning. Forty Long-Evans rats (20 male) were randomly assigned to undergo Pavlovian training (lever-CS precedes food delivery by 8 s), and the other half underwent unpaired training (CS uncorrelated with food). During the test of impulsive choice that followed, choosing the larger-later reward produced 10-s access to the CS during the 20-s delay to that reward. Pavlovian training significantly increased larger-later reward choice relative to rats in the Unpaired group. The large effect size and ease of training are discussed in the context of potential translational research.

Pierre CL, Missfeldt Sanches T, Bimschleger HV, Gao J, Cheng R, Nguyen K, Holl KL, Polesskaya O, Ishiwari K, Chen H, Robinson TE, Flagel SB, Solberg Woods LC, Palmer AA, Meyer PJ. Genetic Loci Influencing Cue-Reactivity in Heterogeneous Stock Rats

Addiction vulnerability is associated with the tendency to attribute incentive salience to reward predictive cues. Both addiction and the attribution of incentive salience are influenced by environmental and genetic factors. To characterize the genetic contributions to incentive salience attribution, we performed a genome-wide association study (GWAS) in a cohort of 1596 heterogeneous stock (HS) rats. Rats underwent a Pavlovian conditioned approach task that characterized the responses to food-associated stimuli ("cues"). Responses ranged from cue-directed "sign-tracking" behavior to food-cup directed "goal-tracking" behavior (12 measures, SNP heritability: 0.051-0.215). Next, rats performed novel operant responses for unrewarded presentations of the cue using the conditioned reinforcement procedure. GWAS identified 14 quantitative trait loci (QTLs) for 11 of the 12 traits across both tasks. Interval sizes of these QTLs varied widely. Seven traits shared a QTL on chromosome 1 that contained a few genes (e.g., Tenm4, Mir708) that have been associated with substance use disorders and other psychiatric disorders in humans. Other candidate genes (e.g., Wnt11, Pak1) in this region had coding variants and expression-QTLs in mesocorticolimbic regions of the brain. We also conducted a Phenome-Wide Association Study (PheWAS) on addiction-related behaviors in HS rats and found that the QTL on chromosome 1 was also associated with nicotine self-administration in a separate cohort of HS rats. These results provide a starting point for the molecular genetic dissection of incentive motivational processes and provide further support for a relationship between the attribution of incentive salience and drug abuse-related traits.

Using sign tracking to experimentally increase self-control in rats

Impulsive choice describes a preference for a smaller-sooner reward (SSR) over a larger-later reward (LLR). A large body of research has examined different procedures for decreasing impulsive choice in nonhuman subjects. One limitation of these procedures is the extensive training duration required to achieve the desired results. To address this limitation, the current experiment examined the effects of a brief course of Pavlovian training, designed to establish a conditioned stimulus (CS) that could be strategically used to encourage LLR choices. Forty male Long-Evans rats were randomly assigned to appetitive Pavlovian or unpaired training. A lever insertion signaled an upcoming unconditioned stimulus (i.e., food presentation) for Pavlovian rats and it acquired CS properties. The lever was uncorrelated with the US in the unpaired group, and it did not acquire CS properties. In the subsequent impulsive-choice assessment, the lever from the training phase served as the lever rats pressed to choose the LLR. After an LLR choice, the lever remained in the chamber during the delay to the LLR, just as the SSR lever remained in the chamber until that reward was delivered. Pavlovian-trained rats sign tracked toward the lever CS and made significantly fewer impulsive choices than did rats in the unpaired group.

Resting-state brain activation patterns and network topology distinguish human sign and goal trackers

The "Sign-tracker/Goal-tracker" (ST/GT) is an animal model of individual differences in learning and motivational processes attributable to distinctive conditioned responses to environmental cues. While GT rats value the reward-predictive cue as a mere predictor, ST rats attribute it with incentive salience, engaging in aberrant reward-seeking behaviors that mirror those of impulse control disorders. Given its potential clinical value, the present study aimed to map such model onto humans and investigated resting state functional magnetic resonance imaging correlates of individuals categorized as more disposed to sign-tracking or goal-tracking behavior. To do so, eye-tracking was used during a translationally informed Pavlovian paradigm to classify humans as STs (n = 36) GTs (n = 35) or as Intermediates (n = 33), depending on their eye-gaze towards the reward-predictive cue or the reward location. Using connectivity and network-based approach, measures of resting state functional connectivity and centrality (role of a node as a hub) replicated preclinical findings, suggesting a major involvement of subcortical areas in STs, and dominant cortical involvement in GTs. Overall, the study strengthens the translational value of the ST/GT model, with important implications for the early identification of vulnerable phenotypes for psychopathological conditions such as substance use disorder.

Understanding the shift to compulsion in addiction: insights from personality traits, social factors, and neurobiology

Compulsion stands as a central symptom of drug addiction; however, only a small fraction of individuals who use drugs exhibit compulsive characteristics. Differences observed in Sign-trackers (ST) and Goal-trackers (GT) during Pavlovian conditioning may shed light on individual variances in drug addiction. Here, we focus on the behavioral attributes, formation processes, and neural mechanisms underlying ST and how they drive addiction toward compulsivity in humans. We will explore addiction from three interconnected levels: individual personality traits, social factors, and neurobiology. Furthermore, we distinguish between the processes of sensitization and habituation within ST. These nuanced distinctions across various aspects of addiction will contribute to our understanding of the addiction development process and the formulation of targeted preventive strategies.

Leveraging individual differences in cue-reward learning to investigate the psychological and neural basis of shared psychiatric symptomatology: The sign-tracker/goal-tracker model

In our modern environment, we are bombarded with stimuli or cues that exert significant influence over our actions. The extent to which such cues attain control over or disrupt goal-directed behavior is dependent on several factors, including one's inherent tendencies. Using a rodent model, we have shown that individuals vary in the value they place on stimuli associated with reward. Some individuals, termed "goal-trackers," primarily attribute predictive value to reward cues, whereas others, termed "sign-trackers," attribute predictive and incentive value. Thus, for sign-trackers, the reward cue is transformed into an incentive stimulus that is capable of eliciting maladaptive behaviors. The sign-tracker/goal-tracker animal model has allowed us to refine our understanding of behavioral and computational theories related to reward learning and to parse the underlying neural processes. Further, the neurobehavioral profile of sign-trackers is relevant to several psychiatric disorders, including substance use disorder, impulse control disorders, obsessive-compulsive disorder, attention-deficit/hyperactivity disorder, and posttraumatic stress disorder. This model, therefore, can advance our understanding of the psychological and neurobiological mechanisms that contribute to individual differences in vulnerability to psychopathology. Notably, initial attempts at translation-capturing individual variability in the propensity to sign-track in humans-have been promising and in line with what we have learned from the animal model. In this review, we highlight the pivotal role played by the sign-tracker/goal-tracker animal model in enriching our understanding of the psychological and neural basis of motivated behavior and psychiatric symptomatology. (PsycInfo Database Record (c) 2024 APA, all rights reserved).

Genomic Loci Influencing Cue-Reactivity in Heterogeneous Stock Rats

Addiction vulnerability is associated with the tendency to attribute incentive salience to reward predictive cues; both addiction and the attribution of incentive salience are influenced by environmental and genetic factors. To characterize the genetic contributions to incentive salience attribution, we performed a genome-wide association study (GWAS) in a cohort of 1,645 genetically diverse heterogeneous stock (HS) rats. We tested HS rats in a Pavlovian conditioned approach task, in which we characterized the individual responses to food-associated stimuli ("cues"). Rats exhibited either cue-directed "sign-tracking" behavior or food-cup directed "goal-tracking" behavior. We then used the conditioned reinforcement procedure to determine whether rats would perform a novel operant response for unrewarded presentations of the cue. We found that these measures were moderately heritable (SNP heritability, h2 = .189-.215). GWAS identified 14 quantitative trait loci (QTLs) for 11 of the 12 traits we examined. Interval sizes of these QTLs varied widely. 7 traits shared a QTL on chromosome 1 that contained a few genes (e.g. Tenm4, Mir708) that have been associated with substance use disorders and other mental health traits in humans. Other candidate genes (e.g. Wnt11, Pak1) in this region had coding variants and expression-QTLs in mesocorticolimbic regions of the brain. We also conducted a Phenome-Wide Association Study (PheWAS) on other behavioral measures in HS rats and found that regions containing QTLs on chromosome 1 were also associated with nicotine self-administration in a separate cohort of HS rats. These results provide a starting point for the molecular genetic dissection of incentive salience and provide further support for a relationship between attribution of incentive salience and drug abuse-related traits.

Molecular and spatial profiling of the paraventricular nucleus of the thalamus

The paraventricular nucleus of the thalamus (PVT) is known to regulate various cognitive and behavioral processes. However, while functional diversity among PVT circuits has often been linked to cellular differences, the molecular identity and spatial distribution of PVT cell types remain unclear. To address this gap, here we used single nucleus RNA sequencing (snRNA-seq) and identified five molecularly distinct PVT neuronal subtypes in the mouse brain. Additionally, multiplex fluorescent in situ hybridization of top marker genes revealed that PVT subtypes are organized by a combination of previously unidentified molecular gradients. Lastly, comparing our dataset with a recently published single-cell sequencing atlas of the thalamus yielded novel insight into the PVT's connectivity with the cortex, including unexpected innervation of auditory and visual areas. This comparison also revealed that our data contains a largely non-overlapping transcriptomic map of multiple midline thalamic nuclei. Collectively, our findings uncover previously unknown features of the molecular diversity and anatomical organization of the PVT and provide a valuable resource for future investigations.

Optogenetic stimulation of infralimbic cortex projections to the paraventricular thalamus attenuates context-induced renewal

Contexts associated with prior reinforcement can renew extinguished conditioned responding. The prelimbic (PL) and infralimbic (IL) cortices are thought to mediate the expression and suppression of conditioned responding, respectively. Evidence suggests that PL inputs to the paraventricular nucleus of the thalamus (PVT) drive the expression of cue-induced reinstatement of drug seeking and that IL inputs to the PVT mediate fear extinction retrieval. However, the role of these projections in renewal of appetitive Pavlovian conditioned responding is unknown. We trained male and female Long-Evans rats to associate a conditioned stimulus (CS; 10 s white noise) with delivery of a 10% sucrose unconditioned stimulus (US; .2 ml/CS) to a fluid port in a distinct context (Context A). We then extinguished responding by presenting the CS without the US in a different context (Context B). At test, rats were returned to Context A, and optogenetic stimulation was delivered to either the IL-to-PVT or PL-to-PVT pathway during CS presentations. Optically stimulating the IL-to-PVT, but not the PL-to-PVT pathway, attenuated ABA renewal of CS port entries, and this effect was similar in males and females. Further, rats self-administered optical stimulation of the IL-to-PVT but not the PL-to-PVT pathway suggesting that activation of the IL-to-PVT pathway is reinforcing. The effectiveness of optical stimulation parameters to activate neurons in the IL, PL and PVT was confirmed using Fos immunohistochemistry. These findings provide evidence for novel neural mechanisms in renewal of responding to a sucrose-predictive CS, as well as more generally in contextual processing and appetitive associative learning.

Neural correlates of recall and extinction in a rat model of appetitive Pavlovian conditioning

Extinction is a fundamental form of inhibitory learning that is important for adapting to changing environmental contingencies. While numerous studies have investigated the neural correlates of extinction using Pavlovian fear conditioning and appetitive operant reward-seeking procedures, less is known about the neural circuitry mediating the extinction of appetitive Pavlovian responding. Here, we aimed to generate an extensive brain activation map of extinction learning in a rat model of appetitive Pavlovian conditioning. Male Long-Evans rats were trained to associate a conditioned stimulus (CS; 20 s white noise) with the delivery of a 10% sucrose unconditioned stimulus (US; 0.3 ml/CS) to a fluid port. Control groups also received CS presentations, but sucrose was delivered either during the inter-trial interval or in the home-cage. After conditioning, 1 or 6 extinction sessions were conducted in which the CS was presented but sucrose was withheld. We performed Fos immunohistochemistry and network connectivity analyses on a set of cortical, striatal, thalamic, and amygdalar brain regions. Neural activity in the prelimbic cortex, ventral orbitofrontal cortex, nucleus accumbens core, and paraventricular nucleus of the thalamus was greater during recall relative to extinction. Conversely, prolonged extinction following 6 sessions induced increased neural activity in the infralimbic cortex, medial orbitofrontal cortex, and nucleus accumbens shell compared to home-cage controls. All these structures were similarly recruited during recall on the first extinction session. These findings provide novel evidence for the contribution of brain areas and neural networks that are differentially involved in the recall versus extinction of appetitive Pavlovian conditioned responding.

Sleep-mediated regulation of reward circuits: implications in substance use disorders

Our modern society suffers from both pervasive sleep loss and substance abuse-what may be the indications for sleep on substance use disorders (SUDs), and could sleep contribute to the individual variations in SUDs? Decades of research in sleep as well as in motivated behaviors have laid the foundation for us to begin to answer these questions. This review is intended to critically summarize the circuit, cellular, and molecular mechanisms by which sleep influences reward function, and to reveal critical challenges for future studies. The review also suggests that improving sleep quality may serve as complementary therapeutics for treating SUDs, and that formulating sleep metrics may be useful for predicting individual susceptibility to SUDs and other reward-associated psychiatric diseases.

A Videogame as a Tool for Clinical Screening of Possible Vulnerability to Impulsivity and Attention Disturbances in Children

An attention disturbance is a problem that affects many school-aged children. The assessment in children is usually report-based, and as a result, controversy surrounds the diagnosis. To solve this issue, the aim of this study was to develop a new tool to detect possible attention-related problems and impulsive behavior in 4- and 5-year-old children. This tool was developed as an Android app and could be used to provide an early indicator of possible future development problems. A sample of 103 children (48 girls and 55 boys) was randomly selected from primary schools and assessed by Pinky-Piggy, a videogame application based on a classical paradigm in experimental psychology. Data from this app were compared with a Child Neuropsychological Maturity Questionnaire. The subjects displayed different patterns of response to play a very simple game called Pinky-Piggy. The application discriminated between high-responders and low responders. The results showed a relationship between these two profiles and the levels of attention and neurodevelopment in each group. The tool could identify different types of profiles and demonstrated its potential to evaluate endophenotypes to predict attentional problems related to impulsive behavior. Additionally, it required less time and fewer tests to identify possible at-risk populations, thus assisting in clinical diagnosis.

Appetitive 50 kHz calls in a pavlovian conditioned approach task in Cacna1c haploinsufficient rats

We have previously shown that rats emit high-frequency 50 kHz ultrasonic vocalizations (USV) during sign- and goal-tracking in a common Pavlovian conditioned approach task. Such 50 kHz calls are probably related to positive affect and are associated with meso-limbic dopamine function. In humans, the CACNA1C gene, encoding for the α_1C subunit of the L-type voltage-gated calcium channel Ca_V1.2, is implicated in several mental disorders, including mood disorders associated with altered dopamine signaling. In the present study, we investigated sign- and goal-tracking behavior and the emission of 50 kHz USV in Cacna1c haploinsufficent rats in a task where food pellet delivery is signaled by an appearance of an otherwise inoperable lever. Over the course of this Pavlovian training, these rats not only increased their approach to the reward site, but also their rates of pressing the inoperable lever. During subsequent extinction tests, where reward delivery was omitted, extinction patterns differed between reward site (i.e. magazine entries) and lever, since magazine entries quickly declined whereas behavior towards the lever transiently increased. Based on established criteria to define sign- or goal-tracking individuals, no CACNA1C rat met a sign-tracking criterion, since around 42% of rats tested where goal-trackers and the other 58% fell into an intermediate range. Regarding USV, we found that the CACNA1C rats emitted 50 kHz calls with a clear subject-dependent pattern; also, most of them were of a flat subtype and occurred mainly during initial habituation phases without cues or rewards. Compared, to previously published wildtype controls, Cacna1c haploinsufficent rats displayed reduced numbers of appetitive 50 kHz calls. Moreover, similar to wildtype littermate controls, 50 kHz call emission in Cacna1c haploinsufficent rats was intra-individually stable over training days and was negatively associated with goal-tracking. Together, these findings provide evidence in support of 50 kHz calls as trait marker. The finding that Cacna1c haploinsufficent rats show reductions of 50 kHz calls accompanied with more goal-tracking, is consistent with the assumption of altered dopamine signaling in these rats, a finding which supports their applicability in models of mental disorders.

Inhibition of a cortico-thalamic circuit attenuates cue-induced reinstatement of drug-seeking behavior in "relapse prone" male rats

RATIONALE

Relapse often occurs when individuals are exposed to stimuli or cues previously associated with the drug-taking experience. The ability of drug cues to trigger relapse is believed to be a consequence of incentive salience attribution, a process by which the incentive value of reward is transferred to the reward-paired cue. Sign-tracker (ST) rats that attribute enhanced incentive value to reward cues are more prone to relapse compared to goal-tracker (GT) rats that primarily attribute predictive value to such cues.

OBJECTIVES

The neurobiological mechanisms underlying this individual variation in relapse propensity remains largely unexplored. The paraventricular nucleus of the thalamus (PVT) has been identified as a critical node in the regulation of cue-elicited behaviors in STs and GTs, including cue-induced reinstatement of drug-seeking behavior. Here we used a chemogenetic approach to assess whether "top-down" cortical input from the prelimbic cortex (PrL) to the PVT plays a role in mediating individual differences in relapse propensity.

RESULTS

Chemogenetic inhibition of the PrL-PVT pathway selectively decreased cue-induced reinstatement of drug-seeking behavior in STs, without affecting behavior in GTs. In contrast, cocaine-primed drug-seeking behavior was not affected in either phenotype. Furthermore, when rats were characterized based on a different behavioral phenotype-locomotor response to novelty-inhibition of the PrL-PVT pathway had no effect on either cue- or drug-induced reinstatement.

CONCLUSIONS

These results highlight an important role for the PrL-PVT pathway in vulnerability to relapse that is consequent to individual differences in the propensity to attribute incentive salience to discrete reward cues.

Neural correlates and determinants of approach-avoidance conflict in the prelimbic prefrontal cortex

The recollection of environmental cues associated with threat or reward allows animals to select the most appropriate behavioral responses. Neurons in the prelimbic (PL) cortex respond to both threat- and reward-associated cues. However, it remains unknown whether PL regulates threat-avoidance vs. reward-approaching responses when an animals’ decision depends on previously associated memories. Using a conflict model in which male Long–Evans rats retrieve memories of shock- and food-paired cues, we observed two distinct phenotypes during conflict: (1) rats that continued to press a lever for food (Pressers) and (2) rats that exhibited a complete suppression in food seeking (Non-pressers). Single-unit recordings revealed that increased risk-taking behavior in Pressers is associated with persistent food-cue responses in PL, and reduced spontaneous activity in PL glutamatergic (PL^GLUT) neurons during conflict. Activating PL^GLUT neurons in Pressers attenuated food-seeking responses in a neutral context, whereas inhibiting PL^GLUT neurons in Non-pressers reduced defensive responses and increased food approaching during conflict. Our results establish a causal role for PL^GLUT neurons in mediating individual variability in memory-based risky decision-making by regulating threat-avoidance vs. reward-approach behaviors.

Thalamo-Nucleus Accumbens Projections in Motivated Behaviors and Addiction

The ventral striatum, also called nucleus accumbens (NAc), has long been known to integrate information from cortical, thalamic, midbrain and limbic nuclei to mediate goal-directed behaviors. Until recently thalamic afferents have been overlooked when studying the functions and connectivity of the NAc. However, findings from recent studies have shed light on the importance and roles of precise Thalamus to NAc connections in motivated behaviors and in addiction. In this review, we summarize studies using techniques such as chemo- and optogenetics, electrophysiology and in vivo calcium imaging to elucidate the complex functioning of the thalamo-NAc afferents, with a particular highlight on the projections from the Paraventricular Thalamus (PVT) to the NAc. We will focus on the recent advances in the understanding of the roles of these neuronal connections in motivated behaviors, with a special emphasis on their implications in addiction, from cue-reward association to the mechanisms driving relapse.

The Paraventricular Thalamus as a Critical Node of Motivated Behavior via the Hypothalamic-Thalamic-Striatal Circuit

In this review, we highlight evidence that supports a role for the paraventricular nucleus of the thalamus (PVT) in motivated behavior. We include a neuroanatomical and neurochemical overview, outlining what is known of the cellular makeup of the region and its most prominent afferent and efferent connections. We discuss how these connections and distinctions across the anterior-posterior axis correspond to the perceived function of the PVT. We then focus on the hypothalamic-thalamic-striatal circuit and the neuroanatomical and functional placement of the PVT within this circuit. In this regard, the PVT is ideally positioned to integrate information regarding internal states and the external environment and translate it into motivated actions. Based on data that has emerged in recent years, including that from our laboratory, we posit that orexinergic (OX) innervation from the lateral hypothalamus (LH) to the PVT encodes the incentive motivational value of reward cues and thereby alters the signaling of the glutamatergic neurons projecting from the PVT to the shell of the nucleus accumbens (NAcSh). The PVT-NAcSh pathway then modulates dopamine activity and resultant cue-motivated behaviors. As we and others apply novel tools and approaches to studying the PVT we will continue to refine the anatomical, cellular, and functional definitions currently ascribed to this nucleus and further elucidate its role in motivated behaviors.

Acute, but not longer-term, exposure to environmental enrichment attenuates Pavlovian cue-evoked conditioned approach and Fos expression in the prefrontal cortex in mice

Exposure to environmental enrichment can modify the impact of motivationally relevant stimuli. For instance, previous studies in rats have found that even a brief, acute (~1 day), but not chronic, exposure to environmentally enriched (EE) housing attenuates instrumental lever pressing for sucrose-associated cues in a conditioned reinforcement setup. Moreover, acute EE reduces corticoaccumbens activity, as measured by decreases in expression of the neuronal activity marker "Fos." Currently, it is not known whether acute EE also reduces sucrose seeking and corticoaccumbens activity elicited by non-contingent or "forced" exposure to sucrose cues, which more closely resembles cue exposure encountered in daily life. We therefore measured the effects of acute/intermittent (1 day or 6 day of EE prior to test day) versus chronic (EE throughout conditioning lasting until test day) EE on the ability of a Pavlovian sucrose cue to elicit sucrose seeking (conditioned approach) and Fos expression in the medial prefrontal cortex (mPFC), orbitofrontal cortex (OFC), and nucleus accumbens (NAc) in mice. One day, but not 6 day or chronic EE , reduced sucrose seeking and Fos in the deep layers of the dorsal mPFC. By contrast, 1 day, 6 day, and chronic EE all reduced Fos in the shallow layers of the OFC. None of the EE manipulations modulated NAc Fos expression. We reveal how EE reduces behavioral reactivity to sucrose cues by reducing activity in select prefrontal cortical brain areas. Our work further demonstrates the robustness of EE in its ability to modulate various forms of reward-seeking across species.

The paraventricular nucleus of the thalamus: an integrative node underlying homeostatic behavior

Early anatomical evidence suggested that the paraventricular nucleus of the thalamus (PVT) regulates arousal, as well as emotional and motivated behaviors. We discuss recent studies using modern techniques which now confirm and expand the involvement of the rodent PVT in these functions. Despite the emerging notion that the PVT is implicated in various behavioral processes, a recurrent theme is that activity in this brain region depends on internal state information arriving from the hypothalamus and brainstem, and is influenced by prior experience. We propose that the primary function of the PVT is to detect homeostatic challenges by integrating information about prior experiences, competing needs, and internal state to guide adaptive behavioral responses aimed at restoring homeostasis.

A proposed role for glucocorticoids in mediating dopamine-dependent cue-reward learning

Learning to respond appropriately to one's surrounding environment is fundamental to survival. Importantly, however, individuals vary in how they respond to cues in the environment and this variation may be a key determinant of psychopathology. The ability of seemingly neutral cues to promote maladaptive behavior is a hallmark of several psychiatric disorders including, substance use disorder, post-traumatic stress disorder, eating disorders and obsessive-compulsive disorder. Thus, it is important to uncover the neural mechanisms by which such cues are able to attain inordinate control and promote psychopathological behavior. Here, we suggest that glucocorticoids play a critical role in this process. Glucocorticoids are primarily recognized as the main hormone secreted in response to stress but are known to exert their effects across the body and the brain, and to affect learning and memory, cognition and reward-related behaviors, among other things. Here we speculate that glucocorticoids act to facilitate a dopamine-dependent form of cue-reward learning that appears to be relevant to a number of psychiatric conditions. Specifically, we propose to utilize the sign-tracker/goal-tracker animal model as a means to capture individual variation in stimulus-reward learning and to isolate the role of glucocorticoid-dopamine interactions in mediating these individual differences. It is hoped that this framework will lead to the discovery of novel mechanisms that contribute to complex neuropsychiatric disorders and their comorbidity.

Motivational competition and the paraventricular thalamus

Although significant progress has been made in understanding the behavioral and brain mechanisms for motivational systems, much less is known about competition between motivational states or motivational conflict (e.g., approach - avoidance conflict). Despite being produced under diverse conditions, behavior during motivational competition has two signatures: bistability and metastability. These signatures reveal the operation of positive feedback mechanisms in behavioral selection. Different neuronal architectures can instantiate this selection to achieve bistability and metastability in behavior, but each relies on circuit-level inhibition to achieve rapid and stable selection between competing tendencies. Paraventricular thalamus (PVT) is identified as critical to this circuit level inhibition, resolving motivational competition via its extensive projections to local inhibitory networks in the ventral striatum and extended amygdala, enabling adaptive responding under motivational conflict.

A thalamic bridge from sensory perception to cognition

The ability to adapt to dynamic environments requires tracking multiple signals with variable sensory salience and fluctuating behavioral relevance. This complex process requires integrative crosstalk between sensory and cognitive brain circuits. Functional interactions between cortical and thalamic regions are now considered essential for both sensory perception and cognition but a clear account of the functional link between sensory and cognitive circuits is currently lacking. This review aims to document how thalamic nuclei may effectively act as a bridge allowing to fuse perceptual and cognitive events into meaningful experiences. After highlighting key aspects of thalamocortical circuits such as the classic first-order/higher-order dichotomy, we consider the role of the thalamic reticular nucleus from directed attention to cognition. We next summarize research relying on Pavlovian learning paradigms, showing that both first-order and higher-order thalamic nuclei contribute to associative learning. Finally, we propose that modulator inputs reaching all thalamic nuclei may be critical for integrative purposes when environmental signals are computed. Altogether, the thalamus appears as the bridge linking perception, cognition and possibly affect.

'Liking' and 'wanting' in eating and food reward: Brain mechanisms and clinical implications

It is becoming clearer how neurobiological mechanisms generate 'liking' and 'wanting' components of food reward. Mesocorticolimbic mechanisms that enhance 'liking' include brain hedonic hotspots, which are specialized subregions that are uniquely able to causally amplify the hedonic impact of palatable tastes. Hedonic hotspots are found in nucleus accumbens medial shell, ventral pallidum, orbitofrontal cortex, insula cortex, and brainstem. In turn, a much larger mesocorticolimbic circuitry generates 'wanting' or incentive motivation to obtain and consume food rewards. Hedonic and motivational circuitry interact together and with hypothalamic homeostatic circuitry, allowing relevant physiological hunger and satiety states to modulate 'liking' and 'wanting' for food rewards. In some conditions such as drug addiction, 'wanting' is known to dramatically detach from 'liking' for the same reward, and this may also occur in over-eating disorders. Via incentive sensitization, 'wanting' selectively becomes higher, especially when triggered by reward cues when encountered in vulnerable states of stress, etc. Emerging evidence suggests that some cases of obesity and binge eating disorders may reflect an incentive-sensitization brain signature of cue hyper-reactivity, causing excessive 'wanting' to eat. Future findings on the neurobiological bases of 'liking' and 'wanting' can continue to improve understanding of both normal food reward and causes of clinical eating disorders.

The lateral hypothalamus and orexinergic transmission in the paraventricular thalamus promote the attribution of incentive salience to reward-associated cues

RATIONALE

Prior research suggests that the neural pathway from the lateral hypothalamic area (LHA) to the paraventricular nucleus of the thalamus (PVT) mediates the attribution of incentive salience to Pavlovian reward cues. However, a causal role for the LHA and the neurotransmitters involved have not been demonstrated in this regard.

OBJECTIVES

To examine (1) the role of LHA in the acquisition of Pavlovian conditioned approach (PavCA) behaviors, and (2) the role of PVT orexin 1 receptors (OX1r) and orexin 2 receptors (OX2r) in the expression of PavCA behaviors and conditioned reinforcement.

METHODS

Rats received excitotoxic lesions of the LHA prior to Pavlovian training. A separate cohort of rats characterized as sign-trackers (STs) or goal-trackers (GTs) received the OX1r antagonist SB-334867, or the OX2r antagonist TCS-OX2-29, into the PVT, to assess their effects on the expression of PavCA behavior and on the conditioned reinforcing properties of a Pavlovian reward cue.

RESULTS

LHA lesions attenuated the development of sign-tracking behavior. Administration of either the OX1r or OX2r antagonist into the PVT reduced sign-tracking behavior in STs. Further, OX2r antagonism reduced the conditioned reinforcing properties of a Pavlovian reward cue in STs.

CONCLUSIONS

The LHA is necessary for the development of sign-tracking behavior; and blockade of orexin signaling in the PVT attenuates the expression of sign-tracking behavior and the conditioned reinforcing properties of a Pavlovian reward cue. Together, these data suggest that LHA orexin inputs to the PVT are a key component of the circuitry that encodes the incentive motivational value of reward cues.

The Paraventricular Nucleus of the Thalamus Is an Important Node in the Emotional Processing Network

The paraventricular nucleus of the thalamus (PVT) has for decades been acknowledged to be an important node in the limbic system, but studies of emotional processing generally fail to incorporate it into their investigational framework. Here, we propose that the PVT should be considered as an integral part of the emotional processing network. Through its distinct subregions, cell populations, and connections with other limbic nuclei, the PVT participates in both major features of emotion: arousal and valence. The PVT, particularly the anterior PVT, can through its neuronal activity promote arousal, both as part of the sleep-wake cycle and in response to novel stimuli. It is also involved in reward, being both responsive to rewarding stimuli and itself affecting behavior reflecting reward, likely via specific populations of cells distributed throughout its subregions. Similarly, neuronal activity in the PVT contributes to depression-like behavior, through yet undefined subregions. The posterior PVT in particular demonstrates a role in anxiety-like behavior, generally promoting but also inhibiting this behavior. This subregion is also especially responsive to stressors, and it functions to suppress the stress response following chronic stress exposure. In addition to participating in unconditioned or primary emotional responses, the PVT also makes major contributions to conditioned emotional behavior. Neuronal activity in response to a reward-predictive cue can be detected throughout the PVT, and endogenous activity in the posterior PVT strongly predicts approach or seeking behavior. Similarly, neuronal activity during conditioned fear retrieval is detected in the posterior PVT and its activation facilitates the expression of conditioned fear. Much of this involvement of the PVT in arousal and valence has been shown to occur through the same general afferents and efferents, including connections with the hypothalamus, prelimbic and infralimbic cortices, nucleus accumbens, and amygdala, although a detailed functional map of the PVT circuits that control emotional responses remains to be delineated. Thus, while caveats exist and more work is required, the PVT, through its extensive connections with other prominent nuclei in the limbic system, appears to be an integral part of the emotional processing network.

Ultrasonic vocalizations and individual differences in rats performing a Pavlovian conditioned approach task

Rats emit distinct types of ultrasonic vocalizations (USV), including high-frequency 50-kHz USV, which occur in appetitive situations. Such 50-kHz USV are thought to reflect positive affective states, for example in case of reward anticipation, and are linked to dopamine signaling. The present study was conducted to investigate whether rats emit 50-kHz USV during a Pavlovian conditioned approach task and whether trait-like differences in 50-kHz USV emission are associated with sign- versus goal-tracking. We hypothesize that individuals engaging more with a cue predicting a food reward will also elicit more 50-kHz USV. In order to test this, we investigated 34 female rats and gauged USV while they underwent a Pavlovian conditioned approach training and extinction paradigm. For one, we found a high subject-dependent variability in the emission of 50-kHz calls. These were not largely affected by state differences, since these 50-kHz USV were observed throughout the task. During task progress and in most subjects, there was a rather complete shift toward goal-tracking, but subjects engaging more with the cue predicting a reward also emitted higher numbers of appetitive 50-kHz calls. This supports the hypothesis that sign-tracking is positively associated with the emission of 50-kHz USV. The high subject-dependent variability in the emission of 50-kHz calls warrants special attention in future appetitive studies.

Mapping sign-tracking and goal-tracking onto human behaviors

As evidenced through classic Pavlovian learning mechanisms, environmental cues can become incentivized and influence behavior. These stimulus-outcome associations are relevant in everyday life but may be particularly important for the development of impulse control disorders including addiction. Rodent studies have elucidated specific learning profiles termed 'sign-tracking' and 'goal-tracking' which map onto individual differences in impulsivity and other behaviors associated with impulse control disorders' etiology, course, and relapse. Whereas goal-trackers are biased toward the outcome, sign-trackers fixate on features that are associated with but not necessary for achieving an outcome; a pattern of behavior that often leads to escalation of reward-seeking that can be maladaptive. The vast majority of the sign- and goal-tracking research has been conducted using rodent models and very few have bridged this concept into the domain of human behavior. In this review, we discuss the attributes of sign- and goal-tracking profiles, how these are manifested neurobiologically, and how these distinct learning styles could be an important tool for clinical interventions in human addiction.

The role of the paraventricular nucleus of the thalamus in the augmentation of heroin seeking induced by chronic food restriction

Drug addiction is a chronic disorder that is characterized by compulsive drug seeking and involves cycling between periods of compulsive drug use, abstinence, and relapse. In both human addicts and animal models of addiction, chronic food restriction has been shown to increase rates of relapse. Previously, our laboratory has demonstrated a robust increase in drug seeking following a period of withdrawal in chronically food-restricted rats compared with sated rats. To date, the neural mechanisms that mediate the effect of chronic food restriction on drug seeking have not been elucidated. However, the paraventricular nucleus of the thalamus (PVT) appears to be a promising target to investigate. The objective of the current study was to examine the role of the PVT in the augmentation of heroin seeking induced by chronic food restriction. Male Long-Evans rats were trained to self-administer heroin for 10 days. Rats were then removed from the training chambers and experienced a 14-day withdrawal period with either unrestricted (sated) or mildly restricted (FDR) access to food. On day 14, rats underwent a 1-hour heroin-seeking test under extinction conditions, during which neural activity in the PVT was either inhibited or increased using pharmacological or chemogenetic approaches. Unexpectedly, inhibition of the PVT did not alter heroin seeking in food-restricted or sated rats, while enhancing neural activity in the PVT-attenuated heroin seeking in food-restricted rats. These results indicate that PVT activity can modulate heroin seeking induced by chronic food restriction.

Understanding Addiction Using Animal Models

Drug addiction is a neuropsychiatric disorder with grave personal consequences that has an extraordinary global economic impact. Despite decades of research, the options available to treat addiction are often ineffective because our rudimentary understanding of drug-induced pathology in brain circuits and synaptic physiology inhibits the rational design of successful therapies. This understanding will arise first from animal models of addiction where experimentation at the level of circuits and molecular biology is possible. We will review the most common preclinical models of addictive behavior and discuss the advantages and disadvantages of each. This includes non-contingent models in which animals are passively exposed to rewarding substances, as well as widely used contingent models such as drug self-administration and relapse. For the latter, we elaborate on the different ways of mimicking craving and relapse, which include using acute stress, drug administration or exposure to cues and contexts previously paired with drug self-administration. We further describe paradigms where drug-taking is challenged by alternative rewards, such as appetitive foods or social interaction. In an attempt to better model the individual vulnerability to drug abuse that characterizes human addiction, the field has also established preclinical paradigms in which drug-induced behaviors are ranked by various criteria of drug use in the presence of negative consequences. Separation of more vulnerable animals according to these criteria, along with other innate predispositions including goal- or sign-tracking, sensation-seeking behavior or impulsivity, has established individual genetic susceptibilities to developing drug addiction and relapse vulnerability. We further examine current models of behavioral addictions such as gambling, a disorder included in the DSM-5, and exercise, mentioned in the DSM-5 but not included yet due to insufficient peer-reviewed evidence. Finally, after reviewing the face validity of the aforementioned models, we consider the most common standardized tests used by pharmaceutical companies to assess the addictive potential of a drug during clinical trials.

Neural circuits linking sleep and addiction: Animal models to understand why select individuals are more vulnerable to substance use disorders after sleep deprivation

Individuals differ widely in their drug-craving behaviors. One reason for these differences involves sleep. Sleep disturbances lead to an increased risk of substance use disorders and relapse in only some individuals. While animal studies have examined the impact of sleep on reward circuitry, few have addressed the role of individual differences in the effects of altered sleep. There does, however, exist a rodent model of individual differences in reward-seeking behavior: the sign/goal-tracker model of Pavlovian conditioned approach. In this model, only some rats show the key behavioral traits associated with addiction, including impulsivity and poor attentional control, making this an ideal model system to examine individually distinct sleep-reward interactions. Here, we describe how the limbic neural circuits responsible for individual differences in incentive motivation overlap with those involved in sleep-wake regulation, and how this model can elucidate the common underlying mechanisms. Consideration of individual differences in preclinical models would improve our understanding of how sleep interacts with motivational systems, and why sleep deprivation contributes to addiction in only select individuals.

Sign and goal tracker rats process differently the incentive salience of a conditioned stimulus

Sign and goal tracker animals show different behavioral patterns in response to conditioned stimuli, which may be driven by different neural circuits involved in processing stimuli. Here, we explored whether sign and goal-tracker profiles implicated different brain regions and responses to incentive salience of stimuli. We performed three experiments using male Wistar rats. Experiment 1 showed that lesioning the medial prefrontal cortex increased the prevalence of the goal-tracker phenotype. Experiment 2 assessed the developmental trajectory of the salience incentive attribution to a conditioned stimulus, showing that increased incentive salience of stimuli increased the prevalence of the sign-tracker phenotype in mature, but not preadolescent rats. In experiment 3, the functional impact of the medial prefrontal cortex circuits was analyzed with a latent inhibition procedure. Sign tracker rats showed a reduced latent inhibition to stimuli previously exposed when compared to goal tracker or intermediate rats. The overall results of this study highlight a key role of the medial prefrontal cortex for sign tracking behavior. The expression of sign and goal tracker phenotypes changed after lesion to the medial prefrontal cortex (experiment 1), differed across development (experiment 2), and showed differences in the attentional processes to previously exposed stimuli, as preexposure to CS was ineffective in sign tracker animals (experiment 3). These data indicate that the responses to the incentive salience of stimuli in sign tracker and goal tracker profiles are likely driven by different neural circuitry, with a different role of prefrontal cortical function.

The paraventricular thalamus is a critical mediator of top-down control of cue-motivated behavior in rats

Cues in the environment can elicit complex emotional states, and thereby maladaptive behavior, as a function of their ascribed value. Here we capture individual variation in the propensity to attribute motivational value to reward-cues using the sign-tracker/goal-tracker animal model. Goal-trackers attribute predictive value to reward-cues, and sign-trackers attribute both predictive and incentive value. Using chemogenetics and microdialysis, we show that, in sign-trackers, stimulation of the neuronal pathway from the prelimbic cortex (PrL) to the paraventricular nucleus of the thalamus (PVT) decreases the incentive value of a reward-cue. In contrast, in goal-trackers, inhibition of the PrL-PVT pathway increases both the incentive value and dopamine levels in the nucleus accumbens shell. The PrL-PVT pathway, therefore, exerts top-down control over the dopamine-dependent process of incentive salience attribution. These results highlight PrL-PVT pathway as a potential target for treating psychopathologies associated with the attribution of excessive incentive value to reward-cues, including addiction.

Modelling Differential Vulnerability to Substance Use Disorder in Rodents: Neurobiological Mechanisms

Despite the prevalence of drug use within society, only a subset of individuals actively taking addictive drugs lose control over their intake and develop compulsive drug-seeking and intake that typifies substance use disorder (SUD). Although research in this field continues to be an important and dynamic discipline, the specific neuroadaptations that drive compulsive behaviour in humans addicted to drugs and the neurobiological mechanisms that underlie an individual's innate susceptibility to SUD remain surprisingly poorly understood. Nonetheless, it is clear from research within the clinical domain that some behavioural traits are recurrently co-expressed in individuals with SUD, thereby inviting the hypothesis that certain behavioural endophenotypes may be predictive, or at least act in some way, to modify an individual's probability for developing this disorder. The analysis of such endophenotypes and their catalytic relationship to the expression of addiction-related behaviours has been greatly augmented by experimental approaches in rodents that attempt to capture diagnostically relevant aspects of this progressive brain disorder. This work has evolved from an early focus on aberrant drug reinforcement mechanisms to a now much richer account of the putatively impaired cognitive control processes that ultimately determine individual trajectories to compulsive drug-related behaviours. In this chapter we discuss the utility of experimental approaches in rodents designed to elucidate the neurobiological and genetic underpinnings of so-called risk traits and how these innate vulnerabilities collectively contribute to the pathogenesis of SUD.

Feeding Behavior Survival Circuit: Anticipation & Competition

A decision to eat or not to eat can be beneficial or detrimental to an organism, depending on internal and external conditions. Because feeding is essential for survival, as it replenishes energy and nutrients, in safe environments, its expression is prioritized over other behaviors. Under threat, responding to danger is a higher priority for survival and feeding is paused even in hungry states. Thus, successful expression of feeding behavior requires adaptive control that utilizes cognitive processes to dynamically assess and update internal drives and environmental changes. Recently identified key circuit components, which are important in anticipatory responding based on food memories and predictions and in resolving feeding versus threat avoidance competition, will be discussed within a connectional schema.

Transient inactivation of the paraventricular nucleus of the thalamus enhances cue-induced reinstatement in goal-trackers, but not sign-trackers

RATIONALE

The paraventricular nucleus of the thalamus (PVT) has been shown to mediate cue-motivated behaviors, such as sign- and goal-tracking, as well as reinstatement of drug-seeking behavior. However, the role of the PVT in mediating individual variation in cue-induced drug-seeking behavior remains unknown.

OBJECTIVES

This study aimed to determine if inactivation of the PVT differentially mediates cue-induced drug-seeking behavior in sign-trackers and goal-trackers.

METHODS

Rats were characterized as sign-trackers (STs) or goal-trackers (GTs) based on their Pavlovian conditioned approach behavior. Rats were then exposed to 15 days of cocaine self-administration, followed by a 2-week forced abstinence period and then extinction training. Rats then underwent tests for cue-induced reinstatement and general locomotor activity, prior to which they received an infusion of either saline (control) or baclofen/muscimol (B/M) to inactivate the PVT.

RESULTS

Relative to control animals of the same phenotype, GTs show a robust increase in cue-induced drug-seeking behavior following PVT inactivation, whereas the behavior of STs was not affected. PVT inactivation did not affect locomotor activity in either phenotype.

CONCLUSION

In GTs, the PVT appears to inhibit the expression of drug-seeking, presumably by attenuating the incentive value of the drug cue. Thus, inactivation of the PVT releases this inhibition in GTs, resulting in an increase in cue-induced drug-seeking behavior. PVT inactivation did not affect cue-induced drug-seeking behavior in STs, suggesting that the role of the PVT in encoding the incentive motivational value of drug cues differs between STs and GTs.

Organization of Valence-Encoding and Projection-Defined Neurons in the Basolateral Amygdala

The basolateral amygdala (BLA) mediates associative learning for both fear and reward. Accumulating evidence supports the notion that different BLA projections distinctly alter motivated behavior, including projections to the nucleus accumbens (NAc), medial aspect of the central amygdala (CeM), and ventral hippocampus (vHPC). Although there is consensus regarding the existence of distinct subsets of BLA neurons encoding positive or negative valence, controversy remains regarding the anatomical arrangement of these populations. First, we map the location of more than 1,000 neurons distributed across the BLA and recorded during a Pavlovian discrimination task. Next, we determine the location of projection-defined neurons labeled with retrograde tracers and use CLARITY to reveal the axonal path in 3-dimensional space. Finally, we examine the local influence of each projection-defined populations within the BLA. Understanding the functional and topographical organization of circuits underlying valence assignment could reveal fundamental principles about emotional processing.

Boosting of Thalamic D2 Dopaminergic Transmission: A Potential Strategy for Drug-Seeking Attenuation

This commentary focuses on novel findings by Clark et al. (2017) published in eNeuro, which show that dopamine D2 receptors (D2Rs) in the paraventricular nucleus of the thalamus (PVT) are involved in cocaine sensitization. We extend the discussion on how their findings contribute to our understanding of the role of the PVT in drug seeking by providing new insight on the role of the PVT in the regulation of food-seeking and fear responses. We also consider the significance of the neuroanatomical findings reported by Clark et al., that the PVT is reciprocally connected with areas of the brain involved in addiction and discuss the implications associated with the source and type of dopaminergic fibers innervating this area of the thalamus.

Paraventricular Thalamic Control of Food Intake and Reward: Role of Glucagon-Like Peptide-1 Receptor Signaling

Paraventricular thalamic nucleus (PVT) neurons receive hindbrain and hypothalamic inputs, and project to forebrain sites involved in reward and motivation function. The role of PVT in energy balance and reward control is however understudied. Given that PVT neurons express glucagon-like peptide-1 receptors (GLP-1R), which are critical to feeding and body weight control, we tested the hypothesis that PVT GLP-1R signaling contributes to food intake and reward inhibition. To assess the hypothesis, behavioral tests including chow and high-fat diet intake, meal patterns, conditioned place preference for high-fat food, cue-induced reinstatement of sucrose-seeking, and motivation to work for sucrose were employed following intra-PVT delivery of either GLP-1R agonist, exendin-4 (Ex4), or GLP-1R antagonist, exendin-9-39 (Ex9). Anatomical and electrophysiological experiments were conducted to examine the neural connections and cellular mechanisms of GLP-1R signaling on PVT-to-nucleus accumbens (NAc) projecting neurons. PVT GLP-1R agonism reduced food intake, food-motivation, and food-seeking, while blocking endogenous PVT GLP-1R signaling increased meal size and food intake. PVT neurons receive GLP-1 innervation from nucleus tractus solitarius preproglucagon neurons that were activated by food intake; these GLP-1 fibers formed close appositions to putative GLP-1R-expressing PVT cells that project to the NAc. Electrophysiological recordings of PVT-to-NAc neurons revealed that GLP-1R activation reduced their excitability, mediated in part via suppression of excitatory synaptic drive. Collectively, these behavioral, electrophysiological and anatomical data illuminate a novel function for PVT GLP-1R signaling in food intake control and suggest a role for the PVT-to-NAc pathway in mediating the effects of PVT GLP-1R activation.

Unresponsive Choline Transporter as a Trait Neuromarker and a Causal Mediator of Bottom-Up Attentional Biases

Some rats [sign-trackers (STs)] are prone to attribute incentive salience to reward cues, which can manifest as a propensity to approach and contact pavlovian cues, and for addiction-like behavior. STs also exhibit poor attentional performance, relative to goal-trackers (GTs), which is associated with attenuated acetylcholine (ACh) levels in prefrontal cortex (Paolone et al., 2013). Here, we demonstrate a cellular mechanism, linked to ACh synthesis, that accounts for attenuated cholinergic capacity in STs. First, we found that electrical stimulation of the basal forebrain increased cortical choline transporter (CHT)-mediated choline transport in GTs, paralleled by a redistribution of CHTs to the synaptic plasma membrane. Neither increases in choline uptake nor translocation of CHTs occurred in STs. Second, and consistent with uptake/translocation alterations, STs demonstrated a reduced ability to support cortical ACh release in vivo compared with GTs after reverse-dialysis to elevate extracellular potassium levels. Third, rats were significantly more likely to develop sign-tracking behavior if treated systemically before pavlovian conditioned approach training with the CHT inhibitor VU6001221. Consistent with its proposed mechanisms, administration of VU6001221 attenuated potassium-evoked ACh levels in prefrontal cortex measured with in vivo microdialysis. We propose that loss of CHT-dependent activation of cortical cholinergic activity in STs degrades top-down executive control over behavior, producing a bias for bottom-up or stimulus-driven attention. Such an attentional bias contributes to nonadaptive reward processing and thus identifies a novel mechanism that can support psychopathology, including addiction.SIGNIFICANCE STATEMENT The vulnerability for addiction-like behavior has been associated with psychological traits, such as the propensity to attribute incentive salience to reward cues that is modeled in rats by sign-tracking behavior. Sign-trackers tend to approach and contact cues associated with reward, whereas their counterparts, the goal-trackers, have a preference for approaching the location of the reward. Here, we show that the capacity of presynaptic cholinergic synapses to respond to stimulation by elevating presynaptic choline uptake and releasing acetylcholine is attenuated in sign-trackers. Furthermore, pharmacological inhibition of choline transport induced sign-tracking behavior. Our findings suggest that reduced levels of cholinergic neuromodulation can mediate an attentional bias toward reward-related cues, thereby allowing such cues to exert relatively greater control over behavior.

Thalamic cholinergic innervation makes a specific bottom-up contribution to signal detection: Evidence from Parkinson's disease patients with defined cholinergic losses

Successful behavior depends on the ability to detect and respond to relevant cues, especially under challenging conditions. This essential component of attention has been hypothesized to be mediated by multiple neuromodulator systems, but the contributions of individual systems (e.g., cholinergic, dopaminergic) have remained unclear. The present study addresses this issue by leveraging individual variation in regionally-specific cholinergic denervation in Parkinson's disease (PD) patients, while controlling for variation in dopaminergic denervation. Patients whose dopaminergic and cholinergic nerve terminal integrity had been previously assessed using Positron Emission Tomography (Bohnen et al., 2012) and controls were tested in a signal detection task that manipulates attentional-perceptual challenge and has been used extensively in both rodents and humans to investigate the cholinergic system's role in responding to such challenges (Demeter et al., 2008; McGaughy and Sarter, 1995; see Hasselmo and Sarter 2011 for review). In simple correlation analyses, measures of midbrain dopaminergic, and both cortical and thalamic cholinergic innervation all predicted preserved signal detection under challenge. However, regression analyses also controlling for age, disease severity, and other variables showed that the only significant independent neurotransmitter-related predictor over and above the other variables in the model was thalamic cholinergic integrity. Furthermore, thalamic cholinergic innervation exclusively predicted hits, not correct rejections, indicating a specific contribution to bottom-up salience processing. These results help define regionally-specific contributions of cholinergic function to different aspects of attention and behavior.

Neurobiological Basis of Individual Variation in Stimulus-Reward Learning

Cues in the environment can guide behavior in adaptive ways, leading one towards valuable resources such as food, water, or a potential mate. However, cues in the environment may also serve as powerful motivators that lead to maladaptive patterns of behavior, such as addiction. Importantly, and central to this article, there is considerable individual variation in the extent to which reward cues gain motivational control over behavior. Here we describe an animal model that captures this individual variation, allowing us to better understand the psychological and neurobiological processes that contribute to cue-evoked behaviors. When a discrete cue is paired with a food reward in a Pavlovian manner it acquires greater control over motivated behavior in some rats ("sign-trackers, STs) than in others ("goal-trackers", GTs). We review studies that have exploited this animal model to parse the neurobiological mechanisms involved in learning associations between stimuli vs. those involved in attributing incentive salience to those same stimuli. The latter seems to be dependent on dopamine and subcortical circuits, whereas the former may engage more cortical "top-down" mechanisms.