Motivational salience signal in the basal forebrain is coupled with faster and more precise decision speed

Calretinin-Expressing Neurons in the Basal Forebrain Specifically Contact Granule Cells in the Olfactory Bulb and Modulate Odor Learning

GABAergic neurons in basal forebrain (BF) nuclei project densely to all layers of the mouse main olfactory bulb (OB), the first relay in odor information processing. However, BF projection neurons are diverse, and the contribution of each subtype to odor information processing is not known. In the present study, we used retrograde and anterograde tracing methods together with whole-brain light-sheet analyses, patch-clamp recordings coupled with optogenetic and chemogenetic approaches during spontaneous odor discrimination, and go/no-go odor discrimination/learning tests to characterize the synaptic targets in the OB of BF calretinin-expressing (CR+) GABAergic cells and to reveal their functional implications. We used mice of either sex to show that OB-projecting CR+ neurons innervate the bulbar granule cell (GC) layer but not the glomerular layer. Optogenetic stimulation of CR+ axonal projections in OB slices elicited monosynaptic GABAergic currents in GCs. Retrograde rabies virus-based transsynaptic tracing experiments confirmed these synaptic connections and further suggested that CR+ neurons provide the principal, if not the unique, BF input onto GCs. Chemogenetic inhibition of CR+ neurons in the BF of male mice did not affect odor discrimination in habituation/dishabituation tasks but led to impairment in odor learning during go/no-go odor-associative tasks. Our results revealed a subtype-specific projection pattern in the OB of a select population of BF neurons and suggested that distinct BF GABAergic projections have distinct effects on odor information processing and learning.

Modulating the cholinergic system-Novel targets for deep brain stimulation in Parkinson's disease

Parkinson's disease (PD) is the second-fastest growing neurodegenerative disease in the world. The major clinical symptoms rigor, tremor, and bradykinesia derive from the degeneration of the nigrostriatal pathway. However, PD is a multi-system disease, and neurodegeneration extends beyond the degradation of the dopaminergic pathway. Symptoms such as postural instability, freezing of gait, falls, and cognitive decline are predominantly caused by alterations of transmitter systems outside the classical dopaminergic axis. While levodopa and deep brain stimulation (DBS) of the subthalamic nucleus or globus pallidus internus effectively address PD primary motor symptoms, they often fall short in mitigating axial symptoms and cognitive impairment. Along these lines, the cholinergic system is increasingly recognized to play a crucial role in governing locomotion, postural stability, and cognitive function. Thus, there is a growing interest in bolstering the cholinergic tone by DBS of cholinergic targets such as the pedunculopontine nucleus (PPN) and nucleus basalis of Meynert (NBM), aiming to alleviate these debilitating symptoms resistant to traditional treatment strategies targeting the dopaminergic network. This review offers a comprehensive overview of the role of cholinergic dysfunction in PD. We discuss the impact of PPN and NBM DBS on the management of symptoms not readily accessible to established DBS targets and pharmacotherapy in PD and seek to provide guidance on patient selection, surgical approach, and stimulation paradigms.

Neural Representation of Valenced and Generic Probability and Uncertainty

Representing the probability and uncertainty of outcomes facilitates adaptive behavior by allowing organisms to prepare in advance and devote attention to relevant events. Probability and uncertainty are often studied only for valenced (appetitive or aversive) outcomes, raising the question of whether the identified neural machinery also processes the probability and uncertainty of motivationally neutral outcomes. Here, we aimed to dissociate valenced from valence-independent (i.e., generic) probability (p; maximum at p = 1) and uncertainty (maximum at p = 0.5) signals using human neuroimaging. In a Pavlovian task (n = 41; 19 females), different cues predicted appetitive, aversive, or neutral liquids with different probabilities (p = 0, p = 0.5, p = 1). Cue-elicited motor responses accelerated, and pupil sizes increased primarily for cues that predicted valenced liquids with higher probability. For neutral liquids, uncertainty rather than probability tended to accelerate cue-induced responding and decrease pupil size. At the neural level, generic uncertainty signals were limited to the occipital cortex, while generic probability also activated the anterior ventromedial prefrontal cortex. These generic probability and uncertainty signals contrasted with cue-induced responses that only encoded the probability and uncertainty of valenced liquids in medial prefrontal, insular, and occipital cortices. Our findings show a behavioral and neural dissociation of generic and valenced signals. Thus, some parts of the brain keep track of motivational charge while others do not, highlighting the need and usefulness of characterizing the exact nature of learned representations.

Parvalbumin-expressing basal forebrain neurons mediate learning from negative experience

Parvalbumin (PV)-expressing GABAergic neurons of the basal forebrain (BFPVNs) were proposed to serve as a rapid and transient arousal system, yet their exact role in awake behaviors remains unclear. We performed bulk calcium measurements and electrophysiology with optogenetic tagging from the horizontal limb of the diagonal band of Broca (HDB) while male mice were performing an associative learning task. BFPVNs responded with a distinctive, phasic activation to punishment, but showed slower and delayed responses to reward and outcome-predicting stimuli. Optogenetic inhibition during punishment impaired the formation of cue-outcome associations, suggesting a causal role of BFPVNs in associative learning. BFPVNs received strong inputs from the hypothalamus, the septal complex and the median raphe region, while they synapsed on diverse cell types in key limbic structures, where they broadcasted information about aversive stimuli. We propose that the arousing effect of BFPVNs is recruited by aversive stimuli to serve crucial associative learning functions.

Electrophysiological population dynamics reveal context dependencies during decision making in human frontal cortex

Evidence from monkeys and humans suggests that the orbitofrontal cortex (OFC) encodes the subjective value of options under consideration during choice. Data from non-human primates suggests that these value signals are context-dependent, representing subjective value in a way influenced by the decision makers' recent experience. Using electrodes distributed throughout cortical and subcortical structures, human epilepsy patients performed an auction task where they repeatedly reported the subjective values they placed on snack food items. High-gamma activity in many cortical and subcortical sites including the OFC positively correlated with subjective value. Other OFC sites showed signals contextually modulated by the subjective value of previously offered goods-a context dependency predicted by theory but not previously observed in humans. These results suggest that value and value-context signals are simultaneously present but separately represented in human frontal cortical activity.

Cholinergic Reinforcement Signaling Is Impaired by Amyloidosis Prior to Its Synaptic Loss

Alzheimer's disease (AD) is associated with amyloidosis and dysfunction of the cholinergic system, which is crucial for learning and memory. However, the nature of acetylcholine signaling within regions of cholinergic-dependent plasticity and how it changes with experience is poorly understood, much less the impact of amyloidosis on this signaling. Therefore, we optically measure the release profile of acetylcholine to unexpected, predicted, and predictive events in visual cortex (VC)-a site of known cholinergic-dependent plasticity-in a preclinical mouse model of AD that develops amyloidosis. We find that acetylcholine exhibits reinforcement signaling qualities, reporting behaviorally relevant outcomes and displaying release profiles to predictive and predicted events that change as a consequence of experience. We identify three stages of amyloidosis occurring before the degeneration of cholinergic synapses within VC and observe that cholinergic responses in amyloid-bearing mice become impaired over these stages, diverging progressively from age- and sex-matched littermate controls. In particular, amyloidosis degrades the signaling of unexpected rewards and punishments, and attenuates the experience-dependent (1) increase of cholinergic responses to outcome predictive visual cues, and (2) decrease of cholinergic responses to predicted outcomes. Hyperactive spontaneous acetylcholine release occurring transiently at the onset of impaired cholinergic signaling is also observed, further implicating disrupted cholinergic activity as an early functional biomarker in AD. Our findings suggest that acetylcholine acts as a reinforcement signal that is impaired by amyloidosis before pathologic degeneration of the cholinergic system, providing a deeper understanding of the effects of amyloidosis on acetylcholine signaling and informing future interventions for AD.SIGNIFICANCE STATEMENT The cholinergic system is especially vulnerable to the neurotoxic effects of amyloidosis, a hallmark of Alzheimer's disease (AD). Though amyloid-induced cholinergic synaptic loss is thought in part to account for learning and memory impairments in AD, little is known regarding how amyloid impacts signaling of the cholinergic system before its anatomic degeneration. Optical measurement of acetylcholine (ACh) release in a mouse model of AD that develops amyloidosis reveals that ACh signals reinforcement and outcome prediction that is disrupted by amyloidosis before cholinergic degeneration. These observations have important scientific and clinical implications: they implicate ACh signaling as an early functional biomarker, provide a deeper understanding of the action of acetylcholine, and inform on when and how intervention may best ameliorate cognitive decline in AD.

The behavioral signature of stepwise learning strategy in male rats and its neural correlate in the basal forebrain

Studies of associative learning have commonly focused on how rewarding outcomes are predicted by either sensory stimuli or animals' actions. However, in many learning scenarios, reward delivery requires the occurrence of both sensory stimuli and animals' actions in a specific order, in the form of behavioral sequences. How such behavioral sequences are learned is much less understood. Here we provide behavioral and neurophysiological evidence to show that behavioral sequences are learned using a stepwise strategy. In male rats learning a new association, learning started from the behavioral event closest to the reward and sequentially incorporated earlier events. This led to the sequential refinement of reward-seeking behaviors, which was characterized by the stepwise elimination of ineffective and non-rewarded behavioral sequences. At the neuronal level, this stepwise learning process was mirrored by the sequential emergence of basal forebrain neuronal responses toward each event, which quantitatively conveyed a reward prediction error signal and promoted reward-seeking behaviors. Together, these behavioral and neural signatures revealed how behavioral sequences were learned in discrete steps and when each learning step took place.

Basal Forebrain Chemogenetic Inhibition Converts the Attentional Control Mode of Goal-Trackers to That of Sign-Trackers

Sign tracking versus goal tracking in rats indicate vulnerability and resistance, respectively, to Pavlovian cue-evoked addictive drug taking and relapse. Here, we tested hypotheses predicting that the opponent cognitive-behavioral styles indexed by sign tracking versus goal tracking include variations in attentional performance which differentially depend on basal forebrain projection systems. Pavlovian Conditioned Approach (PCA) testing was used to identify male and female sign-trackers (STs) and goal-trackers (GTs), as well as rats with an intermediate phenotype (INTs). Upon reaching asymptotic performance in an operant task requiring the detection of visual signals (hits) as well as the reporting of signal absence for 40 min per session, GTs scored more hits than STs, and hit rates across all phenotypes correlated with PCA scores. STs missed relatively more signals than GTs specifically during the last 15 min of a session. Chemogenetic inhibition of the basal forebrain decreased hit rates in GTs but was without effect in STs. Moreover, the decrease in hits in GTs manifested solely during the last 15 min of a session. Transfection efficacy in the horizontal limb of the diagonal band (HDB), but not substantia innominate (SI) or nucleus basalis of Meynert (nbM), predicted the behavioral efficacy of chemogenetic inhibition in GTs. Furthermore, the total subregional transfection space, not transfection of just cholinergic neurons, correlated with performance effects. These results indicate that the cognitive-behavioral phenotype indexed by goal tracking, but not sign tracking, depends on activation of the basal forebrain-frontal cortical projection system and associated biases toward top-down or model-based performance.

Cholinergic activity reflects reward expectations and predicts behavioral responses

Basal forebrain cholinergic neurons (BFCNs) play an important role in associative learning, suggesting that BFCNs may participate in processing stimuli that predict future outcomes. However, the impact of outcome probabilities on BFCN activity remained elusive. Therefore, we performed bulk calcium imaging and recorded spiking of identified cholinergic neurons from the basal forebrain of mice performing a probabilistic Pavlovian cued outcome task. BFCNs responded more to sensory cues that were often paired with reward. Reward delivery also activated BFCNs, with surprising rewards eliciting a stronger response, whereas punishments evoked uniform positive-going responses. We propose that BFCNs differentially weigh predictions of positive and negative reinforcement, reflecting divergent relative salience of forecasting appetitive and aversive outcomes, partially explained by a simple reinforcement learning model of a valence-weighed unsigned prediction error. Finally, the extent of cue-driven cholinergic activation predicted subsequent decision speed, suggesting that the expectation-gated cholinergic firing is instructive to reward-seeking behaviors.

Neural circuits provide insights into reward and aversion

Maladaptive changes in the neural circuits associated with reward and aversion result in some common symptoms, such as drug addiction, anxiety, and depression. Historically, the study of these circuits has been hampered by technical limitations. In recent years, however, much progress has been made in understanding the neural mechanisms of reward and aversion owing to the development of technologies such as cell type-specific electrophysiology, neuronal tracing, and behavioral manipulation based on optogenetics. The aim of this paper is to summarize the latest findings on the mechanisms of the neural circuits associated with reward and aversion in a review of previous studies with a focus on the ventral tegmental area (VTA), nucleus accumbens (NAc), and basal forebrain (BF). These findings may inform efforts to prevent and treat mental illnesses associated with dysfunctions of the brain's reward and aversion system.

Basal Forebrain Impairment: Understanding the Mnemonic Function of the Septal Region Translates in Therapeutic Advances

The basal forebrain is one of the three major brain circuits involved in episodic memory formation together with the hippocampus and the diencephalon. The dysfunction of each of these regions is known to cause anterograde amnesia. While the hippocampal pyramidal neurons are known to encode episodic information and the diencephalic structures are known to provide idiothetic information, the contribution of the basal forebrain to memory formation has been exclusively associated with septo-hippocampal cholinergic signaling. Research data from the last decade broadened our understanding about the role of septal region in memory formation. Animal studies revealed that septal neurons process locomotor, rewarding and attentional stimuli. The integration of these signals results in a systems model for the mnemonic function of the medial septum that could guide new therapeutic strategies for basal forebrain impairment (BFI). BFI includes the disorders characterized with basal forebrain amnesia and neurodegenerative disorders that affect the basal forebrain. Here, we demonstrate how the updated model of septal mnemonic function can lead to innovative translational treatment approaches that include pharmacological, instrumental and behavioral techniques.

Ventral pallidum regulates the default mode network, controlling transitions between internally and externally guided behavior

Daily life requires transitions between performance of well-practiced, automatized behaviors reliant upon internalized representations and behaviors requiring external focus. Such transitions involve differential activation of the default mode network (DMN), a group of brain areas associated with inward focus. We asked how optogenetic modulation of the ventral pallidum (VP), a subcortical DMN node, impacts task switching between internally to externally guided lever-pressing behavior in the rat. Excitation of the VP dramatically compromised acquisition of an auditory discrimination task, trapping animals in a DMN state of automatized internally focused behavior and impairing their ability to direct attention to external sensory stimuli. VP inhibition, on the other hand, facilitated task acquisition, expediting escape from the DMN brain state, thereby allowing rats to incorporate the contingency changes associated with the auditory stimuli. We suggest that VP, instant by instant, regulates the DMN and plays a deterministic role in transitions between internally and externally guided behaviors.

Electrical stimulation of the nucleus basalis of meynert: a systematic review of preclinical and clinical data

Deep brain stimulation (DBS) of the nucleus basalis of Meynert (NBM) has been clinically investigated in Alzheimer’s disease (AD) and Lewy body dementia (LBD). However, the clinical effects are highly variable, which questions the suggested basic principles underlying these clinical trials. Therefore, preclinical and clinical data on the design of NBM stimulation experiments and its effects on behavioral and neurophysiological aspects are systematically reviewed here. Animal studies have shown that electrical stimulation of the NBM enhanced cognition, increased the release of acetylcholine, enhanced cerebral blood flow, released several neuroprotective factors, and facilitates plasticity of cortical and subcortical receptive fields. However, the translation of these outcomes to current clinical practice is hampered by the fact that mainly animals with an intact NBM were used, whereas most animals were stimulated unilaterally, with different stimulation paradigms for only restricted timeframes. Future animal research has to refine the NBM stimulation methods, using partially lesioned NBM nuclei, to better resemble the clinical situation in AD, and LBD. More preclinical data on the effect of stimulation of lesioned NBM should be present, before DBS of the NBM in human is explored further.

Auditory and Visual Executive Functions in Children and Response to Methylphenidate: A Randomized Controlled Trial

Objectives: The aim of the study was to assess auditory and visually based executive functions (EFs) and the effect of methylphenidate (MPH) in children with ADHD. Methods: Thirty-six boys between the ages of 8.3 and 9.7 years with ADHD and 36 matched controls were included. The study group was randomized into MPH and placebo for 7 days each in a crossover design. A Cued Choice Reaction Time (CCRT) test that included incongruent cuing was administered at baseline and following 1 and 2 weeks. Results: The difference between the study and control groups was more evident with visual cues and incongruent cuing. Increased gains by children with predominantly hyperactive-impulsive\combined (HI\C) type of ADHD were observed under MPH. Conclusions: The differences between children with ADHD and typical children are more pronounce under incongruent auditory cuing . The gains attributable to MPH are more specific to tasks involving auditory and visual EFs and in children with HI\C type ADHDs.

A Basal Forebrain-Cingulate Circuit in Macaques Decides It Is Time to Act

The medial frontal cortex has been linked to voluntary action, but an explanation of why decisions to act emerge at particular points in time has been lacking. We show that, in macaques, decisions about whether and when to act are predicted by a set of features defining the animal’s current and past context; for example, respectively, cues indicating the current average rate of reward and recent previous voluntary action decisions. We show that activity in two brain areas—the anterior cingulate cortex and basal forebrain—tracks these contextual factors and mediates their effects on behavior in distinct ways. We use focused transcranial ultrasound to selectively and effectively stimulate deep in the brain, even as deep as the basal forebrain, and demonstrate that alteration of activity in the two areas changes decisions about when to act.

•

Likelihood and timing of voluntary action in macaques can be partially predicted

•

Recent experience and present context influence when voluntary action occurs

•

A basal forebrain-cingulate circuit mediated effects of these factors on behavior

•

Stimulation of this circuit by ultrasound changed decisions about when to act

Neural circuits linking sleep and addiction: Animal models to understand why select individuals are more vulnerable to substance use disorders after sleep deprivation

Individuals differ widely in their drug-craving behaviors. One reason for these differences involves sleep. Sleep disturbances lead to an increased risk of substance use disorders and relapse in only some individuals. While animal studies have examined the impact of sleep on reward circuitry, few have addressed the role of individual differences in the effects of altered sleep. There does, however, exist a rodent model of individual differences in reward-seeking behavior: the sign/goal-tracker model of Pavlovian conditioned approach. In this model, only some rats show the key behavioral traits associated with addiction, including impulsivity and poor attentional control, making this an ideal model system to examine individually distinct sleep-reward interactions. Here, we describe how the limbic neural circuits responsible for individual differences in incentive motivation overlap with those involved in sleep-wake regulation, and how this model can elucidate the common underlying mechanisms. Consideration of individual differences in preclinical models would improve our understanding of how sleep interacts with motivational systems, and why sleep deprivation contributes to addiction in only select individuals.

Basal forebrain chemogenetic inhibition disrupts the superior complex movement control of goal-tracking rats

Sign- and goal-tracking behavior signifies the influence of opposed cognitive-motivational styles, with the former being characterized by a tendency for approaching and contacting reward cues, including a readiness for attending, bottom-up, to salient cues, and a relatively greater vulnerability for developing and maintaining addiction-like behaviors. We previously demonstrated that these styles also impact the cognitive-motor interactions that are taxed during traversal of dynamic surfaces, with goal-trackers (GTs) making less movement errors and falling less frequently than sign-trackers (STs). The present experiment tested the hypothesis that complex movement control in GTs, but not STs, depends on activation of the basal forebrain projection system to telencephalic regions. Chemogenetic inhibition of the basal forebrain increased movement errors and falls in GTs during traversal of a rotating zigzag rod but had no significant effect on the relatively lower performance of STs. Neurochemical evidence confirmed the efficacy of the inhibitory designer receptor exclusively activated by designer drug (DREADD). Administration of clozapine-N-oxide (CNO) had no significant effect in GTs not expressing the DREADD. These results indicate that GTs, but not STs, activate the basal forebrain projection system to mediate their relatively superior ability for complex movement control. STs may also serve as an animal model in research on the role of basal forebrain systems in aging- and Parkinson's disease-associated falls. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Basal Forebrain Mediates Motivational Recruitment of Attention by Reward-Associated Cues

The basal forebrain, composed of distributed nuclei, including substantia innominata (SI), nucleus basalis and nucleus of the diagonal band of Broca plays a crucial neuromodulatory role in the brain. In particular, its projections to the prefrontal cortex have been shown to be important in a wide variety of brain processes and functions, including attention, learning and memory, arousal, and decision-making. In the present study, we asked whether the basal forebrain is involved in recruitment of cognitive effort in response to reward-related cues. This interaction between motivation and cognition is critically impacted in psychiatric conditions such as schizophrenia. Using the Designer Receptor Exclusively Activated by Designer Drug (DREADD) technique combined with our recently developed signaled probability sustained attention task (SPSA), which explicitly assays the interaction between motivation and attention, we sought to determine the role of the basal forebrain in this interaction. Rats were stereotaxically injected in the basal forebrain with either hM4D(Gi) (a virus that expresses receptors which silence neurons in the presence of the drug clozapine-N-oxide; CNO) or a control virus and tested in the SPSA. Behavior of rats during baseline and under saline indicated control by reward probability. In the presence of CNO, differential accuracy of hM4D(Gi) rats on high and low reward-probability trials was abolished. This result occurred despite spared ability of the reward-probability signals to differentially impact choice-response latencies and omissions. These results indicate that the basal forebrain is critical for the motivational recruitment of attention in response to reward-related cues and are consistent with a role for basal forebrain in encoding and transmitting motivational salience of reward-related cues and readying prefrontal circuits for further attentional processing.

Ventral pallidum encodes relative reward value earlier and more robustly than nucleus accumbens

The ventral striatopallidal system, a basal ganglia network thought to convert limbic information into behavioral action, includes the nucleus accumbens (NAc) and the ventral pallidum (VP), typically described as a major output of NAc. Here, to investigate how reward-related information is transformed across this circuit, we measure the activity of neurons in NAc and VP when rats receive two highly palatable but differentially preferred rewards, allowing us to track the reward-specific information contained within the neural activity of each region. In VP, we find a prominent preference-related signal that flexibly reports the relative value of reward outcomes across multiple conditions. This reward-specific firing in VP is present in a greater proportion of the population and arises sooner following reward delivery than in NAc. Our findings establish VP as a preeminent value signaler and challenge the existing model of information flow in the ventral basal ganglia.

A Central Amygdala-Substantia Innominata Neural Circuitry Encodes Aversive Reinforcement Signals

Aversive stimuli can impact motivation and support associative learning as reinforcers. However, the neural circuitry underlying the processing of aversive reinforcers has not been elucidated. Here, we report that a subpopulation of central amygdala (CeA) GABAergic neurons expressing protein kinase C-delta (PKC-δ+) displays robust responses to aversive stimuli during negative reinforcement learning. Importantly, projections from PKC-δ+ neurons of the CeA to the substantia innominata (SI) could bi-directionally modulate negative reinforcement learning. Moreover, consistent with the idea that SI-projecting PKC-δ+ neurons of the CeA encode aversive information, optogenetic activation of this pathway produces conditioned place aversion, a behavior prevented by simultaneous ablating of SI glutamatergic neurons. Taken together, our data define a cell-type-specific neural circuitry modulating associative learning by encoding aversive reinforcement signals.

Dynamic Encoding of Incentive Salience in the Ventral Pallidum: Dependence on the Form of the Reward Cue

Some rats are especially prone to attribute incentive salience to a cue (conditioned stimulus, CS) paired with food reward (sign-trackers, STs), but the extent they do so varies as a function of the form of the CS. Other rats respond primarily to the predictive value of a cue (goal-trackers, GTs), regardless of its form. Sign-tracking is associated with greater cue-induced activation of mesolimbic structures than goal-tracking; however, it is unclear how the form of the CS itself influences activity in neural systems involved in incentive salience attribution. Thus, our goal was to determine how different cue modalities affect neural activity in the ventral pallidum (VP), which is known to encode incentive salience attribution, as rats performed a two-CS Pavlovian conditioned approach task in which both a lever-CS and a tone-CS predicted identical food reward. The lever-CS elicited sign-tracking in some rats (STs) and goal-tracking in others (GTs), whereas the tone-CS elicited only goal-tracking in all rats. The lever-CS elicited robust changes in neural activity (sustained tonic increases or decreases in firing) throughout the VP in STs, relative to GTs. These changes were not seen when STs were exposed to the tone-CS, and in GTs there were no differences in firing between the lever-CS and tone-CS. We conclude that neural activity throughout the VP encodes incentive signals and is especially responsive when a cue is of a form that promotes the attribution of incentive salience to it, especially in predisposed individuals.

Qualitative Analysis of Emotions: Fear and Thrill

People can speak, and this provides opportunities to analyze human emotions using perceived experiences communicated via language, as well as through measurement and imaging techniques that are also applicable to other higher animal species. Here I compare four qualitative methodological approaches to test if, and how, thrill depends on fear. I use eight high-risk, high-skill, real-life outdoor adventure recreation activities to provide the test circumstances. I present data from: >4000 person-days of participant observation; interviews with 40 expert practitioners; retrospective autoethnography of 50 critical incidents over 4 decades; and experimental autoethnography of 60 events. Results from different methods are congruent, but different approaches yield different insights. The principal findings are as follows. Individuals differ in their fear and thrill responses. The same individual may have different responses on different occasions. Fear boosts performance, but panic causes paralysis. Anxiety or apprehension prior to a risky action or event differs from fear experienced during the event itself. The intensity of pre-event fear generally increases with the immediacy of risk to life, and time to contemplate that risk. Fear must be faced, assessed and overcome in order to act. Thrill can occur either during or after a high-risk event. Thrill can occur without fear, and fear without thrill. Below a lower threshold of perceived risk, thrill can occur without fear. Between a lower and upper threshold, thrill increases with fear. Beyond the upper threshold, thrill vanishes but fear remains. This there is a sawtooth relation between fear and thrill. Perceived danger generates intense focus and awareness. Fear and other emotions can disappear during intense concentration and focus. Under high risk, the usual emotional sequence is fear before the action or event, then focus during the action or event, then thrill, relief, or triumph afterward. The emotionless state persists only during the most intense concentration. For events long enough to differentiate time within the events, fear and thrill can arise and fade in different fine-scale sequences.

Neural Activity in the Ventral Pallidum Encodes Variation in the Incentive Value of a Reward Cue

There is considerable individual variation in the extent to which reward cues are attributed with incentive salience. For example, a food-predictive conditioned stimulus (CS; an illuminated lever) becomes attractive, eliciting approach toward it only in some rats ("sign trackers," STs), whereas others ("goal trackers," GTs) approach the food cup during the CS period. The purpose of this study was to determine how individual differences in Pavlovian approach responses are represented in neural firing patterns in the major output structure of the mesolimbic system, the ventral pallidum (VP). Single-unit in vivo electrophysiology was used to record neural activity in the caudal VP during the performance of ST and GT conditioned responses. All rats showed neural responses to both cue onset and reward delivery but, during the CS period, STs showed greater neural activity than GTs both in terms of the percentage of responsive neurons and the magnitude of the change in neural activity. Furthermore, neural activity was positively correlated with the degree of attraction to the cue. Given that the CS had equal predictive value in STs and GTs, we conclude that neural activity in the VP largely reflects the degree to which the CS was attributed with incentive salience.

SIGNIFICANCE STATEMENT

Cues associated with reward can acquire motivational properties (i.e., incentive salience) that cause them to have a powerful influence on desire and motivated behavior. There are individual differences in sensitivity to reward-paired cues, with some individuals attaching greater motivational value to cues than others. Here, we investigated the neural activity associated with these individual differences in incentive salience. We found that cue-evoked neural firing in the ventral pallidum (VP) reflected the strength of incentive motivation, with the greatest neural responses occurring in individuals that demonstrated the strongest attraction to the cue. This suggests that the VP plays an important role in the process by which cues gain control over motivation and behavior.

Involvement of Dopamine D1/D5 and D2 Receptors in Context-Dependent Extinction Learning and Memory Reinstatement

Dopamine contributes to the regulation of higher order information processing and executive control. It is important for memory consolidation processes, and for the adaptation of learned responses based on experience. In line with this, under aversive learning conditions, application of dopamine receptor antagonists prior to extinction result in enhanced memory reinstatement. Here, we investigated the contribution of the dopaminergic system to extinction and memory reinstatement (renewal) of an appetitive spatial learning task in rodents. Rats were trained for 3 days in a T-maze (context "A") to associate a goal arm with a food reward, despite low reward probability (acquisition phase). On day 4, extinction learning (unrewarded) occurred, that was reinforced by a context change ("B"). On day 5, re-exposure to the (unrewarded) "A" context took place (renewal of context "A", followed by extinction of context "A"). In control animals, significant extinction occurred on day 4, that was followed by an initial memory reinstatement (renewal) on day 5, that was, in turn, succeeded by extinction of renewal. Intracerebral treatment with a D1/D5-receptor antagonist prior to the extinction trials, elicited a potent enhancement of extinction in context "B". By contrast, a D1/D5-agonist impaired renewal in context "A". Extinction in the "A" context on day 5 was unaffected by the D1/D5-ligands. Treatment with a D2-receptor antagonist prior to extinction had no overall effect on extinction in context "B" or renewal in context "A", although extinction of the renewal effect was impaired on day 5, compared to controls. Taken together, these data suggest that dopamine acting on the D1/D5-receptor modulates both acquisition and consolidation of context-dependent extinction. By contrast, the D2-receptor may contribute to context-independent aspects of this kind of extinction learning.

Optogenetic Dissection of the Basal Forebrain Neuromodulatory Control of Cortical Activation, Plasticity, and Cognition

The basal forebrain (BF) houses major ascending projections to the entire neocortex that have long been implicated in arousal, learning, and attention. The disruption of the BF has been linked with major neurological disorders, such as coma and Alzheimer's disease, as well as in normal cognitive aging. Although it is best known for its cholinergic neurons, the BF is in fact an anatomically and neurochemically complex structure. Recent studies using transgenic mouse lines to target specific BF cell types have led to a renaissance in the study of the BF and are beginning to yield new insights about cell-type-specific circuit mechanisms during behavior. These approaches enable us to determine the behavioral conditions under which cholinergic and noncholinergic BF neurons are activated and how they control cortical processing to influence behavior. Here we discuss recent advances that have expanded our knowledge about this poorly understood brain region and laid the foundation for future cell-type-specific manipulations to modulate arousal, attention, and cortical plasticity in neurological disorders.

SIGNIFICANCE STATEMENT

Although the basal forebrain is best known for, and often equated with, acetylcholine-containing neurons that provide most of the cholinergic innervation of the neocortex, it is in fact an anatomically and neurochemically complex structure. Recent studies using transgenic mouse lines to target specific cell types in the basal forebrain have led to a renaissance in this field and are beginning to dissect circuit mechanisms in the basal forebrain during behavior. This review discusses recent advances in the roles of basal forebrain cholinergic and noncholinergic neurons in cognition via their dynamic modulation of cortical activity.

Central Cholinergic Neurons Are Rapidly Recruited by Reinforcement Feedback

Basal forebrain cholinergic neurons constitute a major neuromodulatory system implicated in normal cognition and neurodegenerative dementias. Cholinergic projections densely innervate neocortex, releasing acetylcholine to regulate arousal, attention, and learning. However, their precise behavioral function is poorly understood because identified cholinergic neurons have never been recorded during behavior. To determine which aspects of cognition their activity might support, we recorded cholinergic neurons using optogenetic identification in mice performing an auditory detection task requiring sustained attention. We found that a non-cholinergic basal forebrain population-but not cholinergic neurons-were correlated with trial-to-trial measures of attention. Surprisingly, cholinergic neurons responded to reward and punishment with unusual speed and precision (18 ± 3 ms). Cholinergic responses were scaled by the unexpectedness of reinforcement and were highly similar across neurons and two nuclei innervating distinct cortical areas. These results reveal that the cholinergic system broadcasts a rapid and precisely timed reinforcement signal, supporting fast cortical activation and plasticity.

Withholding a Reward-driven Action: Studies of the Rise and Fall of Motor Activation and the Effect of Cognitive Depletion

Controlling an inappropriate response tendency in the face of a reward-predicting stimulus likely depends on the strength of the reward-driven activation, the strength of a putative top-down control process, and their relative timing. We developed a rewarded go/no-go paradigm to investigate such dynamics. Participants made rapid responses (on go trials) to high versus low reward-predicting stimuli and sometimes had to withhold responding (on no-go trials) in the face of the same stimuli. Behaviorally, for high versus low reward stimuli, responses were faster on go trials, and there were more errors of commission on no-go trials. We used single-pulse TMS to map out the corticospinal excitability dynamics, especially on no-go trials where control is needed. For successful no-go trials, there was an early rise in motor activation that was then sharply reduced beneath baseline. This activation-reduction pattern was more pronounced for high- versus low-reward trials and in individuals with greater motivational drive for reward. A follow-on experiment showed that, when participants were fatigued by an effortful task, they made more errors on no-go trials for high versus low reward stimuli. Together, these studies show that, when a response is inappropriate, reward-predicting stimuli induce early motor activation, followed by a top-down effortful control process (which we interpret as response suppression) that depends on the strength of the preceding activation. Our findings provide novel information about the activation-suppression dynamics during control over reward-driven actions, and they illustrate how fatigue or depletion leads to control failures in the face of reward.

Basal forebrain motivational salience signal enhances cortical processing and decision speed

The basal forebrain (BF) contains major projections to the cerebral cortex, and plays a well-documented role in arousal, attention, decision-making, and in modulating cortical activity. BF neuronal degeneration is an early event in Alzheimer’s disease (AD) and dementias, and occurs in normal cognitive aging. While the BF is best known for its population of cortically projecting cholinergic neurons, the region is anatomically and neurochemically diverse, and also contains prominent populations of non-cholinergic projection neurons. In recent years, increasing attention has been dedicated to these non-cholinergic BF neurons in order to better understand how non-cholinergic BF circuits control cortical processing and behavioral performance. In this review, we focus on a unique population of putative non-cholinergic BF neurons that encodes the motivational salience of stimuli with a robust ensemble bursting response. We review recent studies that describe the specific physiological and functional characteristics of these BF salience-encoding neurons in behaving animals. These studies support the unifying hypothesis whereby BF salience-encoding neurons act as a gain modulation mechanism of the decision-making process to enhance cortical processing of behaviorally relevant stimuli, and thereby facilitate faster and more precise behavioral responses. This function of BF salience-encoding neurons represents a critical component in determining which incoming stimuli warrant an animal’s attention, and is therefore a fundamental and early requirement of behavioral flexibility.

Basal forebrain neuronal inhibition enables rapid behavioral stopping

Cognitive inhibitory control, the ability to rapidly suppress responses inappropriate for the context, is essential for flexible and adaptive behavior. Although most studies on inhibitory control have focused on the fronto-basal-ganglia circuit, we found that rapid behavioral stopping is enabled by neuronal inhibition in the basal forebrain (BF). In rats performing the stop signal task, putative noncholinergic BF neurons with phasic bursting responses to the go signal were nearly completely inhibited by the stop signal. The onset of BF neuronal inhibition was tightly coupled with and temporally preceded the latency to stop, the stop signal reaction time. Artificial inhibition of BF activity in the absence of the stop signal was sufficient to reproduce rapid behavioral stopping. These results reveal a previously unknown subcortical mechanism of rapid inhibitory control by the BF, which provides bidirectional control over the speed of response generation and inhibition.

The ventral pallidum: Subregion-specific functional anatomy and roles in motivated behaviors

The ventral pallidum (VP) plays a critical role in the processing and execution of motivated behaviors. Yet this brain region is often overlooked in published discussions of the neurobiology of mental health (e.g., addiction, depression). This contributes to a gap in understanding the neurobiological mechanisms of psychiatric disorders. This review is presented to help bridge the gap by providing a resource for current knowledge of VP anatomy, projection patterns and subregional circuits, and how this organization relates to the function of VP neurons and ultimately behavior. For example, ventromedial (VPvm) and dorsolateral (VPdl) VP subregions receive projections from nucleus accumbens shell and core, respectively. Inhibitory GABAergic neurons of the VPvm project to mediodorsal thalamus, lateral hypothalamus, and ventral tegmental area, and this VP subregion helps discriminate the appropriate conditions to acquire natural rewards or drugs of abuse, consume preferred foods, and perform working memory tasks. GABAergic neurons of the VPdl project to subthalamic nucleus and substantia nigra pars reticulata, and this VP subregion is modulated by, and is necessary for, drug-seeking behavior. Additional circuits arise from nonGABAergic neuronal phenotypes that are likely to excite rather than inhibit their targets. These subregional and neuronal phenotypic circuits place the VP in a unique position to process motivationally relevant stimuli and coherent adaptive behaviors.

Beta-adrenergic receptors support attention to extinction learning that occurs in the absence, but not the presence, of a context change

The noradrenergic (NA)-system is an important regulator of cognitive function. It contributes to extinction learning (EL), and in disorders where EL is impaired NA-dysfunction has been postulated. We explored whether NA acting on beta-adrenergic-receptors (β-AR), regulates EL that depends on context, but is not fear-associated. We assessed behavior in an "AAA" or "ABA" paradigm: rats were trained for 3 days in a T-maze (context-A) to learn that a reward is consistently found in the goal arm, despite low reward probability. This was followed on day 4 by EL (unrewarded), whereby in the ABA-paradigm, EL was reinforced by a context change (B), and in the AAA-paradigm, no context change occurred. On day 5, re-exposure to the A-context (unrewarded) occurred. Typically, in control "AAA" animals EL occurred on day 4 that progressed further on day 5. In control "ABA" animals, EL also occurred on day 4, followed by renewal of the previously learned (A) behavior on day 5, that was succeeded (on day 5) by extinction of this behavior, as the animals realised that no food reward would be given. Treatment with the β-AR-antagonist, propranolol, prior to EL on day 4, impaired EL in the AAA-paradigm. In the "ABA" paradigm, antagonist treatment on day 4, had no effect on extinction that was reinforced by a context change (B). Furthermore, β-AR-antagonism prior to renewal testing (on day 5) in the ABA-paradigm, resulted in normal renewal behavior, although subsequent extinction of responses during day 5 was prevented by the antagonist. Thus, under both treatment conditions, β-AR-antagonism prevented extinction of the behavior learned in the "A" context. β-AR-blockade during an overt context change did not prevent EL, whereas β-AR were required for EL in an unchanging context. These data suggest that β-AR may support EL by reinforcing attention towards relevant changes in the previously learned experience, and that this process supports extinction learning in constant-context conditions.

Drift diffusion model of reward and punishment learning in schizophrenia: Modeling and experimental data

In this study, we tested reward- and punishment learning performance using a probabilistic classification learning task in patients with schizophrenia (n=37) and healthy controls (n=48). We also fit subjects' data using a Drift Diffusion Model (DDM) of simple decisions to investigate which components of the decision process differ between patients and controls. Modeling results show between-group differences in multiple components of the decision process. Specifically, patients had slower motor/encoding time, higher response caution (favoring accuracy over speed), and a deficit in classification learning for punishment, but not reward, trials. The results suggest that patients with schizophrenia adopt a compensatory strategy of favoring accuracy over speed to improve performance, yet still show signs of a deficit in learning based on negative feedback. Our data highlights the importance of applying fitting models (particularly drift diffusion models) to behavioral data. The implications of these findings are discussed relative to theories of schizophrenia and cognitive processing.

Thalamic and extrathalamic mechanisms of consciousness after severe brain injury

OBJECTIVE

What mechanisms underlie the loss and recovery of consciousness after severe brain injury? We sought to establish, in the largest cohort of patients with disorders of consciousness (DOC) to date, the link between gold standard clinical measures of awareness and wakefulness, and specific patterns of local brain pathology-thereby possibly providing a mechanistic framework for patient diagnosis, prognosis, and treatment development.

METHODS

Structural T1-weighted magnetic resonance images were collected, in a continuous sample of 143 severely brain-injured patients with DOC (and 96 volunteers), across 2 tertiary expert centers. Brain atrophy in subcortical regions (bilateral thalamus, basal ganglia, hippocampus, basal forebrain, and brainstem) was assessed across (1) healthy volunteers and patients, (2) clinical entities (eg, vegetative state, minimally conscious state), (3) clinical measures of consciousness (Coma Recovery Scale-Revised), and (4) injury etiology.

RESULTS

Compared to volunteers, patients exhibited significant atrophy across all structures (p < 0.05, corrected). Strikingly, we found almost no significant differences across clinical entities. Nonetheless, the clinical measures of awareness and wakefulness upon which differential diagnosis rely were systematically associated with tissue atrophy within thalamic and basal ganglia nuclei, respectively; the basal forebrain was atrophied in proportion to patients' response to sensory stimulation. In addition, nontraumatic injuries exhibited more extensive thalamic atrophy.

INTERPRETATION

These findings provide, for the first time, a grounding in pathology for gold standard behavior-based clinical measures of consciousness, and reframe our current models of DOC by stressing the different links tying thalamic mechanisms to willful behavior and extrathalamic mechanisms to behavioral (and electrocortical) arousal.

The metabotropic glutamate receptor, mGlu5, is required for extinction learning that occurs in the absence of a context change

The metabotropic glutamate (mGlu) receptors and, in particular, mGlu5 are crucially involved in multiple forms of synaptic plasticity that are believed to underlie explicit memory. MGlu5 is also required for information transfer through neuronal oscillations and for spatial memory. Furthermore, mGlu5 is involved in extinction of implicit forms of learning. This places this receptor in a unique position with regard to information encoding. Here, we explored the role of this receptor in context-dependent extinction learning under constant, or changed, contextual conditions. Animals were trained over 3 days to take a left turn under 25% reward probability in a T-maze with a distinct floor pattern (Context A). On Day 4, they experienced either a floor pattern change (Context B) or the same floor pattern (Context A) in the absence of reward. After acquisition of the task, the animals were returned to the maze once more on Day 5 (Context A, no reward). Treatment with the mGlu5 antagonist, 2-methyl-6-(phenylethynyl) pyridine, before maze exposure on Day 4 completely inhibited extinction learning in the AAA paradigm but had no effect in the ABA paradigm. A subsequent return to the original context (A, on Day 5) revealed successful extinction in the AAA paradigm, but impairment of extinction in the ABA paradigm. These data support that although extinction learning in a new context is unaffected by mGlu5 antagonism, extinction of the consolidated context is impaired. This suggests that mGlu5 is intrinsically involved in enabling learning that once-relevant information is no longer valid.

Distinct neuronal populations in the basal forebrain encode motivational salience and movement

Basal forebrain (BF) is one of the largest cortically-projecting neuromodulatory systems in the mammalian brain, and plays a key role in attention, arousal, learning and memory. The cortically projecting BF neurons, comprised of mainly magnocellular cholinergic and GABAergic neurons, are widely distributed across several brain regions that spatially overlap with the ventral striatopallidal system at the ventral pallidum (VP). As a first step toward untangling the respective functions of spatially overlapping BF and VP systems, the goal of this study was to comprehensively characterize the behavioral correlates and physiological properties of heterogeneous neuronal populations in the BF region. We found that, while rats performed a reward-biased simple reaction time task, distinct neuronal populations encode either motivational salience or movement information. The motivational salience of attended stimuli is encoded by phasic bursting activity of a large population of slow-firing neurons that have large, broad, and complex action potential waveforms. In contrast, two other separate groups of neurons encode movement-related information, and respectively increase and decrease firing rates while rats maintained fixation. These two groups of neurons mostly have higher firing rates and small, narrow action potential waveforms. These results support the conclusion that multiple neurophysiologically distinct neuronal populations in the BF region operate independently of each other as parallel functional circuits. These observations also caution against interpreting neuronal activity in this region as a homogeneous population reflecting the function of either BF or VP alone. We suggest that salience- and movement-related neuronal populations likely correspond to BF corticopetal neurons and VP neurons, respectively.

A frontal cortex event-related potential driven by the basal forebrain

Event-related potentials (ERPs) are widely used in both healthy and neuropsychiatric conditions as physiological indices of cognitive functions. Contrary to the common belief that cognitive ERPs are generated by local activity within the cerebral cortex, here we show that an attention-related ERP in the frontal cortex is correlated with, and likely generated by, subcortical inputs from the basal forebrain (BF). In rats performing an auditory oddball task, both the amplitude and timing of the frontal ERP were coupled with BF neuronal activity in single trials. The local field potentials (LFPs) associated with the frontal ERP, concentrated in deep cortical layers corresponding to the zone of BF input, were similarly coupled with BF activity and consistently triggered by BF electrical stimulation within 5-10 msec. These results highlight the important and previously unrecognized role of long-range subcortical inputs from the BF in the generation of cognitive ERPs. DOI: http://dx.doi.org/10.7554/eLife.02148.001.