Noradrenergic But Not Dopaminergic Neurons Signal Task State Changes and Predict Reengagement After a Failure

Brain stimulation over the left DLPFC enhances motivation for effortful rewards in patients with major depressive disorder

BACKGROUND

Amotivation is a typical feature in major depressive disorder (MDD), which produces reduced willingness to exert effort. The dorsolateral prefrontal cortex (DLPFC) is a crucial structure in goal-directed actions and therefore is a potential target in modulating effortful motivation. However, it remains unclear whether the intervention is effective for patients with MDD.

METHODS

We employed transcranial magnetic stimulation (TMS), computational modelling and event-related potentials (ERPs) to reveal the causal relationship between the left DLPFC and motivation for effortful rewards in MDD. Fifty patients underwent both active and sham TMS sessions, each followed by performing an Effort-Expenditure for Rewards Task, during which participants chose and implemented between low-effort/low-reward and high-effort/high-reward options.

RESULTS

The patients showed increased willingness to exert effort for rewards during the DLPFC facilitated session, compared with the sham session. They also had a trend in larger P3 amplitude for motivated attention toward chosen options, larger CNV during preparing for effort exertion, and larger SPN during anticipating a high reward. Besides, while behavior indexes for effortful choices were negatively related to depression severity in the sham session, this correlation was weakened in the active stimulation session.

CONCLUSIONS

These findings provide behavioral, computational, and neural evidence for the left DLPFC on effortful motivation for rewards. Facilitated DLPFC improves motor preparation and value anticipation after making decisions especially for highly effortful rewards in MDD. Facilitated DLPFC also has a potential function in enhancing motivated attention during cost-benefit trade-off. This neuromodulation effect provides a potential treatment for improving motivation in clinics.

Atomoxetine and reward size equally improve task engagement and perceptual decisions but differently affect movement execution

Our ability to engage and perform daily activities relies on balancing the associated benefits and costs. Rewards, as benefits, act as powerful motivators that help us stay focused for longer durations. The noradrenergic (NA) system is thought to play a significant role in optimizing our performance. Yet, the interplay between reward and the NA system in shaping performance remains unclear, particularly when actions are driven by external incentives (reward). To explore this interaction, we tested four female rhesus monkeys performing a sustained Go/NoGo task under two reward sizes (low/high) and three pharmacological conditions (saline and two doses of atomoxetine, a NA reuptake inhibitor: ATX-0.5 mg/kg and ATX-1 mg/kg). We found that increasing either reward or NA levels equally enhanced the animal's engagement in the task compared to low reward saline; the animals also responded faster and more consistently under these circumstances. Notably, we identified differences between reward size and ATX. When combined with ATX, high reward further reduced the occurrence of false alarms (i.e., incorrect go trials on distractors), implying that it helped further suppress impulsive responses. In addition, ATX (but not reward size) consistently increased movement duration dose-dependently, while high reward did not affect movement duration but decreased its variability. We conclude that noradrenaline and reward modulate performance, but their effects are not identical, suggesting differential underlying mechanisms. Reward might energize/invigorate decisions and action, while ATX might help regulate energy expenditure, depending on the context, through the NA system.

Effects of Adult Age and Functioning of the Locus Coeruleus Norepinephrinergic System on Reward-Based Learning

Age-related impairments in value representations and updating during decision-making and reward-based learning are often related to age-related attenuation in the catecholamine system such as dopamine (DA) and norepinephrine (NE). However, it is unclear to what extent age-related declines in NE functioning in humans affect reward-based decision-making. We conducted a probabilistic decision-making task and applied a Q-learning model to investigate participants' anticipatory values and value sensitivities. Task-related pupil dilations and locus coeruleus (LC) magnetic resonance imaging (MRI) contrast, which served as a potential window of the LC-NE functions, were assessed in younger and older adults. Results showed that in both choice and feedback phases, younger adults' (N = 42, 22 males) pupil dilations negatively correlated with anticipatory values, indicating uncertainty about outcome probabilities. Uncertainty-evoked pupil dilations in older adults (N = 41, 27 males) were smaller, indicating age-related impairments in value estimation and updating. In both age groups, participants who showed a larger uncertainty-evoked pupil dilation exhibited a higher value sensitivity as reflected in the β parameter of the reinforcement Q-learning model. Furthermore, older adults (N = 34, 29 males) showed a lower LC-MRI contrast than younger adults (N = 25, 15 males). The LC-MRI contrast positively correlated with value sensitivity only in older but not in younger adults. These findings suggest that task-related pupillary responses can reflect age-related deficits in value estimation and updating during reward-based decision-making. Our evidence with the LC-MRI contrast further showed the age-related decline of the LC structure in modulating value representations during reward-based learning.SIGNIFICANCE STATEMENT Age-related impairments in value representation and updating during reward-based learning are associated with declines in the catecholamine modulation with age. However, it is unclear how age-related declines in the LC-NE system may affect reward-based learning. Here, we show that compared with younger adults, older adults exhibited reduced uncertainty-induced pupil dilations, suggesting age-related deficits in value estimation and updating. Older adults showed a lower structural MRI of the LC contrast than younger adults, indicating age-related degeneration of the LC structure. The association between the LC-MRI contrast and value sensitivity was only observed in older adults. Our findings may demonstrate a pioneering model to unravel the role of the LC-NE system in reward-based learning in aging.

Neural pathway connectivity and discharge changes between M1 and STN in hemiparkinsonian rats

Alterations of electrophysiological activities, such as changed spike firing rates, reshaping the firing patterns, and aberrant frequency oscillations between the subthalamic nucleus (STN) and the primary motor cortex (M1), are thought to contribute to motor impairment in Parkinson's disease (PD). However, the alterations of electrophysiological characteristics of STN and M1 in PD are still unclear, especially under specific treadmill movement. To examine the relationship between electrophysiological activity in the STN-M1 pathway, extracellular spike trains and local field potential (LFPs) of STN and M1 were simultaneously recorded during resting and movement in unilateral 6-hydroxydopamine (6-OHDA) lesioned rats. The results showed that the identified STN neurons and M1 neurons exhibited abnormal neuronal activity after dopamine loss. The dopamine depletion altered the LFP power in STN and M1 whatever in rest or movement states. Furthermore, the enhanced synchronization of LFP oscillations after dopamine loss was found in 12-35 Hz (beta frequencies) between the STN and M1 during rest and movement. In addition, STN neurons were phase-locked firing to M1 oscillations at 12-35 Hz during rest epochs in 6-OHDA lesioned rats. The dopamine depletion also impaired the anatomical connectivity between the M1 and STN by injecting anterograde neuroanatomical tracing virus into M1 in control and PD rats. Collectively, impairment of' electrophysiological activity and anatomical connectivity in the M1-STN pathway may be the basis for dysfunction of the cortico-basal ganglia circuit, correlating with motor symptoms of PD.

Noradrenergic Modulation of Learned and Innate Behaviors in Dopamine Transporter Knockout Rats by Guanfacine

Investigation of the precise mechanisms of attention deficit and hyperactivity disorder (ADHD) and other dopamine-associated conditions is crucial for the development of new treatment approaches. In this study, we assessed the effects of repeated and acute administration of α2A-adrenoceptor agonist guanfacine on innate and learned forms of behavior of dopamine transporter knockout (DAT-KO) rats to evaluate the possible noradrenergic modulation of behavioral deficits. DAT-KO and wild type rats were trained in the Hebb-Williams maze to perform spatial working memory tasks. Innate behavior was evaluated via pre pulse inhibition (PPI). Brain activity of the prefrontal cortex and the striatum was assessed. Repeated administration of GF improved the spatial working memory task fulfillment and PPI in DAT-KO rats, and led to specific changes in the power spectra and coherence of brain activity. Our data indicate that both repeated and acute treatment with a non-stimulant noradrenergic drug lead to improvements in the behavior of DAT-KO rats. This study further supports the role of the intricate balance of norepinephrine and dopamine in the regulation of attention. The observed compensatory effect of guanfacine on the behavior of hyperdopaminergic rats may be used in the development of combined treatments to support the dopamine-norepinephrine balance.

Natural locus coeruleus dynamics during feeding

Recent data demonstrate that noradrenergic neurons of the locus coeruleus (LC-NE) are required for fear-induced suppression of feeding, but the role of endogenous LC-NE activity in natural, homeostatic feeding remains unclear. Here, we found that LC-NE activity was suppressed during food consumption, and the magnitude of this neural response was attenuated as mice consumed more pellets throughout the session, suggesting that LC responses to food are modulated by satiety state. Visual-evoked LC-NE activity was also attenuated in sated mice, suggesting that satiety state modulates LC-NE encoding of multiple behavioral states. We also found that food intake could be attenuated by brief or longer durations of LC-NE activation. Last, we found that activation of the LC to the lateral hypothalamus pathway suppresses feeding and enhances avoidance and anxiety-like responding. Our findings suggest that LC-NE neurons modulate feeding by integrating both external cues (e.g., anxiogenic environmental cues) and internal drives (e.g., satiety).

Noradrenergic deficits contribute to apathy in Parkinson's disease through the precision of expected outcomes

Apathy is a debilitating feature of many neuropsychiatric diseases, that is typically described as a reduction of goal-directed behaviour. Despite its prevalence and prognostic importance, the mechanisms underlying apathy remain controversial. Degeneration of the locus coeruleus-noradrenaline system is known to contribute to motivational deficits, including apathy. In healthy people, noradrenaline has been implicated in signalling the uncertainty of expectations about the environment. We proposed that noradrenergic deficits contribute to apathy by modulating the relative weighting of prior beliefs about action outcomes. We tested this hypothesis in the clinical context of Parkinson’s disease, given its associations with apathy and noradrenergic dysfunction. Participants with mild-to-moderate Parkinson’s disease (N = 17) completed a randomised double-blind, placebo-controlled, crossover study with 40 mg of the noradrenaline reuptake inhibitor atomoxetine. Prior weighting was inferred from psychophysical analysis of performance in an effort-based visuomotor task, and was confirmed as negatively correlated with apathy. Locus coeruleus integrity was assessed in vivo using magnetisation transfer imaging at ultra-high field 7T. The effect of atomoxetine depended on locus coeruleus integrity: participants with a more degenerate locus coeruleus showed a greater increase in prior weighting on atomoxetine versus placebo. The results indicate a contribution of the noradrenergic system to apathy and potential benefit from noradrenergic treatment of people with Parkinson’s disease, subject to stratification according to locus coeruleus integrity. More broadly, these results reconcile emerging predictive processing accounts of the role of noradrenaline in goal-directed behaviour with the clinical symptom of apathy and its potential pharmacological treatment.

Apathy is a common and harmful consequence of many neuropsychiatric diseases. Its underlying causes are not fully understood, which prevents the development of new treatments. We approach the problem in a new way, modelling human behaviour in terms of the continuously updated interaction between sensory information and brain-based predictions or ‘priors’ about the consequences of our actions. We have previously shown that apathy is related to a loss of precision of these ‘priors’. We proposed that the precision is controlled by noradrenaline (like adrenaline, but made in the brain). We tested whether the noradrenaline-enhancing drug called atomoxetine can restore the priors’ precision in apathetic people. We enrolled participants with Parkinson’s disease, which is associated with both apathy and noradrenaline loss. We used ultra-high field MRI to measure individual differences in the integrity of specialist region called the locus coeruleus–the brain’s source of noradrenaline. We found that the effect of treatment with atomoxetine on prior precision depended on locus coeruleus integrity: Participants with a degenerated locus coeruleus had a more positive change in prior precision. Our results highlight how individual differences in neuroanatomy can predict the potential benefit of noradrenaline treatments in people suffering from apathy.

Effort Mobilization and Lapses of Sustained Attention

The current study examined whether effort mobilization would enhance sustained attention and reduce lapses of attention. Participants performed a sustained attention task and were randomly assigned to either an effort condition where they were instructed to "Try Hard" on a subset of trials or were assigned to a control condition with no "Try Hard" instructions. Pupillary responses were continuously recorded, and periodically during the task participants were presented with thought probes to determine whether they were on or off task. The results suggested within the effort condition there were no behavioral differences between Try Hard and "Standard" trials. Preparatory pupil responses were increased in Try Hard trials, but there were no differences for phasic pupillary responses to stimulus onset. In contrast, examining differences between the effort and control conditions suggested that participants who received the Try Hard instructions demonstrated faster overall performance, a reduction in very long reaction times, and reported fewer off-task thoughts compared with participants in the control condition. Participants in the effort condition also demonstrated a larger ramp-up in pupillary responses during the preparatory interval and a larger phasic response to stimulus onset compared with participants in the control condition. These results are consistent with attention allocation models suggesting that participants in the effort condition mobilized more attentional effort than participants in the control condition, resulting in enhanced sustained attention and a reduction in lapses of attention. These results also are consistent with recent theories, which suggest that the locus coeruleus norepinephrine system is associated with effort mobilization.

Locus coeruleus neurons encode the subjective difficulty of triggering and executing actions

The brain stem noradrenergic nucleus locus coeruleus (LC) is involved in various costly processes: arousal, stress, and attention. Recent work has pointed toward an implication in physical effort, and indirect evidence suggests that the LC could be also involved in cognitive effort. To assess the dynamic relation between LC activity, effort production, and difficulty, we recorded the activity of 193 LC single units in 5 monkeys performing 2 discounting tasks (a delay discounting task and a force discounting task), as well as a simpler target detection task where conditions were matched for difficulty and only differed in terms of sensory-motor processes. First, LC neurons displayed a transient activation both when monkeys initiated an action and when exerting force. Second, the magnitude of the activation scaled with the associated difficulty, and, potentially, the corresponding amount of effort produced, both for decision and force production. Indeed, at action initiation in both discounting tasks, LC activation increased in conditions associated with lower average engagement rate, i.e., those requiring more cognitive control to trigger the response. Decision-related activation also scaled with response time (RT), over and above task parameters, in line with the idea that it reflects the amount of resources (here time) spent on the decision process. During force production, LC activation only scaled with the amount of force produced in the force discounting task, but not in the control target detection task, where subjective difficulty was equivalent across conditions. Our data show that LC neurons dynamically track the amount of effort produced to face both cognitive and physical challenges with a subsecond precision. This works provides key insight into effort processing and the contribution of the noradrenergic system, which is affected in several pathologies where effort is impaired, including Parkinson disease and depression.

The ascending arousal system shapes neural dynamics to mediate awareness of cognitive states

Models of cognitive function typically focus on the cerebral cortex and hence overlook functional links to subcortical structures. This view does not consider the role of the highly-conserved ascending arousal system's role and the computational capacities it provides the brain. We test the hypothesis that the ascending arousal system modulates cortical neural gain to alter the low-dimensional energy landscape of cortical dynamics. Here we use spontaneous functional magnetic resonance imaging data to study phasic bursts in both locus coeruleus and basal forebrain, demonstrating precise time-locked relationships between brainstem activity, low-dimensional energy landscapes, network topology, and spatiotemporal travelling waves. We extend our analysis to a cohort of experienced meditators and demonstrate locus coeruleus-mediated network dynamics were associated with internal shifts in conscious awareness. Together, these results present a view of brain organization that highlights the ascending arousal system's role in shaping both the dynamics of the cerebral cortex and conscious awareness.

Locus Coeruleus Norepinephrine in Learned Behavior: Anatomical Modularity and Spatiotemporal Integration in Targets

The locus coeruleus (LC), a small brainstem nucleus, is the primary source of the neuromodulator norepinephrine (NE) in the brain. The LC receives input from widespread brain regions, and projects throughout the forebrain, brainstem, cerebellum, and spinal cord. LC neurons release NE to control arousal, but also in the context of a variety of sensory-motor and behavioral functions. Despite its brain-wide effects, much about the role of LC-NE in behavior and the circuits controlling LC activity is unknown. New evidence suggests that the modular input-output organization of the LC could enable transient, task-specific modulation of distinct brain regions. Future work must further assess whether this spatial modularity coincides with functional differences in LC-NE subpopulations acting at specific times, and how such spatiotemporal specificity might influence learned behaviors. Here, we summarize the state of the field and present new ideas on the role of LC-NE in learned behaviors.

Roles of Motor Cortex Neuron Classes in Reach-Related Modulation for Hemiparkinsonian Rats

Disruption of the function of the primary motor cortex (M1) is thought to play a critical role in motor dysfunction in Parkinson's disease (PD). Detailed information regarding the specific aspects of M1 circuits that become abnormal is lacking. We recorded single units and local field potentials (LFPs) of M1 neurons in unilateral 6-hydroxydopamine (6-OHDA) lesion rats and control rats to assess the impact of dopamine (DA) cell loss during rest and a forelimb reaching task. Our results indicated that M1 neurons can be classified into two groups (putative pyramidal neurons and putative interneurons) and that 6-OHDA could modify the activity of different M1 subpopulations to a large extent. Reduced activation of putative pyramidal neurons during inattentive rest and reaching was observed. In addition, 6-OHDA intoxication was associated with an increase in certain LFP frequencies, especially those in the beta range (broadly defined here as any frequency between 12 and 35 Hz), which become pathologically exaggerated throughout cortico-basal ganglia circuits after dopamine depletion. Furthermore, assessment of different spike-LFP coupling parameters revealed that the putative pyramidal neurons were particularly prone to being phase-locked to ongoing cortical oscillations at 12-35 Hz during reaching. Conversely, putative interneurons were neither hypoactive nor synchronized to ongoing cortical oscillations. These data collectively demonstrate a neuron type-selective alteration in the M1 in hemiparkinsonian rats. These alterations hamper the ability of the M1 to contribute to motor conduction and are likely some of the main contributors to motor impairments in PD.