Negative symptoms and the failure to represent the expected reward value of actions: behavioral and computational modeling evidence

Psychotic like experiences as part of a continuum of psychosis: Associations with effort-based decision-making and reward responsivity

Research examining psychotic disorders typically involves comparison between individuals with a clinical disorder and healthy controls. However, research suggests that psychotic symptoms, such as delusions and hallucinations, may exist on a continuum ranging from variation in healthy individuals to diagnosable psychotic disorders. On this continuum, some individuals endorse occasional psychotic like experiences (PLEs) that do not cause sufficient impairment or distress to warrant a clinical diagnosis. Given this continuum model, one might expect to observe impairments in those with PLEs in the same behavioral domains impaired in schizophrenia. Thus, we examined two domains typically impaired in schizophrenia, effort allocation and reward responsivity, in a large university sample (n = 126). Participants completed tasks assessing effort-based decision-making, reward responsivity, and questionnaires assessing PLEs. Greater PLEs were associated with greater effort expenditure regardless of probability of receiving a reward or reward value. Higher PLEs were related to greater positive feelings when receiving rewards. Importantly, these relationships remained the same when controlling for other symptoms such as depression, anhedonia, and anxiety. These findings suggest that PLEs may be associated with hypersensitivity to reward at the less severe end of the psychotic continuum, with effort to attain a reward expended in a potentially inefficient manner. This pattern is consistent with models of hyperdopaminergic states in psychotic individuals not taking antipsychotic medications, given the role of dopamine in modulating effort allocation and reward anticipation.

Reward-driven decision-making impairments in schizophrenia

The ability to use feedback to guide optimal decision-making is essential for goal-directed behaviour. While impairments in feedback-driven decision-making have been associated with schizophrenia and depression, this has been examined primarily in the context of binary probabilistic choice paradigms. In real-world decision-making, however, individuals must make choices when there are more than two competing options that vary in the frequency and magnitude of potential rewards and losses. Thus, the current study examined win-stay/lose-shift (WSLS) behaviour on the Iowa Gambling Task (IGT) in order to evaluate the influence of immediate rewards and losses in guiding real-world decision-making in patients with schizophrenia and major depressive disorder. Fifty-one patients with schizophrenia, 43 patients with major depressive disorder, and 51 healthy controls completed the IGT, as well as a series of clinical and cognitive measures. WSLS was assessed by quantifying trial-by-trial behaviour following rewards and losses on the IGT. Multivariate analyses of variance revealed that patients with schizophrenia demonstrated intact lose-shift behaviour, but significantly reduced win-stay rates compared to healthy controls. In contrast, no WSLS impairments emerged in the depressed group. Win-stay impairments in the schizophrenia group were significantly related to deficits in motivation and cognition. Patients with schizophrenia exhibit impaired reward-driven decision-making in the context of multiple choices with concurrent rewards and losses, and this appears to be driven by a reduced propensity for advantageous win-stay behaviour. With the importance of reward learning and decision-making in generating goal-directed behaviour, these findings suggest a potential mechanism contributing to the motivation deficits seen in schizophrenia.

Temporal and Effort cost Decision-making in Healthy Individuals with Subclinical Psychotic Symptoms

The value people attribute to rewards is influenced both by the time and the effort required to obtain them. Impairments in these computations are described in patients with schizophrenia and appear associated with negative symptom severity. This study investigated whether deficits in temporal and effort cost computations can be observed in individuals with subclinical psychotic symptoms (PS) to determine if this dysfunction is already present in a potentially pre-psychotic period. Sixty participants, divided into three groups based on the severity of PS (high, medium and low), performed two temporal discounting tasks with food and money and a concurrent schedule task, in which the effort to obtain food increased over time. We observed that in high PS participants the discounting rate appeared linear and flatter than that exhibited by participants with medium and low PS, especially with food. In the concurrent task, compared to those with low PS, participants with high PS exerted tendentially less effort to obtain snacks only when the required effort was high. Participants exerting less effort in the higher effort condition were those with higher negative symptoms. These results suggest that aberrant temporal and effort cost computations might be present in individuals with subclinical PS and therefore could represent a vulnerability marker for psychosis.

Socially Learned Attitude Change is not reduced in Medicated Patients with Schizophrenia

Schizophrenia is often associated with distinctive or odd social behaviours. Previous work suggests this could be due to a general reduction in conformity; however, this work only assessed the tendency to publicly agree with others, which may involve a number of different mechanisms. In this study, we specifically investigated whether patients display a reduced tendency to adopt other people’s opinions (socially learned attitude change). We administered a computerized conformity task, assumed to rely on reinforcement learning circuits, to 32 patients with schizophrenia or schizo-affective disorder and 39 matched controls. Each participant rated 153 faces for trustworthiness. After each rating, they were immediately shown the opinion of a group. After approximately 1 hour, participants were unexpectedly asked to rate all the faces again. We compared the degree of attitude change towards group opinion in patients and controls. Patients presented equal or more social influence on attitudes than controls. This effect may have been medication induced, as increased conformity was seen with higher antipsychotic dose. The results suggest that there is not a general decline in conformity in medicated patients with schizophrenia and that previous findings of reduced conformity are likely related to mechanisms other than reinforcement based social influence on attitudes.

COMPASS: An Open-Source, General-Purpose Software Toolkit for Computational Psychiatry

Mathematical modeling of behavior during a psychophysical task, referred to as "computational psychiatry," could greatly improve our understanding of mental disorders. One barrier to the broader adoption of computational methods, is that they often require advanced statistical modeling and mathematical skills. Biological and behavioral signals often show skewed or non-Gaussian distributions, and very few toolboxes and analytical platforms are capable of processing such signal categories. We developed the Computational Psychiatry Adaptive State-Space (COMPASS) toolbox, an open-source MATLAB-based software package. This toolbox is easy to use and capable of integrating signals with a variety of distributions. COMPASS has the tools to process signals with continuous-valued and binary measurements, or signals with incomplete-missing or censored-measurements, which makes it well-suited for processing those signals captured during a psychophysical task. After specifying a few parameters in a small set of user-friendly functions, COMPASS allows users to efficiently apply a wide range of computational behavioral models. The model output can be analyzed as an experimental outcome or used as a regressor for neural data and can also be tested using the goodness-of-fit measurement. Here, we demonstrate that COMPASS can replicate two computational behavioral analyses from different groups. COMPASS replicates and can slightly improve on the original modeling results. We also demonstrate the use of COMPASS application in a censored-data problem and compare its performance result with naïve estimation methods. This flexible, general-purpose toolkit should accelerate the use of computational modeling in psychiatric neuroscience.

Schizophrenia, Dopamine and the Striatum: From Biology to Symptoms

The mesolimbic hypothesis has been a central dogma of schizophrenia for decades, positing that aberrant functioning of midbrain dopamine projections to limbic regions causes psychotic symptoms. Recently, however, advances in neuroimaging techniques have led to the unanticipated finding that dopaminergic dysfunction in schizophrenia is greatest within nigrostriatal pathways, implicating the dorsal striatum in the pathophysiology and calling into question the mesolimbic theory. At the same time our knowledge of striatal anatomy and function has progressed, suggesting new mechanisms via which striatal dysfunction may contribute to the symptoms of schizophrenia. This Review draws together these developments, to explore what they mean for our understanding of the pathophysiology, clinical manifestations, and treatment of the disorder.

Techniques for characterising the mesostriatal dopamine system, both in humans and animal models, have advanced significantly over the past decade.

In vivo imaging studies in schizophrenia patients demonstrate that dopaminergic dysfunction in schizophrenia is greatest in nigrostriatal as opposed to mesolimbic pathways.

Better understanding of striatal structure and function has enhanced our insight into the neurobiological basis of psychotic symptoms.

The role of other neurotransmitters in modulating striatal dopamine function merits further exploration, and modulating these neurotransmitter systems has potential to offer new therapeutic strategies.

Dopamine: Functions, Signaling, and Association with Neurological Diseases

The dopaminergic system plays important roles in neuromodulation, such as motor control, motivation, reward, cognitive function, maternal, and reproductive behaviors. Dopamine is a neurotransmitter, synthesized in both central nervous system and the periphery, that exerts its actions upon binding to G protein-coupled receptors. Dopamine receptors are widely expressed in the body and function in both the peripheral and the central nervous systems. Dopaminergic signaling pathways are crucial to the maintenance of physiological processes and an unbalanced activity may lead to dysfunctions that are related to neurodegenerative diseases. Unveiling the neurobiology and the molecular mechanisms that underlie these illnesses may contribute to the development of new therapies that could promote a better quality of life for patients worldwide. In this review, we summarize the aspects of dopamine as a catecholaminergic neurotransmitter and discuss dopamine signaling pathways elicited through dopamine receptor activation in normal brain function. Furthermore, we describe the potential involvement of these signaling pathways in evoking the onset and progression of some diseases in the nervous system, such as Parkinson's, Schizophrenia, Huntington's, Attention Deficit and Hyperactivity Disorder, and Addiction. A brief description of new dopaminergic drugs recently approved and under development treatments for these ailments is also provided.

In and out of schizophrenia: Activation and deactivation of the negative and positive schemas

Theorists, clinicians, and investigators have attempted to find a common source for the negative and positive symptoms of schizophrenia. We propose that a unified theory, based on a common cognitive structure not only has explanatory value, but can serve as a framework for a psychotherapeutic intervention. Specifically, we propose that the cognitive triad - the negative view of the self, others, and the future - is the source of the content for the negative and positive symptoms. We report literature supporting the relationship between each facet of the negative triad and each of the key symptoms: expressive negative symptoms, delusions, and verbal hallucinations. We conclude that the literature supports the validity of the cognitive model of negative and positive symptoms. The cognitive model furthers the understanding of the positive and negative symptoms of schizophrenia, and we describe how this provides a framework for a psychotherapeutic intervention.

Impaired Expected Value Computations in Schizophrenia Are Associated With a Reduced Ability to Integrate Reward Probability and Magnitude of Recent Outcomes

BACKGROUND

Motivational deficits in people with schizophrenia (PSZ) are associated with an inability to integrate the magnitude and probability of previous outcomes. The mechanisms that underlie probability-magnitude integration deficits, however, are poorly understood. We hypothesized that increased reliance on "valueless" stimulus-response associations, in lieu of expected value (EV)-based learning, could drive probability-magnitude integration deficits in PSZ with motivational deficits.

METHODS

Healthy volunteers (n = 38) and PSZ (n = 49) completed a learning paradigm consisting of four stimulus pairs. Reward magnitude (3, 2, 1, 0 points) and probability (90%, 80%, 20%, 10%) determined each stimulus's EV. Following a learning phase, new and familiar stimulus pairings were presented. Participants were asked to select stimuli with the highest reward value.

RESULTS

PSZ with high motivational deficits made increasingly less optimal choices as the difference in reward value (probability × magnitude) between two competing stimuli increased. Using a previously validated computational hybrid model, PSZ relied less on EV ("Q-learning") and more on stimulus-response learning ("actor-critic"), which correlated with Scale for the Assessment of Negative Symptoms motivational deficit severity. PSZ specifically failed to represent reward magnitude, consistent with model demonstrations showing that response tendencies in the actor-critic were preferentially driven by reward probability.

CONCLUSIONS

Probability-magnitude deficits in PSZ with motivational deficits arise from underutilization of EV in favor of reliance on valueless stimulus-response associations. Confirmed by our computational hybrid framework, probability-magnitude integration deficits were driven specifically by a failure to represent reward magnitude. This work provides a first mechanistic explanation of complex EV-based learning deficits in PSZ with motivational deficits that arise from an inability to combine information from different reward modalities.

Daily-life stress differentially impacts ventral striatal dopaminergic modulation of reward processing in first-degree relatives of individuals with psychosis

Emerging evidence shows that stress can impair the ability to learn from and pursue rewards, which in turn has been linked to motivational impairments characteristic of the psychotic disorder. Ventral striatal dopaminergic neurotransmission has been found to modulate reward processing, and appears to be disrupted by exposure to stress. We investigated the hypothesis that stress experienced in the everyday life has a blunting effect on reward-induced dopamine release in the ventral striatum of 16 individuals at a familial risk for psychosis compared to 16 matched control subjects. Six days of ecological momentary assessments quantified the amount of daily-life stress prior to [¹⁸F]fallypride PET imaging while performing a probabilistic reinforcement learning task. Relative to the controls, individuals at a familial risk for psychosis who encountered more daily-life stress showed significantly diminished extent of reward-induced dopamine release in the right ventral striatum, as well as poorer performance on the reward task. These findings provide the first neuromolecular evidence for stress-related deregulation of reward processing in familial predisposition to psychosis. The implication of daily-life stress in compromised modulation of reward function may facilitate the design of targeted neuropharmacological and ecological interventions.

Dopamine dysregulation hypothesis: the common basis for motivational anhedonia in major depressive disorder and schizophrenia?

Abnormalities in reward processing are crucial symptoms of major depressive disorder (MDD) and schizophrenia (SCH). Recent neuroscientific findings regarding MDD have led to conclusions about two different symptoms related to reward processing: motivational and consummatory anhedonia, corresponding, respectively, to impaired motivation to obtain rewards ('wanting'), and diminished satisfaction from consuming them ('liking'). One can ask: which of these is common for MDD and SCH. In our review of the latest neuroscientific studies, we show that MDD and SCH do not share consummatory anhedonia, as SCH patients usually have unaltered liking. Therefore, we investigated whether motivational anhedonia is the common symptom across MDD and SCH. With regard to the similarities and differences between the neural mechanisms of MDD and SCH, here we expand the current knowledge of motivation deficits and present the common underlying mechanism of motivational anhedonia - the dopamine dysregulation hypothesis - stating that any prolonged dysregulation in tonic dopamine signaling that exceeds the given equilibrium can lead to striatal dysfunction and motivational anhedonia. The implications for further research and treatment of MDD and SCH are also discussed.

Reduced willingness to invest effort in schizophrenia with high negative symptoms regardless of reward stimulus presentation and reward value

BACKGROUND

Negative symptoms in schizophrenia, which are related to poor functioning, are thought to be grounded on aberrant functioning in the reward system. We aimed to disentangle how negative symptoms and two cognitive aspects of goal-directed behavior, mental representation of reward and reward value, affect willingness to invest effort to attain a reward in schizophrenia.

AIMS AND PROCEDURES

To this purpose, 43 schizophrenia patients and 35 healthy controls were assessed for negative symptoms and general functioning, and completed an effort-based reward task. Patients were split in high and low negative symptoms scorers. A series of ANOVA tests were conducted in order to test the effects of group controlling for representation of reward (Task 1) and balance between reward value and effort (Task 2) on will to invest effort to attain a reward.

MAIN FINDINGS

Schizophrenia patients with high negative symptoms chose to invest lower amounts of effort for a reward compared both to low negative symptoms patients and to controls in both tasks. Neither mental representation of reward (Task 1) nor reward value (Task 2) did differentially affect will to invest effort between-groups.

CONCLUSIONS

These findings suggest that the lower willingness to invest effort observed in schizophrenia patients with high negative symptoms may not be related to cognitive aspects of goal-oriented behavior.

Attractor-like Dynamics in Belief Updating in Schizophrenia

Subjects with a diagnosis of schizophrenia (Scz) overweight unexpected evidence in probabilistic inference: such evidence becomes "aberrantly salient." A neurobiological explanation for this effect is that diminished synaptic gain (e.g., hypofunction of cortical NMDARs) in Scz destabilizes quasi-stable neuronal network states (or "attractors"). This attractor instability account predicts that (1) Scz would overweight unexpected evidence but underweight consistent evidence, (2) belief updating would be more vulnerable to stochastic fluctuations in neural activity, and (3) these effects would correlate. Hierarchical Bayesian belief updating models were tested in two independent datasets (n = 80 male and n = 167 female) comprising human subjects with Scz, and both clinical and nonclinical controls (some tested when unwell and on recovery) performing the "probability estimates" version of the beads task (a probabilistic inference task). Models with a standard learning rate, or including a parameter increasing updating to "disconfirmatory evidence," or a parameter encoding belief instability were formally compared. The "belief instability" model (based on the principles of attractor dynamics) had most evidence in all groups in both datasets. Two of four parameters differed between Scz and nonclinical controls in each dataset: belief instability and response stochasticity. These parameters correlated in both datasets. Furthermore, the clinical controls showed similar parameter distributions to Scz when unwell, but were no different from controls once recovered. These findings are consistent with the hypothesis that attractor network instability contributes to belief updating abnormalities in Scz, and suggest that similar changes may exist during acute illness in other psychiatric conditions.SIGNIFICANCE STATEMENT Subjects with a diagnosis of schizophrenia (Scz) make large adjustments to their beliefs following unexpected evidence, but also smaller adjustments than controls following consistent evidence. This has previously been construed as a bias toward "disconfirmatory" information, but a more mechanistic explanation may be that in Scz, neural firing patterns ("attractor states") are less stable and hence easily altered in response to both new evidence and stochastic neural firing. We model belief updating in Scz and controls in two independent datasets using a hierarchical Bayesian model, and show that all subjects are best fit by a model containing a belief instability parameter. Both this and a response stochasticity parameter are consistently altered in Scz, as the unstable attractor hypothesis predicts.

Reference-point centering and range-adaptation enhance human reinforcement learning at the cost of irrational preferences

In economics and perceptual decision-making contextual effects are well documented, where decision weights are adjusted as a function of the distribution of stimuli. Yet, in reinforcement learning literature whether and how contextual information pertaining to decision states is integrated in learning algorithms has received comparably little attention. Here, we investigate reinforcement learning behavior and its computational substrates in a task where we orthogonally manipulate outcome valence and magnitude, resulting in systematic variations in state-values. Model comparison indicates that subjects' behavior is best accounted for by an algorithm which includes both reference point-dependence and range-adaptation-two crucial features of state-dependent valuation. In addition, we find that state-dependent outcome valuation progressively emerges, is favored by increasing outcome information and correlated with explicit understanding of the task structure. Finally, our data clearly show that, while being locally adaptive (for instance in negative valence and small magnitude contexts), state-dependent valuation comes at the cost of seemingly irrational choices, when options are extrapolated out from their original contexts.

Striatal dopamine D2 receptors regulate effort but not value-based decision making and alter the dopaminergic encoding of cost

Deficits in goal-directed motivation represent a debilitating symptom for many patients with schizophrenia. Impairments in motivation can arise from deficits in processing information about effort and or value, disrupting effective cost-benefit decision making. We have previously shown that upregulated dopamine D2 receptor expression within the striatum (D2R-OE mice) decreases goal-directed motivation. Here, we determine the behavioral and neurochemical mechanisms behind this deficit. Female D2R-OE mice were tested in several behavioral paradigms including recently developed tasks that independently assess the impact of Value or Effort manipulations on cost-benefit decision making. In vivo microdialysis was used to measure extracellular dopamine in the striatum during behavior. In a value-based choice task, D2R-OE mice show normal sensitivity to changes in reward value and used reward value to guide their actions. In an effort-based choice task, D2R-OE mice evaluate the cost of increasing the number of responses greater relative to the effort cost of longer duration responses compared to controls. This shift away from choosing to repeatedly execute a response is accompanied by a dampening of extracellular dopamine in the striatum during goal-directed behavior. In the ventral striatum, extracellular dopamine level negatively correlates with response cost in controls, but this relationship is lost in D2R-OE mice. These results show that D2R signaling in the striatum, as observed in some patients with schizophrenia, alters the relationship between effort expenditure and extracellular dopamine. This dysregulation produces motivation deficits that are specific to effort but not value-based decision making, paralleling the effort-based motivational deficits observed in schizophrenia.

Differential neural reward mechanisms in treatment-responsive and treatment-resistant schizophrenia

BACKGROUND

The significant proportion of schizophrenia patients refractory to treatment, primarily directed at the dopamine system, suggests that multiple mechanisms may underlie psychotic symptoms. Reinforcement learning tasks have been employed in schizophrenia to assess dopaminergic functioning and reward processing, but these have not directly compared groups of treatment-refractory and non-refractory patients.

METHODS

In the current functional magnetic resonance imaging study, 21 patients with treatment-resistant schizophrenia (TRS), 21 patients with non-treatment-resistant schizophrenia (NTR), and 24 healthy controls (HC) performed a probabilistic reinforcement learning task, utilizing emotionally valenced face stimuli which elicit a social bias toward happy faces. Behavior was characterized with a reinforcement learning model. Trial-wise reward prediction error (RPE)-related neural activation and the differential impact of emotional bias on these reward signals were compared between groups.

RESULTS

Patients showed impaired reinforcement learning relative to controls, while all groups demonstrated an emotional bias favoring happy faces. The pattern of RPE signaling was similar in the HC and TRS groups, whereas NTR patients showed significant attenuation of RPE-related activation in striatal, thalamic, precentral, parietal, and cerebellar regions. TRS patients, but not NTR patients, showed a positive relationship between emotional bias and RPE signal during negative feedback in bilateral thalamus and caudate.

CONCLUSION

TRS can be dissociated from NTR on the basis of a different neural mechanism underlying reinforcement learning. The data support the hypothesis that a favorable response to antipsychotic treatment is contingent on dopaminergic dysfunction, characterized by aberrant RPE signaling, whereas treatment resistance may be characterized by an abnormality of a non-dopaminergic mechanism - a glutamatergic mechanism would be a possible candidate.

Neurophysiological correlates of Avolition-apathy in schizophrenia: A resting-EEG microstates study

Background

The “Avolition-apathy” domain of the negative symptoms was found to include different symptoms by factor analytic studies on ratings derived by different scales. In particular, the relationship of anhedonia with this domain is controversial. Recently introduced negative symptom rating scales provide a better assessment of anhedonia, allowing the distinction of anticipatory and consummatory aspects, which might be related to different psychopathological dimensions. The study of associations with external validators, such as electrophysiological, brain imaging or cognitive indices, might shed further light on the status of anhedonia within the Avolition-apathy domain.

Objectives

We used brain electrical microstates (MSs), which represent subsecond periods of quasi-stable scalp electrical field, associated with resting-state neural networks (and thus with global patterns of functional connectivity), to test whether the component symptoms of Avolition-apathy share the same correlates.

Method

We analyzed multichannel resting EEGs in 142 individuals with schizophrenia (SCZ) and in 64 healthy controls (HC), recruited within the add-on EEG study of the Italian Network for Research on Psychoses. Relative time contribution, duration and occurrence of four MS classes (MS-A/-B/-C/−D) were calculated. Group differences on MS parameters (contribution and duration) and their associations with negative symptom domains (assessed using the Brief Negative Symptoms Scale) were investigated.

Results

SCZ, in comparison to HC, showed increased contribution and duration of MS-C. The contribution of MS-A positively correlated with Avolition-apathy, but not with Expressive deficit. Within the Avolition-apathy domain, anticipatory anhedonia, avolition and asociality, but not consummatory anhedonia, showed the same correlations with MS-A contribution.

Conclusion

Our findings support the existence of distinct electrophysiological correlates of Avolition-apathy with respect to Expressive deficit, and lend support to the hypothesis that only the anticipatory component of anhedonia shares the same pathophysiological underpinnings of the Avolition-apathy domain.

•

Microstate C contribution and duration were increased in SCZ compared to HC.

•

Avolition-apathy was correlated with the contribution of microstate A.

•

Avolition-apathy might be associated with sensory processing deficit.

Intact striatal dopaminergic modulation of reward learning and daily-life reward-oriented behavior in first-degree relatives of individuals with psychotic disorder

BACKGROUND

Abnormalities in reward learning in psychotic disorders have been proposed to be linked to dysregulated subcortical dopaminergic (DA) neurotransmission, which in turn is a suspected mechanism for predisposition to psychosis. We therefore explored the striatal dopaminergic modulation of reward processing and its behavioral correlates in individuals at familial risk for psychosis.

METHODS

We performed a DA D2/3 receptor [18F]fallypride positron emission tomography scan during a probabilistic reinforcement learning task in 16 healthy first-degree relatives of patients with psychosis and 16 healthy volunteers, followed by a 6-day ecological momentary assessment study capturing reward-oriented behavior in the everyday life.

RESULTS

We detected significant reward-induced DA release in bilateral caudate, putamen and ventral striatum of both groups, with no group differences in its magnitude nor spatial extent. In both groups alike, greater extent of reward-induced DA release in all regions of interest was associated with better performance in the task, as well as in greater tendency to be engaged in reward-oriented behavior in the daily life.

CONCLUSIONS

These findings suggest intact striatal dopaminergic modulation of reinforcement learning and reward-oriented behavior in individuals with familial predisposition to psychosis. Furthermore, this study points towards a key link between striatal reward-related DA release and pursuit of ecologically relevant rewards.

Identifying the "Therapy Targets" for Treating the Negative Symptoms of Psychosis Using Cognitive Behavioral Therapy

The division of psychotic symptoms into positive and negative categories has largely divided the research on them. While the research on positive symptoms of psychosis has rapidly developed over the last three decades, the literature on negative symptoms has noticeably lagged behind. Negative symptoms have likely been ignored in the treatment literature because they were previously thought to remit following the treatment of positive symptoms. Recent evidence does not consistently support this theory and indicates that the different manifestations of negative symptoms require distinct approaches to treatment. The current review provides a re-evaluation of the theoretical literature on negative symptoms to inform and identify "treatment targets" to reduce them. The "treatment targets" are then translated into intervention strategies using a cognitive behavioral framework. A review of the empirical literature on cognitive behavior therapy for treating negative symptoms is then offered along with a critical discussion of where cognitive behavior therapy stands compared to other interventions and what research is still needed.

Disrupted salience processing involved in motivational deficits for real-life activities in patients with schizophrenia

Motivational deficits in patients with schizophrenia adversely affect various domains of daily living. This symptom in everyday life situations manifests in a complex behavioral pattern whose root cannot be simplified to an impaired reward-motivation scheme. This study aimed to identify impairment of the salience network that underlies motivational deficits seen in patients with schizophrenia in real-life situations. During the functional magnetic resonance imaging scan, 20 patients with schizophrenia and 20 normal controls performed a task mimicking real-life situations, in which an avatar proposed participation in a daily activity with either an intrinsic or extrinsic reward. Group and type-of-reward effects were evaluated with respect to brain activity. Further, psychophysiological interactions were analyzed for the dorsal anterior cingulate cortex (dACC) and insula, which are the key nodes of the salience network. The acceptance of the proposal was significantly higher for intrinsic than for extrinsic rewards in controls, whereas patients showed no difference. The imaging results showed a group effect in the dACC, right insula, thalamus, and lingual gyrus. The dACC showed negative contrast interaction with regions of the left dorsolateral prefrontal cortex, and the right insula showed positive contrast interaction with the occipital gyrus and precentral gyrus. These results suggest that patients exhibit no different participation behavior between activities with intrinsic and extrinsic rewards, which can be explained by the floor effect. Disrupted salience processing in schizophrenia including aberrant salience network and a disconnection of the salience and reward networks may account for the lack of motivation for daily activities.

Dissociation between affective experience and motivated behaviour in schizophrenia patients and their unaffected first-degree relatives and schizotypal individuals

BACKGROUND

The neuropsychological origins of negative syndrome of schizophrenia remain elusive. Evidence from behavioural studies, which utilised emotion-inducing pictures to elicit motivated behaviour generally reported that that schizophrenia patients experienced similar affective experience as healthy individuals but failed to translate emotional salience to motivated behaviour, a phenomenon called emotion-behaviour decoupling. However, a few studies have examined emotion-behaviour decoupling in non-psychotic high-risk populations, who are relatively unaffected by medication effects.

METHODS

In this study, we examined the nature and extent of emotion-behaviour decoupling in in three independent samples (65 schizophrenia patients v. 63 controls; 40 unaffected relatives v. 45 controls; and 32 individuals with social anhedonia v. 32 controls). We administered an experimental task to examine their affective experience and its coupling with behaviour, using emotion-inducing slides, and allowed participants to alter stimulus exposure using button-pressing to seek pleasure or avoid aversion.

RESULTS

Schizophrenia patients reported similar affective experiences as their controls, while their unaffected relatives and individuals with high levels of social anhedonia exhibited attenuated affective experiences, in particular in the arousal aspect. Compared with their respective control groups, all of the three groups showed emotion-behaviour decoupling.

CONCLUSIONS

Our findings support that both genetically and behaviourally high-risk groups exhibit emotion-behaviour decoupling. The familial association apparently supports its role as a putative trait marker for schizophrenia.

The impact of reward on attention in schizophrenia

Traditionally, attention was thought to be directed by either top-down goals or bottom-up salience. Recent studies have shown that the reward history of a stimulus feature also acts as a powerful attentional cue. This is particularly relevant in schizophrenia, which is characterized by motivational and attentional deficits. Here, we examine the impact of reward on selective attention. Forty-eight people with schizophrenia (PSZ) and 34 non-psychiatric control subject (NCS) discriminated the location of a target dot appearing inside a left circle or right circle. The circles were different colors, one of which was associated with reward via pre-training. In the first 2 blocks, targets were equally likely to appear in the left or right circle. In the last 4 blocks, the target was 75% likely on one side, thus allowing us to separately examine how attention was impacted by reward (color) and probability (location). PSZ had slower overall reaction times (RTs) than NCS. Both groups showed robust effects of spatial probability and reward history, with faster RTs for the rewarded color and for the more probable location. These effects were similar in PSZ and NCS. Negative symptom severity correlated with overall RT slowing, but there were no correlations between symptoms and reward-associated biasing of attention. PSZ demonstrated RT slowing but normal reward history and spatial probability-driven RT facilitation. These results are conceptually similar to prior findings showing intact implicit reward effects on response bias, and suggest that implicit processing of reward and probability is intact in PSZ.

Increased conflict-induced slowing, but no differences in conflict-induced positive or negative prediction error learning in patients with schizophrenia

People with schizophrenia (PSZ) often fail to pursue rewarding activities despite largely intact in-the-moment hedonic experiences. Deficits in effort-based decision making in PSZ may be related to enhanced effects of cost or reduced reward, i.e., through the amplification of negative prediction errors or by dampened positive prediction errors (here, positive and negative prediction errors refer to outcomes that are better or worse than expected respectively). We administered a modified Simon task to people with schizophrenia (PSZ; N = 46) and healthy controls (N = 32). The modification included a reinforcement learning component, where positive and negative prediction errors are dampened or boosted through the use of cognitively-effortful response conflict. EEG was recorded concurrently to investigate potential differences in conflict enhanced mid-frontal theta power between PSZ and controls. We found an enhanced effect of response conflict on response time in people with schizophrenia, but no discernible difference in conflict processing as reflected by the lack of a difference in theta-power enhancement to conflict in mid-frontal regions. Using the reinforcement learning transfer phase of the modified Simon task, PSZ also showed clear deficits in selecting the most rewarding stimulus during the 'easy' (most discriminable in terms of value) stimulus contrasts. However, we failed to find a difference between patients and controls in their gain or avoidance learning bias, nor did these biases correlate with negative symptoms. Previous studies had failed to find significant conflict effects on the Simon task likely due to its modest effect size. Our results show that PSZ do indeed possess subtle impairments in response-conflict, suggesting an increase in cognitive effort required for appropriate responding. In addition, while the lack of an overt positive or negative prediction error bias (i.e., a bias towards punishment or reward learning) was unexpected, it is consistent with recent work showing intact estimation of value when the reinforcement learning system is isolated from other contributors to value learning.

Anhedonia in depression and schizophrenia: A transdiagnostic challenge

BACKGROUND

Anhedonia, as a dysregulation of the reward circuit, is present in both Major Depressive Disorder (MDD) and schizophrenia (SZ).

AIMS

To elucidate the clinical and neurobiological differences between schizophrenia (SZ) and depression (MDD) in regard to anhedonia, while reconciling the challenges and benefits of assessing anhedonia as a transdiagnostic feature under the Research Domain Criteria (RDoC) framework.

METHODS

In this review, we summarize data from publications examining anhedonia or its underlying reward deficits in SZ and MDD. A literature search was conducted in OVID Medline, PsycINFO and EMBASE databases between 2000 and 2017.

RESULTS

While certain subgroups share commonalities, there are also important differences. SZ may be characterized by a disorganization, rather than a deficiency, in reward processing and cognitive function, including inappropriate energy expenditure and focus on irrelevant cues. In contrast, MDD has been characterized by deficits in anticipatory pleasure, development of reward associations, and integration of information from past experience. Understanding the roles of neurotransmitters and aberrant brain circuitry is necessary to appreciate differences in reward function in SZ and MDD.

CONCLUSION

Anhedonia as a clinical presentation of reward circuit dysregulation is an important and relatively undertreated symptom of both SZ and MDD. In order to improve patient outcomes and quality of life, it is important to consider how anhedonia fits into both diagnoses.

Impaired Expected Value Computations Coupled With Overreliance on Stimulus-Response Learning in Schizophrenia

BACKGROUND

While many have emphasized impaired reward prediction error signaling in schizophrenia, multiple studies suggest that some decision-making deficits may arise from overreliance on stimulus-response systems together with a compromised ability to represent expected value. Guided by computational frameworks, we formulated and tested two scenarios in which maladaptive representations of expected value should be most evident, thereby delineating conditions that may evoke decision-making impairments in schizophrenia.

METHODS

In a modified reinforcement learning paradigm, 42 medicated people with schizophrenia and 36 healthy volunteers learned to select the most frequently rewarded option in a 75-25 pair: once when presented with a more deterministic (90-10) pair and once when presented with a more probabilistic (60-40) pair. Novel and old combinations of choice options were presented in a subsequent transfer phase. Computational modeling was employed to elucidate contributions from stimulus-response systems (actor-critic) and expected value (Q-learning).

RESULTS

People with schizophrenia showed robust performance impairments with increasing value difference between two competing options, which strongly correlated with decreased contributions from expected value-based learning (Q-learning). Moreover, a subtle yet consistent contextual choice bias for the probabilistic 75 option was present in people with schizophrenia, which could be accounted for by a context-dependent reward prediction error in the actor-critic.

CONCLUSIONS

We provide evidence that decision-making impairments in schizophrenia increase monotonically with demands placed on expected value computations. A contextual choice bias is consistent with overreliance on stimulus-response learning, which may signify a deficit secondary to the maladaptive representation of expected value. These results shed new light on conditions under which decision-making impairments may arise.

Social motivation in people with recent-onset schizophrenia spectrum disorders

People with schizophrenia-spectrum disorders (SSD) often experience impairments in non-social motivation. In this study, we extended this line of investigation by examining specific components of social motivation and the extent to which these components work together in people with and without a recent-onset SSD. Sixty-four people with a recent-onset SSD and 26 controls completed a task that allowed us to examine changes in anticipated pleasure, decisions to trust, and effort expenditure over the course of repeated interactions with positive or negative outcomes. Compared to controls, we found that people in the SSD group placed less trust, tended to anticipate less pleasure, and expended less effort to increase the likelihood of future interactions with positive outcomes. Further, in the SSD group, effort expenditure was not associated with either anticipated pleasure or decisions to trust. While there were no group differences in anticipated pleasure or trust placed during interactions with negative outcomes, people in the SSD group expended less effort to decrease to the likelihood of future interactions. Taken together, our findings suggest that people with a recent-onset SSD may experience both impairment and disconnection between various components of social motivation for interactions with positive outcomes. Implications for interventions for social engagement in people with SSD are discussed.

Meta-analytic evidence for altered mesolimbic responses to reward in schizophrenia

Dysfunction of reward-related neural circuitry in schizophrenia (SCZ) has been widely reported, and may provide insight into the motivational and cognitive disturbances that characterize the disorder. Although previous meta-analyses of reward learning paradigms in SCZ have been performed, a meta-analysis of whole-brain coordinate maps in SCZ alone has not been conducted. In this study, we performed an activation likelihood estimate (ALE) meta-analysis, and performed a follow-up analysis of functional connectivity and functional decoding of identified regions. We report several salient findings that extend prior work in this area. First, an alteration in reward-related activation was observed in the right ventral striatum, but this was not solely driven by hypoactivation in the SCZ group compared to healthy controls. Second, the region was characterized by functional connectivity primarily with the lateral prefrontal cortex and pre-supplementary motor area (preSMA), as well as subcortical regions such as the thalamus which show structural deficits in SCZ. Finally, although the meta-analysis showed no regions outside the ventral striatum to be significantly altered, regions with higher functional connectivity with the ventral striatum showed a greater number of subthreshold foci. Together, these findings confirm the alteration of ventral striatal function in SCZ, but suggest that a network-based approach may assist future analysis of the functional underpinnings of the disorder.

Impairments in action-outcome learning in schizophrenia

Learning the causal relation between actions and their outcomes (AO learning) is critical for goal-directed behavior when actions are guided by desire for the outcome. This can be contrasted with habits that are acquired by reinforcement and primed by prevailing stimuli, in which causal learning plays no part. Recently, we demonstrated that goal-directed actions are impaired in schizophrenia; however, whether this deficit exists alongside impairments in habit or reinforcement learning is unknown. The present study distinguished deficits in causal learning from reinforcement learning in schizophrenia. We tested people with schizophrenia (SZ, n = 25) and healthy adults (HA, n = 25) in a vending machine task. Participants learned two action-outcome contingencies (e.g., push left to get a chocolate M&M, push right to get a cracker), and they also learned one contingency was degraded by delivery of noncontingent outcomes (e.g., free M&Ms), as well as changes in value by outcome devaluation. Both groups learned the best action to obtain rewards; however, SZ did not distinguish the more causal action when one AO contingency was degraded. Moreover, action selection in SZ was insensitive to changes in outcome value unless feedback was provided, and this was related to the deficit in AO learning. The failure to encode the causal relation between action and outcome in schizophrenia occurred without any apparent deficit in reinforcement learning. This implies that poor goal-directed behavior in schizophrenia cannot be explained by a more primary deficit in reward learning such as insensitivity to reward value or reward prediction errors.

Avolition-Apathy and White Matter Connectivity in Schizophrenia: Reduced Fractional Anisotropy Between Amygdala and Insular Cortex

The avolition/apathy domain of negative symptoms includes motivation- and pleasure-related impairments. In people with schizophrenia, structural and functional abnormalities were reported in key regions within the motivational reward system, including ventral-tegmental area (VTA), striatum (especially at the level of the nucleus accumbens, NAcc), orbitofrontal cortex (OFC), as well as amygdala (Amy) and insular cortex (IC). However, the association of the reported abnormalities with avoliton-apathy is still controversial. In the present study, we investigated white matter connectivity patterns within these regions, using a probabilistic analysis of diffusion tensor imaging (DTI) data, in male subjects with schizophrenia. Thirty-five male subjects with schizophrenia (SCZ) and 17 male healthy controls (HC) matched for age, underwent DTI. SCZ were evaluated using the Schedule for Deficit Syndrome (SDS), the Positive and Negative Syndrome Scale (PANSS), and the MATRICS Consensus Cognitive Battery (MCCB). Probabilistic tractography was applied to investigate pathways connecting the Amy and the NAcc with the OFC and IC. Reduced fractional anisotropy (FA) was observed in left Amy-ventral anterior IC connections, in SCZ compared with controls. This abnormality was negatively correlated with avolition/apathy but not with expressive deficit scores. SCZ showed also a reduced connectivity index between right NAcc and medial OFC, as compared with controls. Finally, the left NAcc-dorsal anterior IC connectivity index was negatively correlated with working memory scores. Our results indicate that only the avolition/apathy domain of negative symptoms is related to abnormal connectivity in the motivation-related circuits. The findings also demonstrate that distinct alterations underlie cognitive impairment and avolition/apathy.

Prefrontal cortical thinning links to negative symptoms in schizophrenia via the ENIGMA consortium

BACKGROUND

Our understanding of the complex relationship between schizophrenia symptomatology and etiological factors can be improved by studying brain-based correlates of schizophrenia. Research showed that impairments in value processing and executive functioning, which have been associated with prefrontal brain areas [particularly the medial orbitofrontal cortex (MOFC)], are linked to negative symptoms. Here we tested the hypothesis that MOFC thickness is associated with negative symptom severity.

METHODS

This study included 1985 individuals with schizophrenia from 17 research groups around the world contributing to the ENIGMA Schizophrenia Working Group. Cortical thickness values were obtained from T1-weighted structural brain scans using FreeSurfer. A meta-analysis across sites was conducted over effect sizes from a model predicting cortical thickness by negative symptom score (harmonized Scale for the Assessment of Negative Symptoms or Positive and Negative Syndrome Scale scores).

RESULTS

Meta-analytical results showed that left, but not right, MOFC thickness was significantly associated with negative symptom severity (β std = -0.075; p = 0.019) after accounting for age, gender, and site. This effect remained significant (p = 0.036) in a model including overall illness severity. Covarying for duration of illness, age of onset, antipsychotic medication or handedness weakened the association of negative symptoms with left MOFC thickness. As part of a secondary analysis including 10 other prefrontal regions further associations in the left lateral orbitofrontal gyrus and pars opercularis emerged.

CONCLUSIONS

Using an unusually large cohort and a meta-analytical approach, our findings point towards a link between prefrontal thinning and negative symptom severity in schizophrenia. This finding provides further insight into the relationship between structural brain abnormalities and negative symptoms in schizophrenia.

Anticipated pleasure for positive and negative social interaction outcomes in schizophrenia

While recent research suggests that people with schizophrenia anticipate less pleasure for non-social events, considerably less is known about anticipated pleasure for social events. In this study, we investigated whether people with and without schizophrenia differ in the amount and updating of anticipated pleasure over the course of repeated interactions as well as the influence of emotional displays. Thirty-two people with schizophrenia and 29 controls rated their anticipated pleasure over the course of repeated interactions with smiling, scowling, or neutral social partners that had either positive or negative outcomes. Compared to controls, people with schizophrenia anticipated a lower amount of pleasure during interactions with smiling, but not neutral social partners that had positive outcomes. However, the groups did not differ in the amount or updating of anticipated pleasure during interactions that had negative outcomes. Both groups anticipated more pleasure over the course of repeated interactions with smiling partners and less pleasure over the course of repeated interactions with scowling partners compared to interactions with neutral partners. We discuss how less anticipated pleasure for interactions with smiling social partners may be linked to difficulties in social engagement among people with schizophrenia.

Using Functional Analysis as a Framework to Guide Individualized Treatment for Negative Symptoms

Although numerous interventions are available for negative symptoms, outcomes have been unsatisfactory with pharmacological and psychological interventions producing changes of only limited clinical significance. Here, we argue that because negative symptoms occur as a complex syndrome caused and maintained by numerous factors that vary between individuals they are unlikely to be treated effectively by the present "one size fits all" approaches. Instead, a well-founded selection of those interventions relevant to each individual is needed to optimize both the efficiency and the efficacy of existing approaches. The concept of functional analysis (FA) can be used to structure existing knowledge so that it can guide individualized treatment planning. FA is based on stimulus-response learning mechanisms taking into account the characteristics of the organism that contribute to the responses, their consequences and the contingency with which consequences are tied to the response. FA can thus be flexibly applied to the level of individual patients to understand the factors causing and maintaining negative symptoms and derive suitable interventions. In this article we will briefly introduce the concept of FA and demonstrate-exemplarily-how known psychological and biological correlates of negative symptoms can be incorporated into its framework. We then outline the framework's implications for individual assessment and treatment. Following the logic of FA, we argue that a detailed assessment is needed to identify the key factors causing or maintaining negative symptoms for each individual patient. Interventions can then be selected according to their likelihood of changing these key factors and need to take interactions between different factors into account. Supplementary case vignettes exemplify the usefulness of functional analysis for individual treatment planning. Finally, we discuss and point to avenues for future research guided by this model.

Developmental Changes in Learning: Computational Mechanisms and Social Influences

Our ability to learn from the outcomes of our actions and to adapt our decisions accordingly changes over the course of the human lifespan. In recent years, there has been an increasing interest in using computational models to understand developmental changes in learning and decision-making. Moreover, extensions of these models are currently applied to study socio-emotional influences on learning in different age groups, a topic that is of great relevance for applications in education and health psychology. In this article, we aim to provide an introduction to basic ideas underlying computational models of reinforcement learning and focus on parameters and model variants that might be of interest to developmental scientists. We then highlight recent attempts to use reinforcement learning models to study the influence of social information on learning across development. The aim of this review is to illustrate how computational models can be applied in developmental science, what they can add to our understanding of developmental mechanisms and how they can be used to bridge the gap between psychological and neurobiological theories of development.

A little rein on addiction

Rewarding and aversive experiences influence emotions, motivate specific behaviors, and modify future action in animals. Multiple conserved vertebrate neural circuits have been discovered that act in a species-specific manner to reinforce behaviors that are rewarding, while attenuating those with an adverse outcome. A growing body of research now suggests that malfunction of the same circuits is an underlying cause for many human disorders and mental ailments. The habenula (Latin for "little rein") complex, an epithalamic structure that regulates midbrain monoaminergic activity has emerged in recent years as one such region in the vertebrate brain that modulates behavior. Its dysfunction, on the other hand, is implicated in a spectrum of psychiatric disorders in humans such as schizophrenia, depression and addiction. Here, I review the progress in identification of potential mechanisms involving the habenula in addiction.

Motivational Deficits in Schizophrenia Are Associated With Reduced Differentiation Between Gain and Loss-Avoidance Feedback in the Striatum

BACKGROUND

The current study was designed to test the hypothesis that motivational deficits in schizophrenia (SZ) are tied to a reduced ability to differentially signal gains and instances of loss-avoidance in the brain, leading to reduced ability to form adaptive representations of expected value.

METHODS

We administered a reinforcement learning paradigm to 27 medicated SZ patients and 27 control subjects in which participants learned three probabilistic discriminations. In regions of interest in reward networks identified a priori, we examined contrasts between trial types with different expected values (e.g., expected gain-nonmonetary) and between outcomes with the same prediction error valence but different experienced values (e.g., gain-loss-avoidance outcome, miss-loss outcome).

RESULTS

Both whole-brain and region of interest analyses revealed that SZ patients showed reduced differentiation between gain and loss-avoidance outcomes in the dorsal anterior cingulate cortex and bilateral anterior insula. That is, SZ patients showed reduced contrasts between positive prediction errors of different objective values in these areas. In addition, we observed significant correlations between gain-loss-avoidance outcome contrasts in the ventral striatum and ratings for avolition/anhedonia and between expected gain-nonmonetary contrasts in the ventral striatum and ventromedial prefrontal cortex.

CONCLUSIONS

These results provide further evidence for intact prediction error signaling in medicated SZ patients, especially with regard to loss-avoidance. By contrast, components of frontostriatal circuits appear to show reduced sensitivity to the absolute valence of expected and experienced outcomes, suggesting a mechanism by which motivational deficits may emerge.

Computational approaches to schizophrenia: A perspective on negative symptoms

Schizophrenia is a heterogeneous spectrum disorder often associated with detrimental negative symptoms. In recent years, computational approaches to psychiatry have attracted growing attention. Negative symptoms have shown some overlap with general cognitive impairments and were also linked to impaired motivational processing in brain circuits implementing reward prediction. In this review, we outline how computational approaches may help to provide a better understanding of negative symptoms in terms of the potentially underlying behavioural and biological mechanisms. First, we describe the idea that negative symptoms could arise from a failure to represent reward expectations to enable flexible behavioural adaptation. It has been proposed that these impairments arise from a failure to use prediction errors to update expectations. Important previous studies focused on processing of so-called model-free prediction errors where learning is determined by past rewards only. However, learning and decision-making arise from multiple cognitive mechanisms functioning simultaneously, and dissecting them via well-designed tasks in conjunction with computational modelling is a promising avenue. Second, we move on to a proof-of-concept example on how generative models of functional imaging data from a cognitive task enable the identification of subgroups of patients mapping on different levels of negative symptoms. Combining the latter approach with behavioural studies regarding learning and decision-making may allow the identification of key behavioural and biological parameters distinctive for different dimensions of negative symptoms versus a general cognitive impairment. We conclude with an outlook on how this computational framework could, at some point, enrich future clinical studies.

Individual negative symptoms and domains - Relevance for assessment, pathomechanisms and treatment

The negative symptoms of schizophrenia can be divided into two domains. Avolition/apathy includes the individual symptoms of avolition, asociality and anhedonia. Diminished expression includes blunted affect and alogia. Until now, causes and treatment of negative symptoms have remained a major challenge, which is partially related to the focus on negative symptoms as a broad entity. Here, we propose that negative symptoms may become more tractable when the different domains and individual symptoms are taken into account. There is now increasing evidence that the relationship with clinical variables - in particular outcome - differs between the domains of avolition/apathy and diminished expression. Regarding models of negative symptom formation, those relevant to avolition/apathy are now converging on processes underlying goal-directed behavior and dysfunctions of the reward system. In contrast, models of the diminished expression domains are only beginning to emerge. The aim of this article is to review the specific clinical, behavioral and neural correlates of individual symptoms and domains as a better understanding of these areas may facilitate specific treatment approaches.

Allocating effort and anticipating pleasure in schizophrenia: Relationship with real world functioning

BACKGROUND

Poor motivation to engage in goal-oriented behavior has been recognized as a hallmark feature of schizophrenia spectrum disorders (SZ). Low drive in SZ may be related to anticipating rewards as well as to poor working memory. However, few studies to date have examined beliefs about self-efficacy and satisfaction for future rewards (anticipatory pleasure). Additionally, few studies to date have examined how these deficits may impact SZ patients' real world functioning.

METHOD

The present study examined SZ patients' (n=57) anticipatory pleasure, working memory, self-efficacy and real world functioning in relation to their negative symptom severity.

RESULTS

Results revealed that SZ patients' negative symptom severity was related to decisions in effort allocation and reward probability, working memory deficits, self-efficacy and anticipatory pleasure for future reward. Effort allocation deficits also predicted patients' daily functioning skills.

CONCLUSIONS

SZ patients with high levels of negative symptoms are not merely effort averse, but have more difficulty effectively allocating effort and anticipating pleasure engaging in effortful activities. It may be the case that continuously failing to achieve reinforcement from engagement and participation may lead SZ patients to form certain negative beliefs about their abilities which contributes to amotivation and cognitive deficits. Lastly, our findings provide further support for a link between SZ patients functional daily living skills their effort allocation.

Paradigms for Assessing Hedonic Processing and Motivation in Humans: Relevance to Understanding Negative Symptoms in Psychopathology

Clinicians and researchers have long known that one of the debilitating aspects of psychotic disorders is the presence of "negative symptoms," which involve impairments in hedonic and motivational function, and/or alterations in expressive affect. We have a number of excellent clinical tools available for assessing the presence and severity of negative symptoms. However, to better understand the mechanisms that may give rise to negative symptoms, we need tools and methods that can help distinguish among different potential contributing causes, as a means to develop more targeted intervention pathways. Using such paradigms is particularly important if we wish to understand whether the causes are the same or different across disorders that may share surface features of negative symptoms. This approach is in line with the goals of the Research Diagnostic Criteria Initiative, which advocates understanding the nature of core dimensions of brain-behavior relationships transdiagnostically. Here we highlight some of the emerging measures and paradigms that may help us to parse the nature and causes of negative symptoms, illustrating both the research approaches from which they emerge and the types of constructs that they can help elucidate.

Explicit and implicit reinforcement learning across the psychosis spectrum

Motivational and hedonic impairments are core features of a variety of types of psychopathology. An important aspect of motivational function is reinforcement learning (RL), including implicit (i.e., outside of conscious awareness) and explicit (i.e., including explicit representations about potential reward associations) learning, as well as both positive reinforcement (learning about actions that lead to reward) and punishment (learning to avoid actions that lead to loss). Here we present data from paradigms designed to assess both positive and negative components of both implicit and explicit RL, examine performance on each of these tasks among individuals with schizophrenia, schizoaffective disorder, and bipolar disorder with psychosis, and examine their relative relationships to specific symptom domains transdiagnostically. None of the diagnostic groups differed significantly from controls on the implicit RL tasks in either bias toward a rewarded response or bias away from a punished response. However, on the explicit RL task, both the individuals with schizophrenia and schizoaffective disorder performed significantly worse than controls, but the individuals with bipolar did not. Worse performance on the explicit RL task, but not the implicit RL task, was related to worse motivation and pleasure symptoms across all diagnostic categories. Performance on explicit RL, but not implicit RL, was related to working memory, which accounted for some of the diagnostic group differences. However, working memory did not account for the relationship of explicit RL to motivation and pleasure symptoms. These findings suggest transdiagnostic relationships across the spectrum of psychotic disorders between motivation and pleasure impairments and explicit RL. (PsycINFO Database Record

A Transdiagnostic Review of Negative Symptom Phenomenology and Etiology

In the DSM5, negative symptoms are 1 of the 5 core dimensions of psychopathology evaluated for schizophrenia. However, negative symptoms are not pathognomonic-they are also part of the diagnostic criteria for other schizophrenia-spectrum disorders, disorders that sometimes have comorbid psychosis, diagnoses not in the schizophrenia-spectrum, and the general "nonclinical" population. Although etiological models of negative symptoms have been developed for chronic schizophrenia, there has been little attention given to whether these models have transdiagnostic applicability. In the current review, we examine areas of commonality and divergence in the clinical presentation and etiology of negative symptoms across diagnostic categories. It was concluded that negative symptoms are relatively frequent across diagnostic categories, but individual disorders may differ in whether their negative symptoms are persistent/transient or primary/secondary. Evidence for separate dimensions of volitional and expressive symptoms exists, and there may be multiple mechanistic pathways to the same symptom phenomenon among DSM-5 disorders within and outside the schizophrenia-spectrum (ie, equifinality). Evidence for a novel transdiagnostic etiological model is presented based on the Research Domain Criteria (RDoC) constructs, which proposes the existence of 2 such pathways-a hedonic pathway and a cognitive pathway-that can both lead to expressive or volitional symptoms. To facilitate treatment breakthroughs, future transdiagnostic studies on negative symptoms are warranted that explore mechanisms underlying volitional and expressive pathology.

Learning relative values in the striatum induces violations of normative decision making

To decide optimally between available options, organisms need to learn the values associated with these options. Reinforcement learning models offer a powerful explanation of how these values are learnt from experience. However, human choices often violate normative principles. We suggest that seemingly counterintuitive decisions may arise as a natural consequence of the learning mechanisms deployed by humans. Here, using fMRI and a novel behavioural task, we show that, when suddenly switched to novel choice contexts, participants' choices are incongruent with values learnt by standard learning algorithms. Instead, behaviour is compatible with the decisions of an agent learning how good an option is relative to an option with which it had previously been paired. Striatal activity exhibits the characteristics of a prediction error used to update such relative option values. Our data suggest that choices can be biased by a tendency to learn option values with reference to the available alternatives.

Computational neuroscience approach to biomarkers and treatments for mental disorders

Psychiatry research has long experienced a stagnation stemming from a lack of understanding of the neurobiological underpinnings of phenomenologically defined mental disorders. Recently, the application of computational neuroscience to psychiatry research has shown great promise in establishing a link between phenomenological and pathophysiological aspects of mental disorders, thereby recasting current nosology in more biologically meaningful dimensions. In this review, we highlight recent investigations into computational neuroscience that have undertaken either theory- or data-driven approaches to quantitatively delineate the mechanisms of mental disorders. The theory-driven approach, including reinforcement learning models, plays an integrative role in this process by enabling correspondence between behavior and disorder-specific alterations at multiple levels of brain organization, ranging from molecules to cells to circuits. Previous studies have explicated a plethora of defining symptoms of mental disorders, including anhedonia, inattention, and poor executive function. The data-driven approach, on the other hand, is an emerging field in computational neuroscience seeking to identify disorder-specific features among high-dimensional big data. Remarkably, various machine-learning techniques have been applied to neuroimaging data, and the extracted disorder-specific features have been used for automatic case-control classification. For many disorders, the reported accuracies have reached 90% or more. However, we note that rigorous tests on independent cohorts are critically required to translate this research into clinical applications. Finally, we discuss the utility of the disorder-specific features found by the data-driven approach to psychiatric therapies, including neurofeedback. Such developments will allow simultaneous diagnosis and treatment of mental disorders using neuroimaging, thereby establishing 'theranostics' for the first time in clinical psychiatry.

Modified Mediterranean Diet for Enrichment of Short Chain Fatty Acids: Potential Adjunctive Therapeutic to Target Immune and Metabolic Dysfunction in Schizophrenia?

Growing interest in gut and digestive processes and their potential link to brain and peripheral based inflammation or biobehavioral phenotypes has led to an increasing number of basic and translational scientific reports focused on the role of gut microbiota within the context of neuropsychiatric disorders. However, the effect of dietary modification on specific gut metabolites, in association with immune, metabolic, and psychopathological functioning in schizophrenia spectrum disorders has not been well characterized. The short chain fatty acids (SCFA) acetate, butyrate, and propionate, major metabolites derived from fermentation of dietary fibers by gut microbes, interact with multiple immune and metabolic pathways. The specific pathways that SCFA are thought to target, are dysregulated in cardiovascular disease, type II diabetes, and systemic inflammation. Most notably, these disorders are consistently linked to an attenuated lifespan in schizophrenia. Although, unhealthy dietary intake patterns and increased prevalence of immune and metabolic dysfunction has been observed in people with schizophrenia; dietary interventions have not been well utilized to target immune or metabolic illness. Prior schizophrenia patient trials primarily focused on the effects of gluten free diets. Findings from these studies indicate that a diet avoiding gluten benefits a limited subset of patients, individuals with celiac disease or non-celiac gluten sensitivity. Therefore, alternative dietary and nutritional modifications such as high-fiber, Mediterranean style, diets that enrich the production of SCFA, while being associated with a minimal likelihood of adverse events, may improve immune and cardiovascular outcomes linked to premature mortality in schizophrenia. With a growing literature demonstrating that SCFA can cross the blood brain barrier and target key inflammatory and metabolic pathways, this article highlights enriching dietary intake for SCFA as a potential adjunctive therapy for people with schizophrenia.

The habenula in psychiatric disorders: More than three decades of translational investigation

The habenula is an epithalamic structure located at the center of the dorsal diencephalic conduction system, a pathway involved in linking forebrain to midbrain regions. Composed of a medial and lateral subdivisions, the habenula receives inputs from the limbic system and basal ganglia mainly through the stria medullaris (SM), and projects to midbrain regions through the fasciculus retroflexus (FR). An increasing number of studies have implicated this structure in psychiatric disorders associated with dysregulated reward circuitry function, notably mood disorders, schizophrenia, and substance use disorder. However, despite significant progress in research, the mechanisms underlying the relationship between the habenula and the pathophysiology of psychiatric disorders are far from being fully understood, and still need further investigation. This review provides a closer look at key findings from animal and human studies illustrating the role of the habenula in mood disorders, schizophrenia, and substance use disorder, and discusses the clinical potential of using this structure as a therapeutic target.