Negative symptoms and the failure to represent the expected reward value of actions: behavioral and computational modeling evidence

Motivational Deficits and Negative Symptoms in Schizophrenia: Concepts and Assessments

Recent years have seen a resurgence of interest in motivational disturbances in schizophrenia . This is largely driven by the recognition that these disturbances are central to the "experiential" subdomain of negative symptoms and are particularly important determinants of functional disability. Research into the causes and treatment of experiential negative symptoms is therefore a high priority. This chapter reviews findings from experimental psychopathology and affective science relevant to understanding the neurobehavioral processes that underlie these negative symptoms. We focus on abnormalities in four processes that have received the most attention as likely contributors: anticipatory pleasure, reward learning, effort-based decision-making, and social motivation. We also review the research literature on pharmacological and psychosocial approaches to reduce functional deficits attributable to negative symptoms. Translational research is beginning to inform the development of new treatments specifically designed to target the experiential subdomain of negative symptoms.

Reinforcement learning deficits in people with schizophrenia persist after extended trials

Previous research suggests that people with schizophrenia have difficulty learning from positive feedback and when learning needs to occur rapidly. However, they seem to have relatively intact learning from negative feedback when learning occurs gradually. Participants are typically given a limited amount of acquisition trials to learn the reward contingencies and then tested about what they learned. The current study examined whether participants with schizophrenia continue to display these deficits when given extra time to learn the contingences. Participants with schizophrenia and matched healthy controls completed the Probabilistic Selection Task, which measures positive and negative feedback learning separately. Participants with schizophrenia showed a deficit in learning from both positive feedback and negative feedback. These reward learning deficits persisted even if people with schizophrenia are given extra time (up to 10 blocks of 60 trials) to learn the reward contingencies. These results suggest that the observed deficits cannot be attributed solely to slower learning and instead reflect a specific deficit in reinforcement learning.

Amotivation in schizophrenia: integrated assessment with behavioral, clinical, and imaging measures

Motivational deficits play a central role in disability caused by schizophrenia and constitute a major unmet therapeutic need. Negative symptoms have previously been linked to hypofunction in ventral striatum (VS), a core component of brain motivation circuitry. However, it remains unclear to what extent this relationship holds for specific negative symptoms such as amotivation, and this question has not been addressed with integrated behavioral, clinical, and imaging measures. Here, 41 individuals with schizophrenia and 37 controls performed a brief, computerized progressive ratio task (PRT) that quantifies effort exerted in pursuit of monetary reward. Clinical amotivation was assessed using the recently validated Clinical Assessment Interview for Negative Symptoms (CAINS). VS function was probed during functional magnetic resonance imaging using a monetary guessing paradigm. We found that individuals with schizophrenia had diminished motivation as measured by the PRT, which significantly and selectively related to clinical amotivation as measured by the CAINS. Critically, lower PRT motivation in schizophrenia was also dimensionally related to VS hypofunction. Our results demonstrate robust dimensional associations between behavioral amotivation, clinical amotivation, and VS hypofunction in schizophrenia. Integrating behavioral measures such as the PRT will facilitate translational efforts to identify biomarkers of amotivation and to assess response to novel therapeutic interventions.

Identifying cognitive remediation change through computational modelling--effects on reinforcement learning in schizophrenia

OBJECTIVE

Converging research suggests that individuals with schizophrenia show a marked impairment in reinforcement learning, particularly in tasks requiring flexibility and adaptation. The problem has been associated with dopamine reward systems. This study explores, for the first time, the characteristics of this impairment and how it is affected by a behavioral intervention-cognitive remediation.

METHOD

Using computational modelling, 3 reinforcement learning parameters based on the Wisconsin Card Sorting Test (WCST) trial-by-trial performance were estimated: R (reward sensitivity), P (punishment sensitivity), and D (choice consistency). In Study 1 the parameters were compared between a group of individuals with schizophrenia (n = 100) and a healthy control group (n = 50). In Study 2 the effect of cognitive remediation therapy (CRT) on these parameters was assessed in 2 groups of individuals with schizophrenia, one receiving CRT (n = 37) and the other receiving treatment as usual (TAU, n = 34).

RESULTS

In Study 1 individuals with schizophrenia showed impairment in the R and P parameters compared with healthy controls. Study 2 demonstrated that sensitivity to negative feedback (P) and reward (R) improved in the CRT group after therapy compared with the TAU group. R and P parameter change correlated with WCST outputs. Improvements in R and P after CRT were associated with working memory gains and reduction of negative symptoms, respectively.

CONCLUSION

Schizophrenia reinforcement learning difficulties negatively influence performance in shift learning tasks. CRT can improve sensitivity to reward and punishment. Identifying parameters that show change may be useful in experimental medicine studies to identify cognitive domains susceptible to improvement.

Mind matters: placebo enhances reward learning in Parkinson's disease

Expectations have a powerful influence on how we experience the world. Neurobiological and computational models of learning suggest that dopamine is crucial for shaping expectations of reward and that expectations alone may influence dopamine levels. However, because expectations and reinforcers are typically manipulated together, the role of expectations per se has remained unclear. Here, we separated these two factors using a placebo dopaminergic manipulation in Parkinson’s patients. We combined a reward learning task with fMRI to test how expectations of dopamine release modulate learning-related activity in the brain. We found that the mere expectation of dopamine release enhances reward learning and modulates learning-related signals in the striatum and the ventromedial prefrontal cortex. These effects were selective to learning from reward: neither medication nor placebo had an effect on learning to avoid monetary loss. These findings suggest a neurobiological mechanism by which expectations shape learning and affect.

Motivational deficits in individuals at-risk for psychosis and across the course of schizophrenia

Motivational impairment is a critical factor that contributes to functional disability in schizophrenia and undermines an individual's ability to engage in and adhere to effective treatment. However, little is known about the developmental trajectory of deficits in motivation and whether these deficits are present prior to the onset of psychosis. We assessed several components of motivation including anticipatory versus consummatory pleasure (using the Temporal Experience of Pleasure Scale (TEPS)), and behavioral drive, behavioral inhibition, and reward responsivity (using the Behavioral Inhibition Scale/Behavioral Activation Scale (BIS/BAS)). A total of 234 participants completed study measures, including 60 clinical high risk (CHR) participants, 60 recent-onset schizophrenia participants (RO), 78 chronic schizophrenia participants (SZ) and 29 healthy controls (HC) age matched to the CHR group. CHR participants endorsed greater deficits in anticipatory pleasure and reward responsivity, relative to HC comparison participants and individuals diagnosed with schizophrenia. Motivational deficits were not more pronounced over the course of illness. Depressed mood was uniquely associated with impairments in motivation in the CHR sample, but not the schizophrenia participants. The results suggest that CHR individuals experience multiple contributors to impaired motivation, and thus multiple leverage points for treatment.

Do people with schizophrenia have difficulty anticipating pleasure, engaging in effortful behavior, or both?

Motivation deficits are common in schizophrenia, but little is known about underlying mechanisms, or the specific goals that people with schizophrenia set in daily life. Using neurobiological heuristics of pleasure anticipation and effort assessment, we examined the quality of activities and goals of 47 people with and 41 people without schizophrenia, utilizing ecological momentary assessment. Participants were provided cell phones and called 4 times a day for 7 days, and were asked about their current activities and anticipation of upcoming goals. Activities and goals were later coded by independent raters on pleasure and effort. In line with recent laboratory findings on effort computation deficits in schizophrenia, relative to healthy participants, people with schizophrenia reported engaging in less effortful activities and setting less effortful goals, which were related to patient functioning. In addition, patients showed some inaccuracy in estimating how difficult an effortful goal would be, which in turn was associated with lower neurocognition. In contrast to previous research, people with schizophrenia engaged in activities and set goals that were more pleasure-based, and anticipated goals as being more pleasurable than controls. Thus, this study provided evidence for difficulty with effortful behavior and not anticipation of pleasure. These findings may have psychosocial treatment implications, focusing on effort assessment or effort expenditure. For example, to help people with schizophrenia engage in more meaningful goal pursuits, treatment providers may leverage low-effort pleasurable goals by helping patients to break down larger, more complex goals into smaller, lower-effort steps that are associated with specific pleasurable rewards.

Physical activity level and medial temporal health in youth at ultra high-risk for psychosis

A growing body of evidence suggests that moderate to vigorous activity levels can affect quality of life, cognition, and brain structure in patients diagnosed with schizophrenia. However, physical activity has not been systematically studied during the period immediately preceding the onset of psychosis. Given reports of exercise-based neurogenesis in schizophrenia, understanding naturalistic physical activity levels in the prodrome may provide valuable information for early intervention efforts. The present study examined 29 ultra high-risk (UHR) and 27 matched controls to determine relationships between physical activity level, brain structure (hippocampus and parahippocampal gyrus), and symptoms. Participants were assessed with actigraphy for a 5-day period, MRI, and structured clinical interviews. UHR participants showed a greater percentage of time in sedentary behavior while healthy controls spent more time engaged in light to vigorous activity. There was a strong trend to suggest the UHR group showed less total physical activity. The UHR group exhibited smaller medial temporal volumes when compared with healthy controls. Total level of physical activity in the UHR group was moderately correlated with parahippocampal gyri bilaterally (right: r = .44, left: r = .55) and with occupational functioning (r = -.36; of negative symptom domain), but not positive symptomatology. Results suggest that inactivity is associated with medial temporal lobe health. Future studies are needed to determine if symptoms are driving inactivity, which in turn may be affecting the health of the parahippocampal structure and progression of illness. Although causality cannot be determined from the present design, these findings hold important implications for etiological conceptions and suggest promise for an experimental trial.

Using self-determination theory to understand motivation deficits in schizophrenia: the 'why' of motivated behavior

Self-determination theory (SDT) provides a model for understanding motivation deficits in schizophrenia, and recent research has focused on problems with intrinsic motivation. However, SDT emphasizes that motivated behavior results from three different factors: intrinsic motivators (facilitated by needs for autonomy, competency, and relatedness), extrinsic motivators (towards reward or away from punishment), or when intrinsic and extrinsic motivators are absent or thwarted a disconnect-disengagement occurs resulting in behavior driven by boredom or 'passing time'. Using a novel approach to Ecological Momentary Assessment, we assessed the degree to which people with schizophrenia were motivated by these factors relative to healthy control participants. Forty-seven people with and 41 people without schizophrenia were provided with cell phones and were called four times a day for one week. On each call participants were asked about their goals, and about the most important reason motivating each goal. All responses were coded by independent raters (blind to group and hypotheses) on all SDT motivating factors, and ratings were correlated to patient functioning and symptoms. We found that, relative to healthy participants, people with schizophrenia reported goals that were: (1) less motivated by filling autonomy and competency needs, but equivalently motivated by relatedness; (2) less extrinsically rewarding, but equivalently motivated by punishment; (3) more disconnected-disengaged. Higher disconnected-disengaged goals were significantly associated with higher negative symptoms and lower functioning. These findings indicate several important leverage points for behavioral treatments and suggest the need for vigorous psychosocial intervention focusing on autonomy, competence, and reward early in the course of illness.

Reduced activation in ventral striatum and ventral tegmental area during probabilistic decision-making in schizophrenia

Patients with schizophrenia suffer from deficits in monitoring and controlling their own thoughts. Within these so-called metacognitive impairments, alterations in probabilistic reasoning might be one cognitive phenomenon disposing to delusions. However, so far little is known about alterations in associated brain functionality. A previously established task for functional magnetic resonance imaging (fMRI), which requires a probabilistic decision after a variable amount of stimuli, was applied to 23 schizophrenia patients and 28 healthy controls matched for age, gender and educational levels. We compared activation patterns during decision-making under conditions of certainty versus uncertainty and evaluated the process of final decision-making in ventral striatum (VS) and ventral tegmental area (VTA). We replicated a pre-described extended cortical activation pattern during probabilistic reasoning. During final decision-making, activations in several fronto- and parietocortical areas, as well as in VS and VTA became apparent. In both of these regions schizophrenia patients showed a significantly reduced activation. These results further define the network underlying probabilistic decision-making. The observed hypo-activation in regions commonly associated with dopaminergic neurotransmission fits into current concepts of disrupted prediction error signaling in schizophrenia and suggests functional links to reward anticipation. Forthcoming studies with patients at risk for psychosis and drug-naive first episode patients are necessary to elucidate the development of these findings over time and the interplay with associated clinical symptoms.

Translational studies of goal-directed action as a framework for classifying deficits across psychiatric disorders

The ability to learn contingencies between actions and outcomes in a dynamic environment is critical for flexible, adaptive behavior. Goal-directed actions adapt to changes in action-outcome contingencies as well as to changes in the reward-value of the outcome. When networks involved in reward processing and contingency learning are maladaptive, this fundamental ability can be lost, with detrimental consequences for decision-making. Impaired decision-making is a core feature in a number of psychiatric disorders, ranging from depression to schizophrenia. The argument can be developed, therefore, that seemingly disparate symptoms across psychiatric disorders can be explained by dysfunction within common decision-making circuitry. From this perspective, gaining a better understanding of the neural processes involved in goal-directed action, will allow a comparison of deficits observed across traditional diagnostic boundaries within a unified theoretical framework. This review describes the key processes and neural circuits involved in goal-directed decision-making using evidence from animal studies and human neuroimaging. Select studies are discussed to outline what we currently know about causal judgments regarding actions and their consequences, action-related reward evaluation, and, most importantly, how these processes are integrated in goal-directed learning and performance. Finally, we look at how adaptive decision-making is impaired across a range of psychiatric disorders and how deepening our understanding of this circuitry may offer insights into phenotypes and more targeted interventions.

Effort, anhedonia, and function in schizophrenia: reduced effort allocation predicts amotivation and functional impairment

One of the most debilitating aspects of schizophrenia is an apparent interest in or ability to exert effort for rewards. Such "negative symptoms" may prevent individuals from obtaining potentially beneficial outcomes in educational, occupational, or social domains. In animal models, dopamine abnormalities decrease willingness to work for rewards, implicating dopamine (DA) function as a candidate substrate for negative symptoms given that schizophrenia involves dysregulation of the dopamine system. We used the effort-expenditure for rewards task (EEfRT) to assess the degree to which individuals with schizophrenia were wiling to exert increased effort for either larger magnitude rewards or for rewards that were more probable. Fifty-nine individuals with schizophrenia and 39 demographically similar controls performed the EEfRT task, which involves making choices between "easy" and "hard" tasks to earn potential rewards. Individuals with schizophrenia showed less of an increase in effort allocation as either reward magnitude or probability increased. In controls, the frequency of choosing the hard task in high reward magnitude and probability conditions was negatively correlated with depression severity and anhedonia. In schizophrenia, fewer hard task choices were associated with more severe negative symptoms and worse community and work function as assessed by a caretaker. Consistent with patterns of disrupted dopamine functioning observed in animal models of schizophrenia, these results suggest that 1 mechanism contributing to impaired function and motivational drive in schizophrenia may be a reduced allocation of greater effort for higher magnitude or higher probability rewards.

A systems neuroscience perspective of schizophrenia and bipolar disorder

Neuroimaging studies have generated a large body of knowledge regarding the neural correlates of schizophrenia (SZ) and bipolar disorder (BD). However, the initial goal of identifying disease-specific topographical mappings to localized brain regions or to distinct neural networks has not materialized and may be untenable. This contribution will argue that a systems neuroscience approach may prove more fruitful. The supporting evidence presented covers (a) brain structural, functional, and connectivity alterations and their implication for the clinical and cognitive manifestations of SZ and BD, (b) the prevailing system neuroscience models of the 2 disorders, and (c) key hypotheses likely to produce new insights into the mechanisms of underlying psychotic disorders.

The motivation and pleasure dimension of negative symptoms: neural substrates and behavioral outputs

A range of emotional and motivation impairments have long been clinically documented in people with schizophrenia, and there has been a resurgence of interest in understanding the psychological and neural mechanisms of the so-called "negative symptoms" in schizophrenia, given their lack of treatment responsiveness and their role in constraining function and life satisfaction in this illness. Negative symptoms comprise two domains, with the first covering diminished motivation and pleasure across a range of life domains and the second covering diminished verbal and non-verbal expression and communicative output. In this review, we focus on four aspects of the motivation/pleasure domain, providing a brief review of the behavioral and neural underpinnings of this domain. First, we cover liking or in-the-moment pleasure: immediate responses to pleasurable stimuli. Second, we cover anticipatory pleasure or wanting, which involves prediction of a forthcoming enjoyable outcome (reward) and feeling pleasure in anticipation of that outcome. Third, we address motivation, which comprises effort computation, which involves figuring out how much effort is needed to achieve a desired outcome, planning, and behavioral response. Finally, we cover the maintenance emotional states and behavioral responses. Throughout, we consider the behavioral manifestations and brain representations of these four aspects of motivation/pleasure deficits in schizophrenia. We conclude with directions for future research as well as implications for treatment.

Negative symptoms, past and present: a historical perspective and moving to DSM-5

The diagnosis of schizophrenia includes "positive" and "negative" symptoms. These titles were developed to respectively reflect if the symptoms are additions to normal experiences, such as delusions and hallucinations, or if they refer to the absence or the loss of normal emotional function or behavior. This paper describes the history of the negative symptom concept, from its origins up to the considerations for the DSM-5, including the steps that produced the current conceptualizations. The DSM-5 only includes deficits in emotional expression and avolition as negative symptoms, which can be assessed from interview information. Factor analyses show they encompass most other negative symptom items. In addition to using these negative symptoms in a categorical manner to make a diagnosis, the DSM-5 has quantitative severity ratings of the negative symptoms, along with ratings of delusions, cognitive symptoms, motor symptoms, disorganization, depression and mania. With this approach, the different symptom domains, including negative symptoms, can be measured and tracked over time. Another change in the DSM-5 is the dropping of the schizophrenia subtypes that have been included in earlier volumes, as they were not useful in treatment decisions or prognosis. An intended outcome of these changes in DSM-5 is for clinicians to directly treat the individual psychopathological domains of the disorder for optimizing individual outcomes. Finally, this paper includes descriptions of the negative symptom items from over a dozen different scales.

MK-801 Impairs Cognitive Coordination on a Rotating Arena (Carousel) and Contextual Specificity of Hippocampal Immediate-Early Gene Expression in a Rat Model of Psychosis

Flexible behavior in dynamic, real-world environments requires more than static spatial learning and memory. Discordant and unstable cues must be organized in coherent subsets to give rise to meaningful spatial representations. We model this form of cognitive coordination on a rotating arena - Carousel where arena- and room-bound spatial cues are dissociated. Hippocampal neuronal ensemble activity can repeatedly switch between multiple representations of such an environment. Injection of tetrodotoxin into one hippocampus prevents cognitive coordination during avoidance of a stationary room-defined place on the Carousel and increases coactivity of previously unrelated neurons in the uninjected hippocampus. Place avoidance on the Carousel is impaired after systemic administration of non-competitive NMDAr blockers (MK-801) used to model schizophrenia in animals and people. We tested if this effect is due to cognitive disorganization or other effect of NMDAr antagonism such as hyperlocomotion, spatial memory impairment, or general learning deficit. We also examined if the same dose of MK-801 alters patterns of immediate-early gene (IEG) expression in the hippocampus. IEG expression is triggered in neuronal nuclei in a context-specific manner after behavioral exploration and it is used to map activity in neuronal populations. IEG expression is critical for maintenance of synaptic plasticity and memory consolidation. We show that the same dose of MK-801 that impairs spatial coordination of rats on the Carousel also eliminates contextual specificity of IEG expression in hippocampal CA1 ensembles. This effect is due to increased similarity between ensembles activated in different environments, consistent with the idea that it is caused by increased coactivity between neurons, which did not previously fire together. Our data support the proposition of the Hypersynchrony theory that cognitive disorganization in psychosis is due to increased coactivity between unrelated neurons.

A review of reward processing and motivational impairment in schizophrenia

This article reviews and synthesizes research on reward processing in schizophrenia, which has begun to provide important insights into the cognitive and neural mechanisms associated with motivational impairments. Aberrant cortical-striatal interactions may be involved with multiple reward processing abnormalities, including: (1) dopamine-mediated basal ganglia systems that support reinforcement learning and the ability to predict cues that lead to rewarding outcomes; (2) orbitofrontal cortex-driven deficits in generating, updating, and maintaining value representations; (3) aberrant effort-value computations, which may be mediated by disrupted anterior cingulate cortex and midbrain dopamine functioning; and (4) altered activation of the prefrontal cortex, which is important for generating exploratory behaviors in environments where reward outcomes are uncertain. It will be important for psychosocial interventions targeting negative symptoms to account for abnormalities in each of these reward processes, which may also have important interactions; suggestions for novel behavioral intervention strategies that make use of external cues, reinforcers, and mobile technology are discussed.

Impulsivity and risk taking in bipolar disorder and schizophrenia

Impulsive risk taking contributes to deleterious outcomes among clinical populations. Indeed, pathological impulsivity and risk taking are common in patients with serious mental illness, and have severe clinical repercussions including novelty seeking, response disinhibition, aggression, and substance abuse. Thus, the current study seeks to examine self-reported impulsivity (Barratt Impulsivity Scale) and performance-based behavioral risk taking (Balloon Analogue Risk Task) in bipolar disorder and schizophrenia. Participants included 68 individuals with bipolar disorder, 38 with schizophrenia, and 36 healthy controls. Self-reported impulsivity was elevated in the bipolar group compared with schizophrenia patients and healthy controls, who did not differ from each other. On the risk-taking task, schizophrenia patients were significantly more risk averse than the bipolar patients and controls. Aside from the diagnostic group differences, there was a significant effect of antipsychotic (AP) medication within the bipolar group: bipolar patients taking AP medications were more risk averse than those not taking AP medications. This difference in risk taking because of AP medications was not explained by history of psychosis. Similarly, the differences in risk taking between schizophrenia and bipolar disorder were not fully explained by AP effects. Implications for clinical practice and future research are discussed.

Reinforcement learning and dopamine in schizophrenia: dimensions of symptoms or specific features of a disease group?

Abnormalities in reinforcement learning are a key finding in schizophrenia and have been proposed to be linked to elevated levels of dopamine neurotransmission. Behavioral deficits in reinforcement learning and their neural correlates may contribute to the formation of clinical characteristics of schizophrenia. The ability to form predictions about future outcomes is fundamental for environmental interactions and depends on neuronal teaching signals, like reward prediction errors. While aberrant prediction errors, that encode non-salient events as surprising, have been proposed to contribute to the formation of positive symptoms, a failure to build neural representations of decision values may result in negative symptoms. Here, we review behavioral and neuroimaging research in schizophrenia and focus on studies that implemented reinforcement learning models. In addition, we discuss studies that combined reinforcement learning with measures of dopamine. Thereby, we suggest how reinforcement learning abnormalities in schizophrenia may contribute to the formation of psychotic symptoms and may interact with cognitive deficits. These ideas point toward an interplay of more rigid versus flexible control over reinforcement learning. Pronounced deficits in the flexible or model-based domain may allow for a detailed characterization of well-established cognitive deficits in schizophrenia patients based on computational models of learning. Finally, we propose a framework based on the potentially crucial contribution of dopamine to dysfunctional reinforcement learning on the level of neural networks. Future research may strongly benefit from computational modeling but also requires further methodological improvement for clinical group studies. These research tools may help to improve our understanding of disease-specific mechanisms and may help to identify clinically relevant subgroups of the heterogeneous entity schizophrenia.

Fronto-striatal gray matter contributions to discrimination learning in Parkinson's disease

Discrimination learning deficits in Parkinson's disease (PD) have been well-established. Using both behavioral patient studies and computational approaches, these deficits have typically been attributed to dopamine imbalance across the basal ganglia. However, this explanation of impaired learning in PD does not account for the possible contribution of other pathological changes that occur in the disease process, importantly including gray matter loss. To address this gap in the literature, the current study explored the relationship between fronto-striatal gray matter atrophy and learning in PD. We employed a discrimination learning task and computational modeling in order to assess learning rates in non-demented PD patients. Behaviorally, we confirmed that learning rates were reduced in patients relative to controls. Furthermore, voxel-based morphometry imaging analysis demonstrated that this learning impairment was directly related to gray matter loss in discrete fronto-striatal regions (specifically, the ventromedial prefrontal cortex, inferior frontal gyrus and nucleus accumbens). These findings suggest that dopaminergic imbalance may not be the sole determinant of discrimination learning deficits in PD, and highlight the importance of factoring in the broader pathological changes when constructing models of learning in PD.

Using negative feedback to guide behavior: impairments on the first 4 cards of the Wisconsin Card Sorting Test predict negative symptoms of schizophrenia

Research has demonstrated that individuals with schizophrenia fail to appropriately use negative feedback to guide learning. These learning deficits are thought to arise from abnormalities in midbrain dopamine activity. Primary and enduring negative symptoms are also associated with abnormal dopamine activity and are expected to produce more severe deficits in learning when they present in individuals with schizophrenia. The current study examines this matter by comparing individuals with deficit syndrome schizophrenia, which is characterized by primary and enduring negative symptoms, to individuals with nondeficit syndrome schizophrenia and to normal controls in their use of positive feedback and negative feedback to guide learning on the first four cards of the WCST. Participants included 67 individuals with schizophrenia (15 deficit; 52 nondeficit syndrome) and 51 healthy controls. Accuracy data from the first 4 cards of the WCST and measures of global test performance were examined. Individuals with schizophrenia were significantly less accurate than controls in their performance on early (pre-shift) WCST trials, and this impairment was significantly greater in patients with deficit than nondeficit schizophrenia. Additionally, accuracy across the first 4 WCST cards significantly predicted the number of categories completed and percentage of perseverative errors across the entire test. These findings suggest that negative symptoms of schizophrenia are associated with difficulty using negative feedback to adaptively guide behavior, and are consistent with the notion that abnormal DA signaling contributes to the higher-order executive functioning impairments seen in schizophrenia with severe negative symptoms.

Incentive motivation deficits in schizophrenia reflect effort computation impairments during cost-benefit decision-making

BACKGROUND

Motivational impairments are a core feature of schizophrenia and although there are numerous reports studying this feature using clinical rating scales, objective behavioural assessments are lacking. Here, we use a translational paradigm to measure incentive motivation in individuals with schizophrenia.

METHODS

Sixteen stable outpatients with schizophrenia and sixteen matched healthy controls completed a modified version of the Effort Expenditure for Rewards Task that accounts for differences in motoric ability. Briefly, subjects were presented with a series of trials where they may choose to expend a greater amount of effort for a larger monetary reward versus less effort for a smaller reward. Additionally, the probability of receiving money for a given trial was varied at 12%, 50% and 88%. Clinical and other reward-related variables were also evaluated.

RESULTS

Patients opted to expend greater effort significantly less than controls for trials of high, but uncertain (i.e. 50% and 88% probability) incentive value, which was related to amotivation and neurocognitive deficits. Other abnormalities were also noted but were related to different clinical variables such as impulsivity (low reward and 12% probability). These motivational deficits were not due to group differences in reward learning, reward valuation or hedonic capacity.

CONCLUSIONS

Our findings offer novel support for incentive motivation deficits in schizophrenia. Clinical amotivation is associated with impairments in the computation of effort during cost-benefit decision-making. This objective translational paradigm may guide future investigations of the neural circuitry underlying these motivational impairments.

Measuring reinforcement learning and motivation constructs in experimental animals: relevance to the negative symptoms of schizophrenia

The present review article summarizes and expands upon the discussions that were initiated during a meeting of the Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia (CNTRICS; http://cntrics.ucdavis.edu) meeting. A major goal of the CNTRICS meeting was to identify experimental procedures and measures that can be used in laboratory animals to assess psychological constructs that are related to the psychopathology of schizophrenia. The issues discussed in this review reflect the deliberations of the Motivation Working Group of the CNTRICS meeting, which included most of the authors of this article as well as additional participants. After receiving task nominations from the general research community, this working group was asked to identify experimental procedures in laboratory animals that can assess aspects of reinforcement learning and motivation that may be relevant for research on the negative symptoms of schizophrenia, as well as other disorders characterized by deficits in reinforcement learning and motivation. The tasks described here that assess reinforcement learning are the Autoshaping Task, Probabilistic Reward Learning Tasks, and the Response Bias Probabilistic Reward Task. The tasks described here that assess motivation are Outcome Devaluation and Contingency Degradation Tasks and Effort-Based Tasks. In addition to describing such methods and procedures, the present article provides a working vocabulary for research and theory in this field, as well as an industry perspective about how such tasks may be used in drug discovery. It is hoped that this review can aid investigators who are conducting research in this complex area, promote translational studies by highlighting shared research goals and fostering a common vocabulary across basic and clinical fields, and facilitate the development of medications for the treatment of symptoms mediated by reinforcement learning and motivational deficits.

Issues and perspectives in designing clinical trials for negative symptoms in schizophrenia

A number of pharmacological agents for treating negative symptoms in schizophrenia are currently in development. Unresolved questions regarding the design of clinical trials in this area were discussed at an international meeting in Florence, Italy in April 2012. Participants included representatives from academia, the pharmaceutical industry, and the European Medicines Agency (EMA). Prior to the meeting, participants submitted key questions for debate and discussion. Responses to the questions guided the discussion during the meeting. The group reached agreement on a number of issues: (1) study subjects should be under the age of 65; (2) subjects should be excluded for symptoms of depression that do not overlap with negative symptoms; (3) functional measures should not be required as a co-primary in negative symptom trials; (4) information from informants should be included for ratings when available; (5) Phase 2 negative symptom trials should be 12weeks and 26weeks is preferred for Phase 3 trials; (6) prior to entry into a negative symptom study, subjects should demonstrate clinical stability for a period of 4 to 6months by collection of retrospective information; and (7) prior to entry, the stability of negative and positive symptoms should be confirmed prospectively for four weeks or longer. The participants could not reach agreement on whether predominant or prominent negative symptoms should be required for study subjects.

Hypothetical decision making in schizophrenia: the role of expected value computation and "irrational" biases

The aim of the present study was to examine the contributions to decision making (DM) deficits in schizophrenia (SZ) patients of expected value (EV) estimation and loss aversion. Patients diagnosed with SZ (n=46) and healthy controls (n=34) completed two gambling tasks. In one task, participants chose between two options with the same EV across two conditions: Loss frames and Keep frames. A second task involved accepting or rejecting gambles, in which gain and loss amounts varied, determining the EV of each trial. SZ patients showed a reduced "framing effect" relative to controls, as they did not show an increased tendency to gamble when faced with a certain loss. SZ patients also showed a reduced tendency to modify behavior as a function of EV. The degree to which choices tracked EV correlated significantly with several cognitive measures in both patients and controls. SZ patients show distinct deviations from normal behavior under risk when their decisions are based on prospective outcomes. These deviations are two-fold: cognitive deficits prevent value-based DM in more-impaired patients, and in less-impaired patients there is a lack of influence from well-established subjective biases found in healthy people. These abnormalities likely affect everyday DM strategies in schizophrenia patients.

Neural substrates underlying effort computation in schizophrenia

The lack of initiative, drive or effort in patients with schizophrenia is linked to marked functional impairments. However, our assessment of effort and motivation is crude, relying on clinical rating scales based largely on patient recall. In order to better understand the neurobiology of effort in schizophrenia, we need more rigorous measurements of this construct. In the behavioural neuroscience literature, decades of work has been carried out developing various paradigms to examine the neural underpinnings of an animal's willingness to expend effort for a reward. Here, we shall review this literature on the nature of paradigms used in rodents to assess effort, as well as those used in humans. Next, the neurobiology of these effort-based decisions will be discussed. We shall then review what is known about effort in schizophrenia, and what might be inferred from experiments done in other human populations. Lastly, we shall discuss future directions of research that may assist in shedding light on the neurobiology of effort cost computations in schizophrenia.

Negative symptom improvement during cognitive rehabilitation: results from a 2-year trial of Cognitive Enhancement Therapy

Cognitive rehabilitation has shown beneficial effects on cognition in patients with schizophrenia, which may also help to improve negative symptoms due to overlapping pathophysiology between these two domains. To better understand the possible relationship between these areas, we conducted an exploratory analysis of the effects of Cognitive Enhancement Therapy (CET) on negative symptoms. Early course schizophrenia outpatients (n=58) were randomized to 2 years of CET or an Enriched Supportive Therapy (EST) control condition. Results revealed significant and medium-sized (d=0.61) differential improvements favoring CET in overall negative symptoms, particularly social withdrawal, affective flattening, and motor retardation. Neurocognitive improvement was associated with reduced negative symptoms in CET, but not EST patients. No relationships were observed between improvements in emotion processing aspects of social cognition, as measured by the Mayer-Salovey-Caruso Emotional Intelligence Test, and negative symptoms. CET represents an effective cognitive rehabilitation intervention for schizophrenia that may also have benefits to negative symptoms. Future studies specifically designed to examine negative symptoms during the course of cognitive rehabilitation are needed.

Negative symptoms of schizophrenia are associated with abnormal effort-cost computations

BACKGROUND

Decision-making studies show that response selection is influenced by the "effort cost" associated with response alternatives. These effort-cost calculations seem to be mediated by a distributed neural circuit including the anterior cingulate cortex and subcortical targets of dopamine neurons. On the basis of evidence of dysfunction in these systems in schizophrenia (SZ), we examined whether effort-cost computations were impaired in SZ patients and whether these deficits were associated with negative symptoms.

METHODS

Effort-cost decision-making performance was evaluated in 44 patients with SZ and 36 demographically matched control subjects. Subjects performed a computerized task where they were presented with a series of 30 trials in which they could choose between making 20 button presses for $1 or 100 button presses for higher amounts (varying from $3 to $7 across trials). Probability of reward receipt was also manipulated to determine whether certain (100%) or uncertain (50%) reward affected effort-based decision-making.

RESULTS

Patients were less likely than control subjects to select the high-effort response alternative during the 100% probability condition, particularly when the value payoff was highest (i.e., $6 and $7). Patients were also less likely to select the high-effort option on trials after reward in the 50% probability condition. Furthermore, these impairments in effort-cost computations were greatest among patients with elevated negative symptoms. There was no association with haloperidol equivalent dosage.

CONCLUSIONS

The motivational impairments of SZ might be associated with abnormalities in estimating the "cost" of effortful behavior. This increased effort cost might undermine volition.

Impaired prefrontal-basal ganglia functional connectivity and substantia nigra hyperactivity in schizophrenia

BACKGROUND

The theory that prefrontal cortex (PFC) dysfunction in schizophrenia leads to excess subcortical dopamine has generated widespread interest because it provides a parsimonious account for two core features of schizophrenia, cognitive deficits and psychosis, respectively. However, there has been limited empirical validation of this model. Moreover, the identity of the specific subcortical brain regions and circuits that may be impaired as a result of PFC dysfunction and mediate its link to psychosis in schizophrenia remains unclear. We undertook this event-related functional magnetic resonance imaging study to test the hypothesis that PFC dysfunction is associated with altered function of and connectivity with dopamine regulating regions of the basal ganglia.

METHODS

Eighteen individuals with schizophrenia or schizoaffective disorder and 19 healthy control participants completed event-related functional magnetic resonance imaging during working memory. We conducted between-group contrasts of task-evoked, univariate activation maps to identify regions of altered function in schizophrenia. We also compared the groups on the level of functional connectivity between a priori identified PFC and basal ganglia regions to determine if prefrontal disconnectivity in patients was present.

RESULTS

We observed task-evoked hyperactivity of the substantia nigra that occurred in association with prefrontal and striatal hypoactivity in the schizophrenia group. The magnitude of prefrontal functional connectivity with these dysfunctional basal ganglia regions was decreased in the schizophrenia group. Additionally, the level of nigrostriatal functional connectivity predicted the level of psychosis.

CONCLUSIONS

These results suggest that functional impairments of the prefrontal striatonigral circuit may be a common pathway linking the pathogenesis of cognitive deficits and psychosis in schizophrenia.

The processing of emotional stimuli during periods of limited attentional resources in schizophrenia

When participants are asked to attend to two target stimuli in a rapid serial visual presentation sequence, the successful identification of the 1st target (T1) leads to transient impairment in reporting the 2nd target (T2)--this effect is known as the attentional blink (AB). In healthy individuals, this AB effect is either diminished or accentuated when emotional stimuli are presented in the T2 or T1 positions, respectively, suggesting that affective content influences bottom-up (i.e., exogenous) attention. In the current study, we conducted two separate experiments using the Emotional Attentional Blink paradigm where emotional words were presented in the T2 or T1 position to determine whether schizophrenia patients with high and low negative symptoms differ from controls in the extent to which emotional stimuli influence bottom-up attentional processes. Participants included 33 schizophrenia patients and 28 controls in Experiment 1 (T2 Task), and 30 schizophrenia patients and 24 controls in Experiment 2 (T1 Task). In both experiments, patients were divided into high (HI-NEG) and low (LOW-NEG) negative symptom subgroups using the Scale for the Assessment of Negative Symptoms. Results of Experiment 1 indicated that controls and LOW-NEG patients displayed the typical pattern of AB sparing at early lags for emotional relative to neutral words; however, HI-NEG patients showed no difference in T2 accuracy between emotional and neutral stimuli. Results of Experiment 2 indicated that controls and LOW-NEG patients displayed reduced T2 accuracy following unpleasant T1 stimuli, while HI-NEG patients showed no decrement in T2 accuracy after emotional T1s. Across both experiments, findings suggest that emotional stimuli have a bottom-up competitive advantage in LOW-NEG patients and controls; however, this bottom-up advantage is absent in HI-NEG patients.

Emotional Verbal Learning Test: development and psychometric properties

Memory deficits are a common feature of neurological and psychiatric disorders. Measures designed to evaluate memory in clinical populations have distinguished between memory for verbal and visual information; however, few tests assess the recall and recognition of emotional information, despite evidence suggesting that brain regions are differentially involved in memory for emotional and neutral stimuli and that affective disturbances are common in psychiatric and neurological disorders. The present study reports the test development and psychometric properties of the Emotional Verbal Learning Test (EVLT), a new neuropsychological measure that allows for the examination of emotional learning and memory. Psychometric analyses indicated that the EVLT has good internal consistency and test-retest reliability, as well as discriminant validity, clinical utility, and sensitivity to mood-congruency effects. This new measure has potential to be a valuable research and a clinical tool in the assessment of emotional memory and learning in healthy individuals and persons with neuropsychiatric disorders.

Next-generation negative symptom assessment for clinical trials: validation of the Brief Negative Symptom Scale

The current study examined the psychometric properties of the Brief Negative Symptom Scale (BNSS), a next-generation rating instrument developed in response to the NIMH sponsored consensus development conference on negative symptoms. Participants included 100 individuals with a DSM-IV diagnosis of schizophrenia or schizoaffective disorder who completed a clinical interview designed to assess negative, positive, disorganized, and general psychiatric symptoms, as well as functional outcome. A battery of anhedonia questionnaires and neuropsychological tests were also administered. Results indicated that the BNSS has excellent internal consistency and temporal stability, as well as good convergent and discriminant validity in its relationships with other symptom rating scales, functional outcome, self-reported anhedonia, and neuropsychological test scores. Given its brevity (13-items, 15-minute interview) and good psychometric characteristics, the BNSS can be considered a promising new instrument for use in clinical trials.

Cognition-emotion interactions are modulated by working memory capacity in individuals with schizophrenia

Prior research provides evidence for aberrant cognition-emotion interactions in schizophrenia. In the current study, we aimed to extend these findings by administering the "distractor devaluation" task to 40 individuals with schizophrenia and 32 demographically matched healthy controls. The task consisted of a simple visual search task for neutral faces, followed by an evaluative response made for one of the search items (or a novel item) to determine whether prior attentional selection results in a devaluation of a previously unattended stimulus. We also manipulated working memory demands by preceding the search array with a memory array that required subjects to hold 0, 1, or 2 items in working memory while performing the search array and devaluation task, to determine whether the normative process by which attentional states influence evaluative response is limited by working memory capacity. Results indicated that individuals with schizophrenia demonstrated the typical distractor devaluation effect at working memory load 0, suggesting intact evaluative response. However, the devaluation effect was absent at working memory loads of 1 and 2, suggesting that normal evaluative responses can be abolished in people with schizophrenia when working memory capacity is exceeded. Thus, findings provide further evidence for normal evaluative response in schizophrenia, but clarify that these normal experiences may not hold when working memory demands are too high.

Schizophrenia in translation: dissecting motivation in schizophrenia and rodents

The negative symptoms of schizophrenia include deficits in motivation, for which there is currently no treatment available. Animal models provide a powerful tool for identifying the potential pathophysiological mechanisms underlying the motivation deficits of schizophrenia with the aim of discovering novel treatment targets. The success of such an approach critically depends on meticulously detailed analysis of motivational phenotypes in patients and in animal models. Here, we review the results of recent human behavioral and imaging studies of motivation, and we relate those findings to the results from animal studies, including a mouse model of striatal dopamine D2 receptor hyperfunction. The motivational deficit in patients with schizophrenia is not due to an inability to experience pleasure in the moment as hedonic reaction appears intact in patients. Instead, the motivation deficit represents a reduced capacity for anticipating future pleasure resulting from goal-directed action. The diminished anticipation appears to be a consequence of an inability to accurately represent the expected reward values of actions. A strikingly similar phenotype in incentive motivation has also been described in mice with striatal dopamine D2 receptor hyperfunction. These convergent findings identify potential pathophysiological mechanisms that underlie the deficit in anticipatory motivation, and importantly, the mouse model provides a tool for investigating novel treatment strategies, which we discuss here.

Dissociation of response and feedback negativity in schizophrenia: electrophysiological and computational evidence for a deficit in the representation of value

Contrasting theories of schizophrenia propose that the disorder is characterized by a deficit in phasic changes in dopamine activity in response to ongoing events or, alternatively, by a weakness in the representation of the value of responses. Schizophrenia patients have reliably reduced brain activity following incorrect responses but other research suggests that they may have intact feedback-related potentials, indicating that the impairment may be specifically response-related. We used event-related brain potentials and computational modeling to examine this issue by comparing the neural response to outcomes with the neural response to behaviors that predict outcomes in patients with schizophrenia and psychiatrically healthy comparison subjects. We recorded feedback-related activity in a passive gambling task and a time estimation task and error-related activity in a flanker task. Patients' brain activity following an erroneous response was reduced compared to comparison subjects but feedback-related activity did not differ between groups. To test hypotheses about the possible causes of this pattern of results, we used computational modeling of the electrophysiological data to simulate the effects of an overall reduction in patients' sensitivity to feedback, selective insensitivity to positive or negative feedback, reduced learning rate, and a decreased representation of the value of the response given the stimulus on each trial. The results of the computational modeling suggest that schizophrenia patients exhibit weakened representation of response values, possibly due to failure of the basal ganglia to strongly associate stimuli with appropriate response alternatives.