1
|
Herms EN, Brown JW, Wisner KM, Hetrick WP, Zald DH, Purcell JR. Modeling Decision-Making in Schizophrenia: Associations Between Computationally Derived Risk Propensity and Self-Reported Risk Perception. Schizophr Bull 2024; 51:133-144. [PMID: 39241701 PMCID: PMC11661947 DOI: 10.1093/schbul/sbae144] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 09/09/2024]
Abstract
BACKGROUND AND HYPOTHESIS Schizophrenia is associated with a decreased pursuit of risky rewards during uncertain-risk decision-making. However, putative mechanisms subserving this disadvantageous risky reward pursuit, such as contributions of cognition and relevant traits, remain poorly understood. STUDY DESIGN Participants (30 schizophrenia/schizoaffective disorder [SZ]; 30 comparison participants [CP]) completed the Balloon Analogue Risk Task (BART). Computational modeling captured subprocesses of uncertain-risk decision-making: Risk Propensity, Prior Belief of Success, Learning Rate, and Behavioral Consistency. IQ, self-reported risk-specific processes (ie, Perceived Risks and Expected Benefit of Risks), and non-risk-specific traits (ie, defeatist beliefs; hedonic tone) were examined for relationships with Risk Propensity to determine what contributed to differences in risky reward pursuit. STUDY RESULTS On the BART, the SZ group exhibited lower Risk Propensity, higher Prior Beliefs of Success, and comparable Learning Rates. Furthermore, Risk Propensity was positively associated with IQ across groups. Linear models predicting Risk Propensity revealed 2 interactions: 1 between group and Perceived Risk, and 1 between IQ and Perceived Risk. Specifically, in both the SZ group and individuals with below median IQ, lower Perceived Risks was related to lower Risk Propensity. Thus, lower perception of financial risks was associated with a less advantageous pursuit of uncertain-risk rewards. CONCLUSIONS Findings suggest consistently decreased risk-taking on the BART in SZ may reflect risk imperception, the failure to accurately perceive and leverage relevant information to guide the advantageous pursuit of risky rewards. Additionally, our results highlight the importance of cognition in uncertain-risk decision-making.
Collapse
Affiliation(s)
- Emma N Herms
- Department of Psychological & Brain Sciences, Indiana University, Bloomington, IN, USA
| | - Joshua W Brown
- Department of Psychological & Brain Sciences, Indiana University, Bloomington, IN, USA
- Program in Neuroscience, Indiana University, Bloomington, IN, USA
| | - Krista M Wisner
- Department of Psychological & Brain Sciences, Indiana University, Bloomington, IN, USA
- Program in Neuroscience, Indiana University, Bloomington, IN, USA
| | - William P Hetrick
- Department of Psychological & Brain Sciences, Indiana University, Bloomington, IN, USA
- Program in Neuroscience, Indiana University, Bloomington, IN, USA
| | - David H Zald
- Department of Psychiatry, Brain Health Institute, Rutgers University, Piscataway, NJ, USA
| | - John R Purcell
- Department of Psychiatry, Brain Health Institute, Rutgers University, Piscataway, NJ, USA
| |
Collapse
|
2
|
Dong X, Shovestul B, Saxena A, Dudek E, Reda S, Lamberti JS, Dodell-Feder D. Decision-making under risk and its correlates in schizophrenia. Schizophr Res Cogn 2024; 37:100314. [PMID: 38764743 PMCID: PMC11101893 DOI: 10.1016/j.scog.2024.100314] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2023] [Revised: 04/26/2024] [Accepted: 04/30/2024] [Indexed: 05/21/2024]
Abstract
Schizophrenia spectrum disorders (SSD) are associated with pervasive cognitive impairments, including deficits in decision-making under risk. However, there is inconclusive evidence regarding specific mechanisms underlying altered decision-making patterns. In this study, participants (33 SSD and 28 non-SSD) completed the Columbia Card Task, an explicit risk-taking task, to better understand risk preference and adjustment in dynamic decision-making. We found that while there is no group difference in overall risk-taking, risk preference, or optimal decision-making, risk adjustment to contextual factors (e.g., loss probability) is blunted in SSD. We also found associations between risk-taking/suboptimal decision-making and disorganized symptoms, excited symptoms, and role functioning, but no associations between decision-making and working memory. These results suggest that during a complex, dynamic risk-taking task, individuals with SSD exhibit less adaption to changing information about risk, which may reflect risk imperception.
Collapse
Affiliation(s)
- Xiaoyu Dong
- Department of Psychology, University of Rochester, 500 Joseph C. Wilson Blvd, Rochester, NY 14627, United States of America
| | - Bridget Shovestul
- Department of Psychology, University of Rochester, 500 Joseph C. Wilson Blvd, Rochester, NY 14627, United States of America
| | - Abhishek Saxena
- Department of Psychology, University of Rochester, 500 Joseph C. Wilson Blvd, Rochester, NY 14627, United States of America
| | - Emily Dudek
- Department of Psychology, University of Houston, Houston, TX 77204, United States of America
| | - Stephanie Reda
- Department of Psychology, University of Rochester, 500 Joseph C. Wilson Blvd, Rochester, NY 14627, United States of America
| | - J. Steven Lamberti
- Department of Psychiatry, University of Rochester Medical Center, 601 Elmwood Avenue, Rochester, NY 14642, United States of America
| | - David Dodell-Feder
- Department of Psychology, University of Rochester, 500 Joseph C. Wilson Blvd, Rochester, NY 14627, United States of America
- Department of Neuroscience, University of Rochester Medical Center, 601 Elmwood Avenue, Rochester, NY 14642, United States of America
| |
Collapse
|
3
|
Cheng X, Wang L, Lv Q, Wu H, Huang X, Yuan J, Sun X, Zhao X, Yan C, Yi Z. Reduced learning bias towards the reward context in medication-naive first-episode schizophrenia patients. BMC Psychiatry 2022; 22:123. [PMID: 35172748 PMCID: PMC8851841 DOI: 10.1186/s12888-021-03682-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/22/2021] [Accepted: 12/28/2021] [Indexed: 11/22/2022] Open
Abstract
BACKGROUND Reinforcement learning has been proposed to contribute to the development of amotivation in individuals with schizophrenia (SZ). Accumulating evidence suggests dysfunctional learning in individuals with SZ in Go/NoGo learning and expected value representation. However, previous findings might have been confounded by the effects of antipsychotic exposure. Moreover, reinforcement learning also rely on the learning context. Few studies have examined the learning performance in reward and loss-avoidance context separately in medication-naïve individuals with first-episode SZ. This study aimed to explore the behaviour profile of reinforcement learning performance in medication-naïve individuals with first-episode SZ, including the contextual performance, the Go/NoGo learning and the expected value representation performance. METHODS Twenty-nine medication-naïve individuals with first-episode SZ and 40 healthy controls (HCs) who have no significant difference in age and gender, completed the Gain and Loss Avoidance Task, a reinforcement learning task involving stimulus pairs presented in both the reward and loss-avoidance context. We assessed the group difference in accuracy in the reward and loss-avoidance context, the Go/NoGo learning and the expected value representation. The correlations between learning performance and the negative symptom severity were examined. RESULTS Individuals with SZ showed significantly lower accuracy when learning under the reward than the loss-avoidance context as compared to HCs. The accuracies under the reward context (90%win- 10%win) in the Acquisition phase was significantly and negatively correlated with the Scale for the Assessment of Negative Symptoms (SANS) avolition scores in individuals with SZ. On the other hand, individuals with SZ showed spared ability of Go/NoGo learning and expected value representation. CONCLUSIONS Despite our small sample size and relatively modest findings, our results suggest possible reduced learning bias towards reward context among medication-naïve individuals with first-episode SZ. The reward learning performance was correlated with amotivation symptoms. This finding may facilitate our understanding of the underlying mechanism of negative symptoms. Reinforcement learning performance under the reward context may be important to better predict and prevent the development of schizophrenia patients' negative symptom, especially amotivation.
Collapse
Affiliation(s)
- Xiaoyan Cheng
- grid.16821.3c0000 0004 0368 8293Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, 600 South Wanping Road, Shanghai, China ,grid.24516.340000000123704535Clinical Research Center for Mental Disorders, Shanghai Pudong New Area Mental Health Center, School of Medicine, Tongji University, Shanghai, China
| | - Lingling Wang
- grid.9227.e0000000119573309Neuropsychology and Applied Cognitive Neuroscience Laboratory, CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing, China ,grid.410726.60000 0004 1797 8419Department of Psychology, University of Chinese Academy of Sciences, Beijing, China ,grid.22069.3f0000 0004 0369 6365Key Laboratory of Brain Functional Genomics (MOE&STCSM), Affiliated Mental Health Center (ECNU), School of Psychology and Cognitive Science, East China Normal University, 3663 North Zhongshan Road, Shanghai, 200062 China
| | - Qinyu Lv
- grid.16821.3c0000 0004 0368 8293Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, 600 South Wanping Road, Shanghai, China
| | - Haisu Wu
- grid.16821.3c0000 0004 0368 8293Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, 600 South Wanping Road, Shanghai, China
| | - Xinxin Huang
- grid.16821.3c0000 0004 0368 8293Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, 600 South Wanping Road, Shanghai, China
| | - Jie Yuan
- grid.24516.340000000123704535Clinical Research Center for Mental Disorders, Shanghai Pudong New Area Mental Health Center, School of Medicine, Tongji University, Shanghai, China
| | - Xirong Sun
- grid.24516.340000000123704535Clinical Research Center for Mental Disorders, Shanghai Pudong New Area Mental Health Center, School of Medicine, Tongji University, Shanghai, China
| | - Xudong Zhao
- grid.24516.340000000123704535Clinical Research Center for Mental Disorders, Shanghai Pudong New Area Mental Health Center, School of Medicine, Tongji University, Shanghai, China
| | - Chao Yan
- Key Laboratory of Brain Functional Genomics (MOE&STCSM), Affiliated Mental Health Center (ECNU), School of Psychology and Cognitive Science, East China Normal University, 3663 North Zhongshan Road, Shanghai, 200062, China.
| | - Zhenghui Yi
- Shanghai Mental Health Center, Shanghai Jiao Tong University School of Medicine, 600 South Wanping Road, Shanghai, China.
| |
Collapse
|
4
|
Purcell JR, Herms EN, Morales J, Hetrick WP, Wisner KM, Brown JW. A review of risky decision-making in psychosis-spectrum disorders. Clin Psychol Rev 2022; 91:102112. [PMID: 34990988 PMCID: PMC8754677 DOI: 10.1016/j.cpr.2021.102112] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2021] [Revised: 10/29/2021] [Accepted: 12/16/2021] [Indexed: 02/03/2023]
Abstract
The investigation of risky decision-making has a prominent place in clinical science, with sundry behavioral tasks aimed at empirically quantifying the psychological construct of risk-taking. However, use of differing behavioral tasks has resulted in lack of agreement on risky decision-making within psychosis-spectrum disorders, as findings fail to converge upon the typical, binary conceptualization of increased risk-seeking or risk-aversion. The current review synthesizes the behavioral, risky decision-making literature to elucidate how specific task parameters may contribute to differences in task performance, and their associations with psychosis symptomatology and cognitive functioning. A paring of the literature suggests that: 1) Explicit risk-taking may be characterized by risk imperception, evidenced by less discrimination between choices of varying degrees of risk, potentially secondary to cognitive deficits. 2) Ambiguous risk-taking findings are inconclusive with few published studies. 3) Uncertain risk-taking findings, consistently interpreted as more risk-averse, have not parsed risk attitudes from confounding processes that may impact decision-making (e.g. risk imperception, reward processing, motivation). Thus, overgeneralized interpretations of task-specific risk-seeking/aversion should be curtailed, as they may fail to appropriately characterize decision-making phenomena. Future research in psychosis-spectrum disorders would benefit from empirically isolating contributions of specific processes during risky decision-making, including the newly hypothesized risk imperception.
Collapse
Affiliation(s)
- John R Purcell
- Indiana University, Department of Psychological & Brain Sciences, USA; Indiana University, Program in Neuroscience, USA.
| | - Emma N Herms
- Indiana University, Department of Psychological & Brain Sciences, USA
| | - Jaime Morales
- Indiana University, Department of Psychological & Brain Sciences, USA; Indiana University, Program in Neuroscience, USA
| | - William P Hetrick
- Indiana University, Department of Psychological & Brain Sciences, USA; Indiana University, Program in Neuroscience, USA
| | - Krista M Wisner
- Indiana University, Department of Psychological & Brain Sciences, USA; Indiana University, Program in Neuroscience, USA
| | - Joshua W Brown
- Indiana University, Department of Psychological & Brain Sciences, USA; Indiana University, Program in Neuroscience, USA
| |
Collapse
|
5
|
Kim BH, Shin YB, Kyeong S, Lee SK, Kim JJ. Neural Basis of Ambivalence towards Ideal Self-Image in Schizophrenia. Psychiatry Investig 2020; 17:452-459. [PMID: 32403212 PMCID: PMC7265028 DOI: 10.30773/pi.2019.0320] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/01/2019] [Accepted: 03/08/2020] [Indexed: 11/27/2022] Open
Abstract
OBJECTIVE Little has been explored about a reflection towards self-image in schizophrenia, though it can be related to heterogeneous symptoms of the illness. We identified the neural basis of ambivalence towards ideal self-image in patients with schizophrenia. METHODS 20 patients with schizophrenia and 20 healthy controls underwent functional MRI while the self-image reflection tasks of determining whether to agree with sentences describing their actual or ideal self-image that contained one of the adjective pairs with opposite valence. The interaction between the group and ideal ambivalence score was examined, and group differences in functional connectivity related to ambivalence towards ideal self-image were further studied. RESULTS The interaction of group-by-ideal ambivalence score was shown in the dorsal anterior cingulate cortex and dorsolateral prefrontal cortex, where activities were positively correlated with the level of ideal self-image ambivalence in patients, but not in controls. Task-related decrease in functional connectivity was shown between the orbitofrontal cortex and cerebellum in patients. CONCLUSION The process of reflecting on ambivalent ideal self-image in schizophrenia may be related to aberrant prefrontal activity and connectivity. Abnormality in the prefrontal regions that take part in cognitive conflict monitoring and value judgment may underlie the pathophysiology of increased ambivalence towards ideal self-image.
Collapse
Affiliation(s)
- Byung-Hoon Kim
- Institute of Behavioral Science in Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Yu-Bin Shin
- Institute of Behavioral Science in Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Sunghyon Kyeong
- Institute of Behavioral Science in Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Seon-Koo Lee
- Institute of Behavioral Science in Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea
| | - Jae-Jin Kim
- Institute of Behavioral Science in Medicine, Yonsei University College of Medicine, Seoul, Republic of Korea.,Department of Psychiatry, Yonsei University College of Medicine, Seoul, Republic of Korea
| |
Collapse
|
6
|
Clayson PE, Wynn JK, Infantolino ZP, Hajcak G, Green MF, Horan WP. Reward processing in certain versus uncertain contexts in schizophrenia: An event-related potential (ERP) study. JOURNAL OF ABNORMAL PSYCHOLOGY 2019; 128:867-880. [PMID: 31657597 PMCID: PMC6822386 DOI: 10.1037/abn0000469] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Disturbances in motivation are prominent in the clinical presentation of people with schizophrenia and might reflect a disturbance in reward processing. Recent advances in affective neuroscience have subdivided reward processing into distinct components, but there are two limitations of the prior work in schizophrenia. First, studies typically focus on only one component rather than on the unfolding of reward processing across multiple stages. Second, studies have not considered the impact of certainty effects, which represent an important contextual factor that impacts processing. We examined whether individuals with schizophrenia show the typical certainty effects across three phases of reward processing: cue evaluation, feedback anticipation, and feedback receipt. Electroencephalography from 74 healthy controls and 92 people with schizophrenia was recorded during a cued gambling task under conditions in which cues indicated forthcoming reward outcomes that were certain or uncertain. Controls demonstrated the expected certainty effects across each stage. Initial cue evaluation (cue P300) was intact in the schizophrenia group, but people with schizophrenia showed diminished certainty effects during feedback anticipation (stimulus-preceding negativity [SPN]) and receipt (feedback reward positivity [fRewP] and feedback P300). During feedback receipt, event-related potentials in people with schizophrenia were similar to controls for the uncertain context but larger than controls for the certain context. Essentially, people with schizophrenia appeared to process certain feedback as though it were uncertain. These findings show, for the first time, that the fundamental distinction between certain and uncertain contexts is altered in schizophrenia at a neural level. (PsycINFO Database Record (c) 2019 APA, all rights reserved).
Collapse
Affiliation(s)
- Peter E. Clayson
- Veterans Affairs Greater Los Angeles Healthcare System, Los Angeles, CA
- Department of Psychiatry and Biobehavioral Sciences, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA
| | - Jonathan K. Wynn
- Veterans Affairs Greater Los Angeles Healthcare System, Los Angeles, CA
- Department of Psychiatry and Biobehavioral Sciences, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA
| | | | - Greg Hajcak
- Department of Psychology and Biomedical Sciences, Florida State University, Tallahassee, FL
| | - Michael. F. Green
- Veterans Affairs Greater Los Angeles Healthcare System, Los Angeles, CA
- Department of Psychiatry and Biobehavioral Sciences, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA
| | - William P. Horan
- Veterans Affairs Greater Los Angeles Healthcare System, Los Angeles, CA
- Department of Psychiatry and Biobehavioral Sciences, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA
| |
Collapse
|
7
|
Siddiqui I, Saperia S, Fervaha G, Da Silva S, Jeffay E, Zakzanis KK, Agid O, Remington G, Foussias G. Goal-directed planning and action impairments in schizophrenia evaluated in a virtual environment. Schizophr Res 2019; 206:400-406. [PMID: 30471980 DOI: 10.1016/j.schres.2018.10.012] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/14/2018] [Revised: 10/07/2018] [Accepted: 10/18/2018] [Indexed: 11/24/2022]
Abstract
Planning and executing goal-directed behaviours are critical final steps in translating motivation into action. Amotivation is a key feature of schizophrenia, but its impact on goal-directed functioning has not been extensively studied in an objective and ecologically valid manner. To address this, we investigated goal-directed planning and action in schizophrenia using a virtual reality task, the Multitasking in the City Test (MCT). The MCT was administered to 49 outpatients with schizophrenia and 55 healthy controls, and required participants to complete a series of errands in a virtual city. Ability to complete the task as directed was assessed by a performance score based on errands completed and errors committed. Task efficiency was evaluated by the total distance travelled, and an index of path efficiency comparing an optimal route with the traversed route. Schizophrenia participants had lower performance scores, travelled farther, and had reduced path efficiency compared to healthy controls. Greater distance travelled and lower path efficiency in schizophrenia were related to amotivation. Path efficiency in schizophrenia was also related to neurocognition, including planning ability; notably, this relationship appeared to be independent of the relationship with amotivation. Individuals with schizophrenia demonstrated impaired goal-directed planning and action in the context of a simulated everyday errands task, both in terms of reduced capacity to complete errands and reduced efficiency in doing so. The latter may manifest as diminished real-world motivated and functional behaviour in patients with schizophrenia and indicates a specific deficit in the execution of planned behaviour.
Collapse
Affiliation(s)
- Ishraq Siddiqui
- Schizophrenia Division and Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, 250 College St., Toronto, Ontario M5T 1R8, Canada; Institute of Medical Science, Faculty of Medicine, University of Toronto, Medical Sciences Building, 1 King's College Circle, Toronto, Ontario M5S 1A8, Canada.
| | - Sarah Saperia
- Schizophrenia Division and Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, 250 College St., Toronto, Ontario M5T 1R8, Canada
| | - Gagan Fervaha
- Schizophrenia Division and Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, 250 College St., Toronto, Ontario M5T 1R8, Canada; Institute of Medical Science, Faculty of Medicine, University of Toronto, Medical Sciences Building, 1 King's College Circle, Toronto, Ontario M5S 1A8, Canada
| | - Susana Da Silva
- Schizophrenia Division and Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, 250 College St., Toronto, Ontario M5T 1R8, Canada; Institute of Medical Science, Faculty of Medicine, University of Toronto, Medical Sciences Building, 1 King's College Circle, Toronto, Ontario M5S 1A8, Canada
| | - Eliyas Jeffay
- Department of Psychology, University of Toronto Scarborough, 1265 Military Trail, Toronto, Ontario M1C 1A4, Canada
| | - Konstantine K Zakzanis
- Department of Psychology, University of Toronto Scarborough, 1265 Military Trail, Toronto, Ontario M1C 1A4, Canada
| | - Ofer Agid
- Schizophrenia Division and Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, 250 College St., Toronto, Ontario M5T 1R8, Canada; Department of Psychiatry, University of Toronto, 250 College St., Toronto, Ontario M5T 1R8, Canada
| | - Gary Remington
- Schizophrenia Division and Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, 250 College St., Toronto, Ontario M5T 1R8, Canada; Institute of Medical Science, Faculty of Medicine, University of Toronto, Medical Sciences Building, 1 King's College Circle, Toronto, Ontario M5S 1A8, Canada; Department of Psychiatry, University of Toronto, 250 College St., Toronto, Ontario M5T 1R8, Canada
| | - George Foussias
- Schizophrenia Division and Campbell Family Mental Health Research Institute, Centre for Addiction and Mental Health, 250 College St., Toronto, Ontario M5T 1R8, Canada; Institute of Medical Science, Faculty of Medicine, University of Toronto, Medical Sciences Building, 1 King's College Circle, Toronto, Ontario M5S 1A8, Canada; Department of Psychiatry, University of Toronto, 250 College St., Toronto, Ontario M5T 1R8, Canada
| |
Collapse
|
8
|
Alabi OO, Fortunato MP, Fuccillo MV. Behavioral Paradigms to Probe Individual Mouse Differences in Value-Based Decision Making. Front Neurosci 2019; 13:50. [PMID: 30792620 PMCID: PMC6374631 DOI: 10.3389/fnins.2019.00050] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2018] [Accepted: 01/18/2019] [Indexed: 01/08/2023] Open
Abstract
Value-based decision making relies on distributed neural systems that weigh the benefits of actions against the cost required to obtain a given outcome. Perturbations of these systems are thought to underlie abnormalities in action selection seen across many neuropsychiatric disorders. Genetic tools in mice provide a promising opportunity to explore the cellular components of these systems and their molecular foundations. However, few tasks have been designed that robustly characterize how individual mice integrate differential reward benefits and cost in their selection of actions. Here we present a forced-choice, two-alternative task in which each option is associated with a specific reward outcome, and unique operant contingency. We employed global and individual trial measures to assess the choice patterns and behavioral flexibility of mice in response to differing "choice benefits" (modeled as varying reward magnitude ratios) and different modalities of "choice cost" (modeled as either increasing repetitive motor output to obtain reward or increased delay to reward delivery). We demonstrate that (1) mouse choice is highly sensitive to the relative benefit of outcomes; (2) choice costs are heavily discounted in environments with large discrepancies in relative reward; (3) divergent cost modalities are differentially integrated into action selection; (4) individual mouse sensitivity to reward benefit is correlated with sensitivity to reward costs. These paradigms reveal stable individual animal differences in value-based action selection, thereby providing a foundation for interrogating the neural circuit and molecular pathophysiology of goal-directed dysfunction.
Collapse
Affiliation(s)
- Opeyemi O Alabi
- Department of Neuroscience, University of Pennsylvania, Philadelphia, PA, United States.,Neuroscience Graduate Group, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States
| | - Michael P Fortunato
- Department of Neuroscience, University of Pennsylvania, Philadelphia, PA, United States
| | - Marc V Fuccillo
- Department of Neuroscience, University of Pennsylvania, Philadelphia, PA, United States
| |
Collapse
|
9
|
Hernaus D, Frank MJ, Brown EC, Brown JK, Gold JM, Waltz JA. Impaired Expected Value Computations in Schizophrenia Are Associated With a Reduced Ability to Integrate Reward Probability and Magnitude of Recent Outcomes. BIOLOGICAL PSYCHIATRY: COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2018; 4:280-290. [PMID: 30683607 DOI: 10.1016/j.bpsc.2018.11.011] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/09/2018] [Revised: 11/08/2018] [Accepted: 11/27/2018] [Indexed: 01/05/2023]
Abstract
BACKGROUND Motivational deficits in people with schizophrenia (PSZ) are associated with an inability to integrate the magnitude and probability of previous outcomes. The mechanisms that underlie probability-magnitude integration deficits, however, are poorly understood. We hypothesized that increased reliance on "valueless" stimulus-response associations, in lieu of expected value (EV)-based learning, could drive probability-magnitude integration deficits in PSZ with motivational deficits. METHODS Healthy volunteers (n = 38) and PSZ (n = 49) completed a learning paradigm consisting of four stimulus pairs. Reward magnitude (3, 2, 1, 0 points) and probability (90%, 80%, 20%, 10%) determined each stimulus's EV. Following a learning phase, new and familiar stimulus pairings were presented. Participants were asked to select stimuli with the highest reward value. RESULTS PSZ with high motivational deficits made increasingly less optimal choices as the difference in reward value (probability × magnitude) between two competing stimuli increased. Using a previously validated computational hybrid model, PSZ relied less on EV ("Q-learning") and more on stimulus-response learning ("actor-critic"), which correlated with Scale for the Assessment of Negative Symptoms motivational deficit severity. PSZ specifically failed to represent reward magnitude, consistent with model demonstrations showing that response tendencies in the actor-critic were preferentially driven by reward probability. CONCLUSIONS Probability-magnitude deficits in PSZ with motivational deficits arise from underutilization of EV in favor of reliance on valueless stimulus-response associations. Confirmed by our computational hybrid framework, probability-magnitude integration deficits were driven specifically by a failure to represent reward magnitude. This work provides a first mechanistic explanation of complex EV-based learning deficits in PSZ with motivational deficits that arise from an inability to combine information from different reward modalities.
Collapse
Affiliation(s)
- Dennis Hernaus
- Department of Psychiatry and Neuropsychology, School for Mental Health and Neuroscience, Maastricht University, Maastricht, the Netherlands; Maryland Psychiatric Research Center, Department of Psychiatry, University of Maryland School of Medicine, Baltimore, Maryland.
| | - Michael J Frank
- Department of Cognitive, Linguistic, and Psychological Sciences, Brown University, Providence, Rhode Island; Department of Psychiatry and Brown Institute for Brain Science, Brown University, Providence, Rhode Island
| | - Elliot C Brown
- Maryland Psychiatric Research Center, Department of Psychiatry, University of Maryland School of Medicine, Baltimore, Maryland; Institute for Psychology, University of Lübeck, Lübeck, Germany
| | - Jaime K Brown
- Maryland Psychiatric Research Center, Department of Psychiatry, University of Maryland School of Medicine, Baltimore, Maryland
| | - James M Gold
- Maryland Psychiatric Research Center, Department of Psychiatry, University of Maryland School of Medicine, Baltimore, Maryland
| | - James A Waltz
- Maryland Psychiatric Research Center, Department of Psychiatry, University of Maryland School of Medicine, Baltimore, Maryland
| |
Collapse
|