1
|
Saperstein AM, Basaraba CN, Wall MM, Dixon LB, Nossel I, Bello I, Medalia A. Sensitivity and Specificity of Cognitive Health Screening in a Coordinated Specialty Care Setting. Psychiatr Serv 2025:appips20240524. [PMID: 40364638 DOI: 10.1176/appi.ps.20240524] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 05/15/2025]
Abstract
OBJECTIVE Cognitive health should be addressed as part of routine clinical care for people with schizophrenia spectrum disorder, including those with early psychosis. Providers need an efficient workflow that includes screening tools with adequate sensitivity and specificity to facilitate appropriate cognitive symptom management. This study aimed to examine the utility of a cognitive health screening protocol by analyzing data from 102 participants in OnTrackNY, a specialized network of programs for people experiencing early psychosis. METHODS Screening elicited participants' perceptions of the usefulness of better memory, attention, and critical thinking skills and aimed to detect the presence of cognitive difficulties via participant and clinician reports. The screening protocol's sensitivity and specificity for detecting cognitive impairment, as defined by scores on a brief cognitive assessment, were evaluated. RESULTS About half the sample had global cognitive impairment, whereas more than 90% demonstrated impairment in at least one cognitive domain. Screening items demonstrated high sensitivity to detect global (≥0.80) and specific cognitive impairment (≥0.74), such that individuals with objectively measured cognitive impairment were likely to be correctly identified, although specificity remained low (≤0.34). CONCLUSIONS The screening protocol may best be considered as a means to initiate shared decision making for next steps, which may include brief cognitive assessment or more resource-intensive evaluation, and to inform appropriate treatment recommendations.
Collapse
Affiliation(s)
- Alice M Saperstein
- New York State Psychiatric Institute and Department of Psychiatry, Vagelos College of Physicians and Surgeons, Columbia University, New York City (Saperstein, Medalia); New York-Presbyterian Hospital, New York City (Saperstein, Medalia); Department of Psychiatry, Irving Medical Center, Columbia University, New York City (Basaraba, Wall, Dixon, Nossel, Bello)
| | - Cale N Basaraba
- New York State Psychiatric Institute and Department of Psychiatry, Vagelos College of Physicians and Surgeons, Columbia University, New York City (Saperstein, Medalia); New York-Presbyterian Hospital, New York City (Saperstein, Medalia); Department of Psychiatry, Irving Medical Center, Columbia University, New York City (Basaraba, Wall, Dixon, Nossel, Bello)
| | - Melanie M Wall
- New York State Psychiatric Institute and Department of Psychiatry, Vagelos College of Physicians and Surgeons, Columbia University, New York City (Saperstein, Medalia); New York-Presbyterian Hospital, New York City (Saperstein, Medalia); Department of Psychiatry, Irving Medical Center, Columbia University, New York City (Basaraba, Wall, Dixon, Nossel, Bello)
| | - Lisa B Dixon
- New York State Psychiatric Institute and Department of Psychiatry, Vagelos College of Physicians and Surgeons, Columbia University, New York City (Saperstein, Medalia); New York-Presbyterian Hospital, New York City (Saperstein, Medalia); Department of Psychiatry, Irving Medical Center, Columbia University, New York City (Basaraba, Wall, Dixon, Nossel, Bello)
| | - Ilana Nossel
- New York State Psychiatric Institute and Department of Psychiatry, Vagelos College of Physicians and Surgeons, Columbia University, New York City (Saperstein, Medalia); New York-Presbyterian Hospital, New York City (Saperstein, Medalia); Department of Psychiatry, Irving Medical Center, Columbia University, New York City (Basaraba, Wall, Dixon, Nossel, Bello)
| | - Iruma Bello
- New York State Psychiatric Institute and Department of Psychiatry, Vagelos College of Physicians and Surgeons, Columbia University, New York City (Saperstein, Medalia); New York-Presbyterian Hospital, New York City (Saperstein, Medalia); Department of Psychiatry, Irving Medical Center, Columbia University, New York City (Basaraba, Wall, Dixon, Nossel, Bello)
| | - Alice Medalia
- New York State Psychiatric Institute and Department of Psychiatry, Vagelos College of Physicians and Surgeons, Columbia University, New York City (Saperstein, Medalia); New York-Presbyterian Hospital, New York City (Saperstein, Medalia); Department of Psychiatry, Irving Medical Center, Columbia University, New York City (Basaraba, Wall, Dixon, Nossel, Bello)
| |
Collapse
|
2
|
Nuechterlein KH, Nasrallah H, Velligan D. Measuring Cognitive Impairments Associated With Schizophrenia in Clinical Practice: Overview of Current Challenges and Future Opportunities. Schizophr Bull 2025; 51:401-421. [PMID: 39088730 PMCID: PMC11997797 DOI: 10.1093/schbul/sbae051] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 08/03/2024]
Abstract
BACKGROUND Cognitive impairment associated with schizophrenia (CIAS) negatively impacts daily functioning, quality of life, and recovery, yet effective pharmacotherapies and practical assessments for clinical practice are lacking. Despite the pivotal progress made with establishment of the Measurement and Treatment Research to Improve Cognition in Schizophrenia (MATRICS) Consensus Cognitive Battery (MCCB) for clinical research, implementation of the full MCCB is too time-consuming and cost-ineffective for most clinicians in clinical practice. STUDY DESIGN Here we discuss current assessments in relation to delivery format (interview-based and performance-based), validity, ease of use for clinicians and patients, reliability/reproducibility, cost-effectiveness, and suitability for clinical implementation. Key challenges and future opportunities for improving cognitive assessments are also presented. STUDY RESULTS Current assessments that require 30 min to complete would have value in clinical settings, but the associated staff training and time required might preclude their application in most clinical settings. Initial profiling of cognitive deficits may require about 30 min to assist in the selection of evidence-based treatments; follow-up monitoring with brief assessments (10-15 min in duration) to detect treatment-related effects on global cognition may complement this approach. Guidance on validated brief cognitive tests for the strategic monitoring of treatment effects on CIAS is necessary. CONCLUSIONS With increased advancements in technology-based and remote assessments, development of validated formats of remote and in-person assessment, and the necessary training models and infrastructure required for implementation, are likely to be of increasing clinical relevance for future clinical practice.
Collapse
Affiliation(s)
- Keith H Nuechterlein
- Department of Psychiatry and Biobehavioral Sciences, University of California Los Angeles, Los Angeles, CA
| | - Henry Nasrallah
- Department of Psychiatry and Behavioral Neuroscience, University of Cincinnati School of Medicine, Cincinnati, OH
| | - Dawn Velligan
- Division of Schizophrenia and Related Disorders, Department of Psychiatry and Behavioral Sciences, University of Texas Health Science Center, San Antonio, TX
| |
Collapse
|
3
|
Medalia A, Saperstein AM, Wall MM, Basaraba CN, Bello I, Nossel I, Dixon LB. Feasibility and Acceptability of Providing Cognitive Remediation in a Large USA System of Coordinated Specialty Care for Early Psychosis. Early Interv Psychiatry 2025; 19:e13624. [PMID: 39421910 PMCID: PMC11732730 DOI: 10.1111/eip.13624] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/23/2024] [Revised: 09/20/2024] [Accepted: 10/04/2024] [Indexed: 10/19/2024]
Abstract
INTRODUCTION Multinational treatment guidelines support providing cognitive remediation to people recently diagnosed with schizophrenia, but the feasibility of implementing the treatment on a large scale is less well understood. METHODS This study took place between 2019 and 2023 at 14 clinics within a large network of programs providing early intervention services to people aged 16-30 experiencing nonaffective psychosis. Clinics were randomly assigned to deliver cognitive remediation as twice-weekly clinician-led groups (N = 5), cognitive remediation as once-weekly clinician-led groups with homework (N = 6), or treatment as usual (N = 3). All clinics screened for cognitive health need to guide treatment planning. Clinical teams (N = 11) received training to provide cognitive remediation. Program evaluation data were analysed for feasibility and acceptability. RESULTS Screening for cognitive health needs was completed on 77% of the 1193 participants enrolled at the 11 clinics offering cognitive remediation. Clinicians identified cognitive difficulties in 53.9% (n = 496) of screened participants and referred 27% (n = 134) of these participants to cognitive remediation. Of referred participants, 77.6% (n = 104) initiated treatment, and n = 41 completed the treatment. The rate of referral was nearly double, and treatment initiation was significantly higher at programs delivering once-weekly (84.3%) than twice-weekly (64.4%) treatment but the difference in the rate of treatment completion was statistically nonsignificant. Satisfaction among treatment completers was high. CONCLUSIONS Referrals to cognitive remediation required systemic support of a feasible cognitive health screening process. About a quarter of people with clinician-identified cognitive health needs were referred to cognitive remediation. Feasibility data suggest a flexible model of treatment delivery may facilitate implementation in this service setting.
Collapse
Affiliation(s)
- Alice Medalia
- New York State Psychiatric Institute, Department of Psychiatry, Columbia University Vagelos College of Physicians & Surgeons, and New York-Presbyterian, New York, NY, USA
| | - Alice M. Saperstein
- New York State Psychiatric Institute, Department of Psychiatry, Columbia University Vagelos College of Physicians & Surgeons, and New York-Presbyterian, New York, NY, USA
| | - Melanie M. Wall
- New York State Psychiatric Institute and Department of Psychiatry, Columbia University Vagelos College of Physicians & Surgeons, New York, NY, USA
| | - Cale N. Basaraba
- New York State Psychiatric Institute and Department of Psychiatry, Columbia University Vagelos College of Physicians & Surgeons, New York, NY, USA
| | - Iruma Bello
- New York State Psychiatric Institute and Department of Psychiatry, Columbia University Vagelos College of Physicians & Surgeons, New York, NY, USA
| | - Ilana Nossel
- New York State Psychiatric Institute and Department of Psychiatry, Columbia University Vagelos College of Physicians & Surgeons, New York, NY, USA
| | - Lisa B. Dixon
- New York State Psychiatric Institute and Department of Psychiatry, Columbia University Vagelos College of Physicians & Surgeons, New York, NY, USA
| |
Collapse
|
4
|
Heinssen RK, Morris SE, Sherrill JT. National Institute of Mental Health Support for Cognitive Treatment Development in Schizophrenia: A Narrative Review. Schizophr Bull 2024; 50:972-983. [PMID: 38941445 PMCID: PMC11348998 DOI: 10.1093/schbul/sbae109] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/30/2024]
Abstract
For several decades the National Institute of Mental Health (NIMH) has supported basic and translational research into cognitive impairment in schizophrenia. This article describes the Institute's ongoing commitment to cognitive assessment and intervention research, as reflected by three signature initiatives-Measurement and Treatment Research to Improve Cognition in Schizophrenia; Cognitive Neuroscience Treatment Research to Improve Cognition in Schizophrenia; and Research Domain Criteria-and related funding announcements that span basic experimental studies, efficacy and comparative effectiveness trials, and implementation research designed to promote cognitive healthcare in real-world treatment settings. We discuss how trends in science and public health policy since the early 2000s have influenced NIMH treatment development activities, resulting in greater attention to (1) inclusive teams that reflect end-user perspectives on the utility of proposed studies; (2) measurement of discrete neurocognitive processes to inform targeted interventions; (3) clinical trials that produce useful information about putative illness mechanisms, promising treatment targets, and downstream clinical effects; and (4) "productive urgency" in pursuing feasible and effective cognitive interventions for psychosis. Programs employing these principles have catalyzed cognitive measurement, drug development, and behavioral intervention approaches that aim to improve neurocognition and community functioning among persons with schizophrenia. NIMH will maintain support for innovative and impactful investigator-initiated research that advances patient-centered, clinically effective, and continuously improving cognitive health care for persons with psychotic disorders.
Collapse
Affiliation(s)
- Robert K Heinssen
- National Institute of Mental Health, Office of the Director, Bethesda, Maryland, USA
| | - Sarah E Morris
- National Institute of Mental Health, Division of Translational Research, Bethesda, Maryland, USA
| | - Joel T Sherrill
- National Institute of Mental Health, Division of Services and Intervention Research, Bethesda, Maryland, USA
| |
Collapse
|
5
|
Chen CS, Vinogradov S. Personalized Cognitive Health in Psychiatry: Current State and the Promise of Computational Methods. Schizophr Bull 2024; 50:1028-1038. [PMID: 38934792 PMCID: PMC11349010 DOI: 10.1093/schbul/sbae108] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 06/28/2024]
Abstract
BACKGROUND Decades of research have firmly established that cognitive health and cognitive treatment services are a key need for people living with psychosis. However, many current clinical programs do not address this need, despite the essential role that an individual's cognitive and social cognitive capacities play in determining their real-world functioning. Preliminary practice-based research in the Early Psychosis Intervention Network early psychosis intervention network shows that it is possible to develop and implement tools that delineate an individuals' cognitive health profile and that help engage the client and the clinician in shared decision-making and treatment planning that includes cognitive treatments. These findings signify a promising shift toward personalized cognitive health. STUDY DESIGN Extending upon this early progress, we review the concept of interindividual variability in cognitive domains/processes in psychosis as the basis for offering personalized treatment plans. We present evidence from studies that have used traditional neuropsychological measures as well as findings from emerging computational studies that leverage trial-by-trial behavior data to illuminate the different latent strategies that individuals employ. STUDY RESULT We posit that these computational techniques, when combined with traditional cognitive assessments, can enrich our understanding of individual differences in treatment needs, which in turn can guide evermore personalized interventions. CONCLUSION As we find clinically relevant ways to decompose maladaptive behaviors into separate latent cognitive elements captured by model parameters, the ultimate goal is to develop and implement approaches that empower clients and their clinical providers to leverage individual's existing learning capacities to improve their cognitive health and well-being.
Collapse
Affiliation(s)
- Cathy S Chen
- Department of Psychiatry & Behavioral Sciences, University of Minnesota Medical School, Minneapolis, MN, USA
| | - Sophia Vinogradov
- Department of Psychiatry & Behavioral Sciences, University of Minnesota Medical School, Minneapolis, MN, USA
| |
Collapse
|
6
|
Saperstein AM, Bello I, Nossel I, Dixon LB, Medalia A. Implementation of Cognitive Health Services in Large Systems of Care: Highlights From Coordinated Specialty Care for First Episode Psychosis. Schizophr Bull 2024; 50:984-992. [PMID: 38517180 PMCID: PMC11349000 DOI: 10.1093/schbul/sbae030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 03/23/2024]
Abstract
BACKGROUND AND HYPOTHESIS With increasing recognition of the importance of cognitive health for recovery in people with psychosis, questions arise as to how to implement cognitive health services in large systems of care. This paper describes the implementation of cognitive health services in OnTrackNY (OTNY), a network of clinics delivering a Coordinated Specialty Care treatment model for early psychosis, with the goal of documenting the processes, challenges, and useful adaptations. STUDY DESIGN In 2018, OTNY piloted a Cognitive Health Toolkit for implementation across 18 affiliated clinics. The toolkit intended to identify the cognitive health needs of individuals early in the course of psychosis and to integrate cognitive health into the vocabulary of wellness and recovery. Implementation involved creating mechanisms for staff training and support to, in turn, help participants improve how they use cognitive skills in daily life. STUDY RESULTS The toolkit was disseminated to all 28 OTNY programs throughout New York state by 2023. When simple assessment and decision-making tools were embedded in routine care practices, the majority of participants identified that improving memory, attention, and critical thinking skills would be helpful. Consistently, about 70% of those asked wanted to learn more about how to better their cognitive health. CONCLUSIONS Cognitive health services can be implemented in large systems of care that provide a multi-level system of implementation supports. Organizational facilitators of implementation include a training program to educate about cognitive health and the delivery of cognitive health interventions, and embedded quality assurance monitoring and improvement activities.
Collapse
Affiliation(s)
- Alice M Saperstein
- Department of Psychiatry, New York State Psychiatric Institute, Columbia University Vagelos College of Physicians & Surgeons, New York-Presbyterian, New York, NY, USA
| | - Iruma Bello
- Department of Psychiatry, New York State Psychiatric Institute, Columbia University Vagelos College of Physicians & Surgeons, New York, NY, USA
| | - Ilana Nossel
- Department of Psychiatry, New York State Psychiatric Institute, Columbia University Vagelos College of Physicians & Surgeons, New York, NY, USA
| | - Lisa B Dixon
- Department of Psychiatry, New York State Psychiatric Institute, Columbia University Vagelos College of Physicians & Surgeons, New York, NY, USA
| | - Alice Medalia
- Department of Psychiatry, New York State Psychiatric Institute, Columbia University Vagelos College of Physicians & Surgeons, New York-Presbyterian, New York, NY, USA
| |
Collapse
|
7
|
Bryce S, Cheng N, Dalton A, Ojinnaka A, Stainton A, Zbukvic I, Ratheesh A, O'Halloran C, Uren J, Gates J, Daglas-Georgiou R, Wood SJ, Allott K. Cognitive health treatment priorities and preferences among young people with mental illness: The your mind, your choice survey. Early Interv Psychiatry 2024; 18:94-101. [PMID: 37198726 DOI: 10.1111/eip.13436] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Revised: 03/30/2023] [Accepted: 05/05/2023] [Indexed: 05/19/2023]
Abstract
AIM Cognitive impairments negatively impact the everyday functioning of young people with mental illness. However, no previous study has asked young people (1) how much of a priority cognitive functioning is within mental health treatment, and (2) what types of cognition-focused treatments are most appealing. The current study aimed to address these questions. METHODS Your Mind, Your Choice was a survey-based study involving an Australian sample of young people who were receiving mental health treatment. The survey asked participants to (1) provide demographic and mental health history, (2) rate the importance of 20 recovery domains, including cognition, when receiving mental health treatment, (3) share their experiences of cognitive functioning, and (4) rate their likelihood of trying 14 different behavioural, biochemical, and physical treatments that may address cognitive functioning. RESULTS Two-hundred and forty-three participants (Mage = 20.07, SD = 3.25, range = 15-25, 74% female) completed the survey. Participants reported that addressing cognitive functioning in mental health care was very important (M = 76.33, SD = 20.7, rated on a scale from 0 = not important to 100 = extremely important), ranking cognition among their top six treatment needs. Seventy percent of participants reported experiencing cognitive difficulties, but less than one-third had received treatment for these difficulties. Compensatory training, sleep interventions and psychoeducation were ranked as treatments that participants were most likely to try to support their cognitive functioning. CONCLUSIONS Young people with mental ill-health commonly experience cognitive difficulties and would like this to be a focus of treatment; however, this need is often unmet and should be a focus of research and implementation.
Collapse
Affiliation(s)
- Shayden Bryce
- Orygen, Parkville, Australia
- Centre for Youth Mental Health, University of Melbourne, Parkville, Australia
- Alfred Mental and Addiction Health, Melbourne, Australia
| | - Nicholas Cheng
- Orygen, Parkville, Australia
- Centre for Youth Mental Health, University of Melbourne, Parkville, Australia
| | | | | | - Alexandra Stainton
- Orygen, Parkville, Australia
- Centre for Youth Mental Health, University of Melbourne, Parkville, Australia
| | - Isabel Zbukvic
- Orygen, Parkville, Australia
- Centre for Youth Mental Health, University of Melbourne, Parkville, Australia
| | - Aswin Ratheesh
- Orygen, Parkville, Australia
- Centre for Youth Mental Health, University of Melbourne, Parkville, Australia
| | | | - Jacquie Uren
- Alfred Mental and Addiction Health, Melbourne, Australia
- Headspace Early Psychosis, Alfred Health, Melbourne, Australia
| | | | - Rothanthi Daglas-Georgiou
- Orygen, Parkville, Australia
- Centre for Youth Mental Health, University of Melbourne, Parkville, Australia
| | - Stephen J Wood
- Orygen, Parkville, Australia
- Centre for Youth Mental Health, University of Melbourne, Parkville, Australia
- School of Psychology, University of Birmingham, Edgbaston, Birmingham, UK
| | - Kelly Allott
- Orygen, Parkville, Australia
- Centre for Youth Mental Health, University of Melbourne, Parkville, Australia
| |
Collapse
|