1
|
Babatope EY, Ramírez-Acosta AÁ, Avila-Funes JA, García-Vázquez M. The Potential of Automated Assessment of Cognitive Function Using Non-Neuroimaging Data: A Systematic Review. J Clin Med 2024; 13:7068. [PMID: 39685528 DOI: 10.3390/jcm13237068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2024] [Revised: 11/15/2024] [Accepted: 11/19/2024] [Indexed: 12/18/2024] Open
Abstract
Background/Objectives: The growing incidence of cognitive impairment among older adults has a significant impact on individuals, family members, caregivers, and society. Current conventional cognitive assessment tools are faced with some limitations. Recent evidence suggests that automating cognitive assessment holds promise, potentially resulting in earlier diagnosis, timely intervention, improved patient outcomes, and higher chances of response to treatment. Despite the advantages of automated assessment and technological advancements, automated cognitive assessment has yet to gain widespread use, especially in low and lower middle-income countries. This review highlights the potential of automated cognitive assessment tools and presents an overview of existing tools. Methods: This review includes 87 studies carried out with non-neuroimaging data alongside their performance metrics. Results: The identified articles automated the cognitive assessment process and were grouped into five categories either based on the tools' design or the data analysis approach. These categories include game-based, digital versions of conventional tools, original computerized tests and batteries, virtual reality/wearable sensors/smart home technologies, and artificial intelligence-based (AI-based) tools. These categories are further explained, and evaluation of their strengths and limitations is discussed to strengthen their adoption in clinical practice. Conclusions: The comparative metrics of both conventional and automated approaches of assessment suggest that the automated approach is a strong alternative to the conventional approach. Additionally, the results of the review show that the use of automated assessment tools is more prominent in countries ranked as high-income and upper middle-income countries. This trend merits further social and economic studies to understand the impact of this global reality.
Collapse
Affiliation(s)
- Eyitomilayo Yemisi Babatope
- Instituto Politécnico Nacional, Centro de Investigación y Desarrollo de Tecnología Digital, Tijuana 22435, Mexico
| | | | - José Alberto Avila-Funes
- Instituto Nacional de Ciencias Médicas y Nutrición Salvador Zubirán-INCMNSZ, México City 14080, Mexico
| | - Mireya García-Vázquez
- Instituto Politécnico Nacional, Centro de Investigación y Desarrollo de Tecnología Digital, Tijuana 22435, Mexico
| |
Collapse
|
2
|
Horan WP, Moore RC, Belanger HG, Harvey PD. Utilizing Technology to Enhance the Ecological Validity of Cognitive and Functional Assessments in Schizophrenia: An Overview of the State-of-the-Art. SCHIZOPHRENIA BULLETIN OPEN 2024; 5:sgae025. [PMID: 39676763 PMCID: PMC11645460 DOI: 10.1093/schizbullopen/sgae025] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/17/2024]
Abstract
Cognitive impairment is a core feature of schizophrenia and a key determinant of functional outcome. Although conventional paper-and-pencil based cognitive assessments used in schizophrenia remained relatively static during most of the 20th century, this century has witnessed the emergence of innovative digital technologies that aim to enhance the ecological validity of performance-based assessments. This narrative review provides an overview of new technologies that show promise for enhancing the ecological validity of cognitive and functional assessments. We focus on 2 approaches that are particularly relevant for schizophrenia research: (1) digital functional capacity tasks, which use simulations to measure performance of important daily life activities (e.g., virtual shopping tasks), delivered both in-person and remotely, and (2) remote device-based assessments, which include self-administered cognitive tasks (e.g., processing speed test) or functionally-focused surveys regarding momentary activities and experiences (e.g., location, social context), as well as passive sensor-based metrics (e.g., actigraphy measures of activity), during daily life. For each approach, we describe the potential for enhancing ecological validity, provide examples of select measures that have been used in schizophrenia research, summarize available data on their feasibility and validity, and consider remaining challenges. Rapidly growing evidence indicates that digital technologies have the potential to enhance the ecological validity of cognitive and functional outcome assessments, and thereby advance research into the causes of, and treatments for, functional disability in schizophrenia.
Collapse
Affiliation(s)
- William P Horan
- Karuna Therapeutics, A Bristol Myers Squibb Company, Boston, MA, USA
- University of California, Los Angeles, CA, USA
| | | | - Heather G Belanger
- Cognitive Research Corporation, St Petersburg, FL, USA
- Departments of Psychiatry and Behavioral Neurosciences, and Psychology, University of South Florida, Tampa, FL, USA
| | - Philip D Harvey
- University of Miami Miller School of Medicine, Miami, FL, USA
| |
Collapse
|
3
|
Chiang SK, Jhong JR, Wang CY. Effects of cognitive stimulus therapy on middle-aged and elderly institutionalized patients with chronic schizophrenia with declined cognition. J Formos Med Assoc 2023; 122:853-861. [PMID: 36964101 DOI: 10.1016/j.jfma.2023.03.008] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2022] [Revised: 01/11/2023] [Accepted: 03/07/2023] [Indexed: 03/26/2023] Open
Abstract
PURPOSE This study investigates whether using group Cognitive Stimulation Therapy (CST) effectively improves functioning among middle-aged and elderly patients with chronic schizophrenia and a below-normal cognitive range. METHODS The study included an experimental group (N = 24), which was divided into two sub-groups to receive group CST, and a control group (N = 24), who received treatment as usual (TAU). We assessed cognitive functions using the Mini-Mental Status Examination (MMSE). We evaluated the emotional status, psychotic symptoms, and quality of life using the Geriatric Depression Scale short-form 15 (GDS-15), the Brief Psychiatric Rating Scale (BPRS), and the Dementia-Quality of Life (D-QoL) instrument. We performed all measures at three-time points: pre-CST, post-CST, and 3-month follow-up. RESULTS We found group CST can significantly improve cognitive performance, especially the ability to use new information, after group CST intervention. However, the experimental group did not maintain this effect at the 3-month follow-up. RESULTS We found group CST can significantly improve cognitive performance, especially the ability to use new information, after group CST intervention. However, the experimental group did not maintain this effect at the 3-month follow-up. CONCLUSION This study supports group CST can delay the degradation of some cognitive functions in long-term hospitalized patients with chronic schizophrenia for the duration of the intervention. This finding has important clinical implications for long-term institutionalized middle-aged and elderly chronic schizophrenic patients with a below-normal cognitive range in an aging society.
Collapse
Affiliation(s)
- Shih-Kuang Chiang
- Department of Counselling and Clinical Psychology, National Dong Hwa University, Taiwan.
| | - Jia-Rong Jhong
- Department of Clinical Psychology, Taoyuan Mental Hospital, Taiwan
| | - Chia-Yu Wang
- Department of Clinical Psychology, Yuli Hospital, Taiwan
| |
Collapse
|
4
|
Horan WP, Depp CA, Hurst S, Linthicum J, Vargas G, Klein H, Keefe RSE, Harvey PD. Qualitative Analysis of the Content Validity of the Virtual Reality Functional Capacity Assessment Tool (VRFCAT) in Schizophrenia: A Multi-Stakeholder Perspective. SCHIZOPHRENIA BULLETIN OPEN 2023; 4:sgad012. [PMID: 38026054 PMCID: PMC10664622 DOI: 10.1093/schizbullopen/sgad012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 12/01/2023]
Abstract
The US Food and Drug Agency (FDA) requires clinical trials targeting cognitive impairment associated with schizophrenia (CIAS) to demonstrate the functional relevance of cognitive improvements by employing a functional co-primary measure. Although quantitative evidence supports the suitability of the Virtual Reality Functional Capacity Assessment Tool (VRFCAT) for this purpose, FDA guidelines for qualification of clinical outcome assessments require evidence of content validity, defined as qualitative evidence that key stakeholders view the measure as relevant and important. To collect this important qualitative data, semi-structured interviews were conducted with outpatients with schizophrenia (n = 24), caregivers (n = 12), and professional peer support specialists (n = 12) to elicit their views about the definition and importance of functional independence, the importance of the functional domains assessed by the VRFCAT (meal planning, using transportation, handling money, shopping), and the relevance of the VRFCAT tasks to these domains. Qualitative thematic analyses revealed consistent themes across groups in defining functional independence, including performing instrumental self-care, financial, and social tasks; making decisions autonomously; and not depending on others to carry out daily activities. There were, however, notable differences in their views regarding the importance of and barriers to functional independence. All groups viewed the VRFCAT as assessing skill domains that are central to independent functioning and, with some minor differences, the VRFCAT tasks were viewed as relevant and meaningful examples of the domains. These qualitative results provide converging evidence that key stakeholders view the VRFCAT as a content-valid measure.
Collapse
Affiliation(s)
- William P Horan
- WCG Clinical Endpoint Solutions, Cary, NC
- Department of Psychiatry & Biobehavioral Sciences, University of California, Los Angeles, CA
| | - Colin A Depp
- Herbert Wertheim School of Public Health & Human Longevity Science, University of California, San Diego, CA
| | - Samantha Hurst
- Herbert Wertheim School of Public Health & Human Longevity Science, University of California, San Diego, CA
| | | | - Gabriela Vargas
- Department of Psychiatry & Behavioral Sciences, University of Miami Miller School of Medicine, Research Service Bruce W. Carter VA Medical Center, Miami, FL
| | - Hans Klein
- WCG Clinical Endpoint Solutions, Cary, NC
| | | | - Philip D Harvey
- Department of Psychiatry & Behavioral Sciences, University of Miami Miller School of Medicine, Research Service Bruce W. Carter VA Medical Center, Miami, FL
| |
Collapse
|
5
|
Wiebe A, Kannen K, Selaskowski B, Mehren A, Thöne AK, Pramme L, Blumenthal N, Li M, Asché L, Jonas S, Bey K, Schulze M, Steffens M, Pensel MC, Guth M, Rohlfsen F, Ekhlas M, Lügering H, Fileccia H, Pakos J, Lux S, Philipsen A, Braun N. Virtual reality in the diagnostic and therapy for mental disorders: A systematic review. Clin Psychol Rev 2022; 98:102213. [PMID: 36356351 DOI: 10.1016/j.cpr.2022.102213] [Citation(s) in RCA: 21] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Revised: 08/21/2022] [Accepted: 10/11/2022] [Indexed: 01/27/2023]
Abstract
BACKGROUND Virtual reality (VR) technologies are playing an increasingly important role in the diagnostics and treatment of mental disorders. OBJECTIVE To systematically review the current evidence regarding the use of VR in the diagnostics and treatment of mental disorders. DATA SOURCE Systematic literature searches via PubMed (last literature update: 9th of May 2022) were conducted for the following areas of psychopathology: Specific phobias, panic disorder and agoraphobia, social anxiety disorder, generalized anxiety disorder, posttraumatic stress disorder (PTSD), obsessive-compulsive disorder, eating disorders, dementia disorders, attention-deficit/hyperactivity disorder, depression, autism spectrum disorder, schizophrenia spectrum disorders, and addiction disorders. ELIGIBILITY CRITERIA To be eligible, studies had to be published in English, to be peer-reviewed, to report original research data, to be VR-related, and to deal with one of the above-mentioned areas of psychopathology. STUDY EVALUATION For each study included, various study characteristics (including interventions and conditions, comparators, major outcomes and study designs) were retrieved and a risk of bias score was calculated based on predefined study quality criteria. RESULTS Across all areas of psychopathology, k = 9315 studies were inspected, of which k = 721 studies met the eligibility criteria. From these studies, 43.97% were considered assessment-related, 55.48% therapy-related, and 0.55% were mixed. The highest research activity was found for VR exposure therapy in anxiety disorders, PTSD and addiction disorders, where the most convincing evidence was found, as well as for cognitive trainings in dementia and social skill trainings in autism spectrum disorder. CONCLUSION While VR exposure therapy will likely find its way successively into regular patient care, there are also many other promising approaches, but most are not yet mature enough for clinical application. REVIEW REGISTRATION PROSPERO register CRD42020188436. FUNDING The review was funded by budgets from the University of Bonn. No third party funding was involved.
Collapse
Affiliation(s)
- Annika Wiebe
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Kyra Kannen
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Benjamin Selaskowski
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Aylin Mehren
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Ann-Kathrin Thöne
- School of Child and Adolescent Cognitive Behavior Therapy (AKiP), Faculty of Medicine and University Hospital Cologne, University of Cologne, Cologne, Germany
| | - Lisa Pramme
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Nike Blumenthal
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Mengtong Li
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Laura Asché
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Stephan Jonas
- Institute for Digital Medicine, University Hospital Bonn, Bonn, Germany
| | - Katharina Bey
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Marcel Schulze
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Maria Steffens
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Max Christian Pensel
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Matthias Guth
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Felicia Rohlfsen
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Mogda Ekhlas
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Helena Lügering
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Helena Fileccia
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Julian Pakos
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Silke Lux
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Alexandra Philipsen
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany
| | - Niclas Braun
- Department of Psychiatry and Psychotherapy, University Hospital Bonn, Bonn, Germany.
| |
Collapse
|
6
|
Searle A, Allen L, Lowther M, Cotter J, Barnett JH. Measuring functional outcomes in schizophrenia in an increasingly digital world. Schizophr Res Cogn 2022; 29:100248. [PMID: 35444930 PMCID: PMC9014442 DOI: 10.1016/j.scog.2022.100248] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2021] [Revised: 03/15/2022] [Accepted: 03/15/2022] [Indexed: 12/01/2022] Open
Abstract
With an unmet clinical need for effective interventions for cognitive and negative symptoms in patients with schizophrenia, measures of functional status (often a co-primary endpoint) remain key clinical trial outcomes. This review aims to give an overview of the different types of functional assessments commonly used in clinical trials and research involving patients with schizophrenia and highlight pertinent challenges surrounding the use of these as reliable, sensitive, and specific assessments in intervention trials. We provide examples of commonly used functional measures and highlight emerging real-time digital assessment tools. Informant- and clinician-rated functional outcome measures and functional capacity assessments are valid, commonly used measures of functional status that try to overcome the need for often overly ambitious and insensitive ‘real world’ milestones. The wide range of scientific and practical challenges associated with these different tools leave room for the development of improved functional outcome measures for use in clinical trials. In particular, many existing measures fail to capture small, but meaningful, functional changes that may occur over the course of typically short intervention trials. Adding passive digital data collection and short active real-time digital assessments whilst patients go about their day offers the opportunity to build a more fine-grained picture of functional improvements that, if thoughtfully developed and carefully applied, could provide the sensitivity needed to accurately evaluate functional status in intervention studies, aiding the development of desperately needed treatments. Functional outcome measures are important for evaluating the efficacy of treatments. A variety of these are available, each with their own strengths and limitations. However, consensus on the optimal functional outcome measure(s) is lacking. Digital measures may enhance the assessment of associated functional constructs.
Collapse
Affiliation(s)
- Anja Searle
- Cambridge Cognition, Tunbridge Court, Bottisham, Cambridge CB25 9TU, UK
| | - Luke Allen
- Cambridge Cognition, Tunbridge Court, Bottisham, Cambridge CB25 9TU, UK
| | - Millie Lowther
- Cambridge Cognition, Tunbridge Court, Bottisham, Cambridge CB25 9TU, UK.,Anxiety Lab, Neuroscience and Mental Health Group, University College London Institute of Cognitive Neuroscience, Alexandra House, 17-19 Queen Square, Bloomsbury, London WC1N 3AZ, UK
| | - Jack Cotter
- Cambridge Cognition, Tunbridge Court, Bottisham, Cambridge CB25 9TU, UK.,Medical and Scientific Affairs, Nutrition, Reckitt, Slough, UK
| | - Jennifer H Barnett
- Cambridge Cognition, Tunbridge Court, Bottisham, Cambridge CB25 9TU, UK.,University of Cambridge Department of Psychiatry, Cambridge CB2 0SZ, UK
| |
Collapse
|