1
|
Munsell EGS, Bui Q, Kaufman KJ, Tomazin SE, Regan BA, Lenze EJ, Lee JM, Mohr DC, Fong MWM, Metts CL, Pham V, Wong AWK. Intraindividual variability in post-stroke cognition and its relationship with activities of daily living and social functioning: an ecological momentary assessment approach. Top Stroke Rehabil 2024; 31:564-575. [PMID: 38278142 DOI: 10.1080/10749357.2024.2307203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/03/2023] [Accepted: 01/12/2024] [Indexed: 01/28/2024]
Abstract
INTRODUCTION Ecological momentary assessment (EMA) is a methodological approach to studying intraindividual variation over time. This study aimed to use EMA to determine the variability of cognition in individuals with chronic stroke, identify the latent classes of cognitive variability, and examine any differences in daily activities, social functioning, and neuropsychological performance between these latent classes. METHODS Participants (N = 202) with mild-to-moderate stroke and over 3-month post-stroke completed a study protocol, including smartphone-based EMA and two lab visits. Participants responded to five EMA surveys daily for 14 days to assess cognition. They completed patient-reported measures and neuropsychological assessments during lab visits. Using latent class analysis, we derived four indicators to quantify cognitive variability and identified latent classes among participants. We used ANOVA and Chi-square to test differences between these latent classes in daily activities, social functioning, and neuropsychological performance. RESULTS The latent class analysis converged on a three-class model. The moderate and high variability classes demonstrated significantly greater problems in daily activities and social functioning than the low class. They had significantly higher proportions of participants with problems in daily activities and social functioning than the low class. Neuropsychological performance was not statistically different between the three classes, although a trend approaching statistically significant difference was observed in working memory and executive function domains. DISCUSSION EMA could capture intraindividual cognitive variability in stroke survivors. It offers a new approach to understanding the impact and mechanism of post-stroke cognitive problems in daily life and identifying individuals benefiting from self-regulation interventions.
Collapse
Affiliation(s)
- Elizabeth G S Munsell
- Center for Rehabilitation Outcomes Research, Shirley Ryan AbilityLab, Chicago, IL, USA
- Center for Education in Health Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | - Quoc Bui
- Division of Biostatistics, Washington University School of Medicine, St. Louis, MO, USA
| | - Katherine J Kaufman
- Center for Rehabilitation Outcomes Research, Shirley Ryan AbilityLab, Chicago, IL, USA
| | - Stephanie E Tomazin
- Center for Rehabilitation Outcomes Research, Shirley Ryan AbilityLab, Chicago, IL, USA
| | - Bridget A Regan
- Center for Rehabilitation Outcomes Research, Shirley Ryan AbilityLab, Chicago, IL, USA
| | - Eric J Lenze
- Department of Psychiatry, Washington University School of Medicine, St. Louis, MO, USA
| | - Jin-Moo Lee
- Department of Neurology, Washington University School of Medicine, St. Louis, MO, USA
| | - David C Mohr
- Center for Behavioral Intervention Technologies and Department of Preventive Medicine, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| | | | - Christopher L Metts
- Department of Pathology and Laboratory Medicine, Medical University of South Carolina, Charleston, SC, USA
| | - Vy Pham
- Department of Psychiatry, Washington University School of Medicine, St. Louis, MO, USA
| | - Alex W K Wong
- Center for Rehabilitation Outcomes Research, Shirley Ryan AbilityLab, Chicago, IL, USA
- Department of Physical Medicine and Rehabilitation and Department of Medical Social Sciences, Northwestern University Feinberg School of Medicine, Chicago, IL, USA
| |
Collapse
|
2
|
Doucette MM, Kwan H, Premji Z, Duchesne A, Gawryluk JR, Garcia-Barrera MA. Integration of sex/gender and utilization of ecological Momentary assessment of cognition in clinical populations: A scoping review. Clin Neuropsychol 2024; 38:1409-1440. [PMID: 38533627 DOI: 10.1080/13854046.2024.2333579] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/04/2023] [Accepted: 03/15/2024] [Indexed: 03/28/2024]
Abstract
Objectives: We aimed to describe the methods of smartphone-based cognitive ecological momentary assessment designs in clinical populations, with an intention to evaluate how the role of sex and/or gender has been considered in the design and analyses, particularly including female-specific physiology. Methods: This scoping review was conducted based on JBI scoping review methodology. On March 2nd, 2023, we searched for literature across four databases. Screening of the results and data extraction were conducted in duplicate according to the a priori methods in the pre-registered protocol. Results: 31 articles were included in this review. Participants ranged in age from 15-85 years old with various clinical disorders. Prompts were given between 1-7 times per day for 7-84 days. Executive function was the most frequently assessed cognitive domain. Over half the studies (n = 17, 55%) did not investigate the effects of sex and/or gender, and only one study considered the impact of hormonal therapy. Many studies (n = 14, 45%) used sex and gender interchangeably or incorrectly. Conclusions: Studies varied in design, with heterogeneity in the reporting of methodological information. The lack of attention to sex/gender on neuropsychological outcomes can lead to confusion and contradiction regarding its potential impact on cognition in clinical populations. This may hinder the identification of effective interventions for those assigned female at birth who have been overlooked or considered indistinguishable from their male counterparts. Given the well-documented impact of sex/gender on cognition, it is essential that future neuropsychological research, especially EMA-based studies, prioritize investigating sex/gender to ensure better outcomes for all.
Collapse
Affiliation(s)
| | - Heather Kwan
- Department of Psychology, University of Victoria, British Columbia, Canada
- Institute on Aging & Lifelong Health, University of Victoria, British Columbia, Canada
| | - Zahra Premji
- Libraries, University of Victoria, British Columbia, Canada
| | - Annie Duchesne
- Department of Psychology, University of Northern British Columbia, British Columbia, Canada
- Department of Psychology, Université du Québec à Trois-Rivières, Quebec, Canada
| | - Jodie R Gawryluk
- Department of Psychology, University of Victoria, British Columbia, Canada
- Institute on Aging & Lifelong Health, University of Victoria, British Columbia, Canada
- Division of Medical Sciences, University of Victoria, British Columbia, Canada
| | - Mauricio A Garcia-Barrera
- Department of Psychology, University of Victoria, British Columbia, Canada
- Institute on Aging & Lifelong Health, University of Victoria, British Columbia, Canada
| |
Collapse
|
3
|
Harris C, Tang Y, Birnbaum E, Cherian C, Mendhe D, Chen MH. Digital Neuropsychology beyond Computerized Cognitive Assessment: Applications of Novel Digital Technologies. Arch Clin Neuropsychol 2024; 39:290-304. [PMID: 38520381 DOI: 10.1093/arclin/acae016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/05/2024] [Accepted: 02/16/2024] [Indexed: 03/25/2024] Open
Abstract
Compared with other health disciplines, there is a stagnation in technological innovation in the field of clinical neuropsychology. Traditional paper-and-pencil tests have a number of shortcomings, such as low-frequency data collection and limitations in ecological validity. While computerized cognitive assessment may help overcome some of these issues, current computerized paradigms do not address the majority of these limitations. In this paper, we review recent literature on the applications of novel digital health approaches, including ecological momentary assessment, smartphone-based assessment and sensors, wearable devices, passive driving sensors, smart homes, voice biomarkers, and electronic health record mining, in neurological populations. We describe how each digital tool may be applied to neurologic care and overcome limitations of traditional neuropsychological assessment. Ethical considerations, limitations of current research, as well as our proposed future of neuropsychological practice are also discussed.
Collapse
Affiliation(s)
- Che Harris
- Institute for Health, Health Care Policy and Aging Research, Rutgers University, New Brunswick, NJ, USA
- Department of Neurology, Robert Wood Johnson Medical School, Rutgers University, New Brunswick, NJ, USA
| | - Yingfei Tang
- Institute for Health, Health Care Policy and Aging Research, Rutgers University, New Brunswick, NJ, USA
- Department of Neurology, Robert Wood Johnson Medical School, Rutgers University, New Brunswick, NJ, USA
| | - Eliana Birnbaum
- Institute for Health, Health Care Policy and Aging Research, Rutgers University, New Brunswick, NJ, USA
| | - Christine Cherian
- Institute for Health, Health Care Policy and Aging Research, Rutgers University, New Brunswick, NJ, USA
| | - Dinesh Mendhe
- Institute for Health, Health Care Policy and Aging Research, Rutgers University, New Brunswick, NJ, USA
| | - Michelle H Chen
- Institute for Health, Health Care Policy and Aging Research, Rutgers University, New Brunswick, NJ, USA
- Department of Neurology, Robert Wood Johnson Medical School, Rutgers University, New Brunswick, NJ, USA
| |
Collapse
|
4
|
Freis SM, Alexander JD, Anderson JE, Corley RP, De La Vega AI, Gustavson DE, Vrieze SI, Friedman NP. Associations between executive functions assessed in different contexts in a genetically informative sample. J Exp Psychol Gen 2024; 153:70-85. [PMID: 37668562 PMCID: PMC10843656 DOI: 10.1037/xge0001471] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/06/2023]
Abstract
Executive functions (EFs) are cognitive functions that help direct goal-related behavior. EFs are usually measured via behavioral tasks assessed in highly controlled laboratory settings under the supervision of a research assistant. Online versions of EF tasks are an increasingly popular alternative to in-lab testing. However, researchers do not have the same control over the testing environment during online EF assessments. To assess the extent to which EFs assessed in-lab and online are related, we used data from the Colorado Online Twin Study (CoTwins; 887 individual twins aged 13.98-19.05) and constructed an Lab Common EF factor and an Online Common EF factor from four EF tasks assessed in-lab and online. The Lab Common and Online Common EF factors were genetically identical (rA = 1.00) but phenotypically separable (r = .77, 95% confidence interval [0.59, 0.94]) indicating that these EF factors have the same genetic underpinnings but may be differentially influenced by environmental factors. We examined phenotypic, genetic, and environmental correlations between the EF factors and a general cognitive ability factor (g) assessed in the lab and found similar relationships between Lab Common EF and g and Online Common EF and g. Overall, these results suggest that Common EF factors assessed in different contexts are highly related to each other and similarly related to other cognitive outcomes. These findings indicate that online task-based EF assessments could be a viable strategy for increasing sample sizes in large-scale studies, particularly genetically informed studies. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Collapse
Affiliation(s)
- Samantha M. Freis
- Institute for Behavioral Genetics, University of Colorado Boulder
- Department of Psychology and Neuroscience, University of Colorado Boulder
| | | | | | - Robin P. Corley
- Institute for Behavioral Genetics, University of Colorado Boulder
- Department of Psychology and Neuroscience, University of Colorado Boulder
| | | | | | - Scott I. Vrieze
- Institute for Behavioral Genetics, University of Colorado Boulder
- Department of Psychology, University of Minnesota
| | - Naomi P. Friedman
- Institute for Behavioral Genetics, University of Colorado Boulder
- Department of Psychology and Neuroscience, University of Colorado Boulder
| | | |
Collapse
|
5
|
Taylor JC, Heuer HW, Clark AL, Wise AB, Manoochehri M, Forsberg L, Mester C, Rao M, Brushaber D, Kramer J, Welch AE, Kornak J, Kremers W, Appleby B, Dickerson BC, Domoto‐Reilly K, Fields JA, Ghoshal N, Graff‐Radford N, Grossman M, Hall MGH, Huey ED, Irwin D, Lapid MI, Litvan I, Mackenzie IR, Masdeu JC, Mendez MF, Nevler N, Onyike CU, Pascual B, Pressman P, Rankin KP, Ratnasiri B, Rojas JC, Tartaglia MC, Wong B, Gorno‐Tempini ML, Boeve BF, Rosen HJ, Boxer AL, Staffaroni AM. Feasibility and acceptability of remote smartphone cognitive testing in frontotemporal dementia research. ALZHEIMER'S & DEMENTIA (AMSTERDAM, NETHERLANDS) 2023; 15:e12423. [PMID: 37180971 PMCID: PMC10170087 DOI: 10.1002/dad2.12423] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/02/2022] [Revised: 12/27/2022] [Accepted: 03/01/2023] [Indexed: 05/16/2023]
Abstract
Introduction Remote smartphone assessments of cognition, speech/language, and motor functioning in frontotemporal dementia (FTD) could enable decentralized clinical trials and improve access to research. We studied the feasibility and acceptability of remote smartphone data collection in FTD research using the ALLFTD Mobile App (ALLFTD-mApp). Methods A diagnostically mixed sample of 214 participants with FTD or from familial FTD kindreds (asymptomatic: CDR®+NACC-FTLD = 0 [N = 101]; prodromal: 0.5 [N = 49]; symptomatic ≥1 [N = 51]; not measured [N = 13]) were asked to complete ALLFTD-mApp tests on their smartphone three times within 12 days. They completed smartphone familiarity and participation experience surveys. Results It was feasible for participants to complete the ALLFTD-mApp on their own smartphones. Participants reported high smartphone familiarity, completed ∼ 70% of tasks, and considered the time commitment acceptable (98% of respondents). Greater disease severity was associated with poorer performance across several tests. Discussion These findings suggest that the ALLFTD-mApp study protocol is feasible and acceptable for remote FTD research. HIGHLIGHTS The ALLFTD Mobile App is a smartphone-based platform for remote, self-administered data collection.The ALLFTD Mobile App consists of a comprehensive battery of surveys and tests of executive functioning, memory, speech and language, and motor abilities.Remote digital data collection using the ALLFTD Mobile App was feasible in a multicenter research consortium that studies FTD. Data was collected in healthy controls and participants with a range of diagnoses, particularly FTD spectrum disorders.Remote digital data collection was well accepted by participants with a variety of diagnoses.
Collapse
Affiliation(s)
- Jack Carson Taylor
- Department of Neurology, Memory and Aging Center, University of California, San FranciscoWeill Institute for NeurosciencesSan FranciscoCaliforniaUSA
| | - Hilary W. Heuer
- Department of Neurology, Memory and Aging Center, University of California, San FranciscoWeill Institute for NeurosciencesSan FranciscoCaliforniaUSA
| | - Annie L. Clark
- Department of Neurology, Memory and Aging Center, University of California, San FranciscoWeill Institute for NeurosciencesSan FranciscoCaliforniaUSA
| | - Amy B. Wise
- Department of Neurology, Memory and Aging Center, University of California, San FranciscoWeill Institute for NeurosciencesSan FranciscoCaliforniaUSA
| | | | - Leah Forsberg
- Department of NeurologyMayo ClinicRochesterMinnesotaUSA
| | - Carly Mester
- Department of Quantitative Health SciencesDivision of Biomedical Statistics and InformaticsMayo ClinicRochesterMinnesotaUSA
| | - Meghana Rao
- Department of NeurologyMayo ClinicRochesterMinnesotaUSA
| | - Daniell Brushaber
- Department of Quantitative Health SciencesDivision of Biomedical Statistics and InformaticsMayo ClinicRochesterMinnesotaUSA
| | - Joel Kramer
- Department of Neurology, Memory and Aging Center, University of California, San FranciscoWeill Institute for NeurosciencesSan FranciscoCaliforniaUSA
| | - Ariane E. Welch
- Department of Neurology, Memory and Aging Center, University of California, San FranciscoWeill Institute for NeurosciencesSan FranciscoCaliforniaUSA
| | - John Kornak
- Department of Epidemiology and BiostatisticsUniversity of CaliforniaSan FranciscoCaliforniaUSA
| | - Walter Kremers
- Department of Quantitative Health SciencesDivision of Biomedical Statistics and InformaticsMayo ClinicRochesterMinnesotaUSA
| | - Brian Appleby
- Department of NeurologyCase Western Reserve UniversityClevelandOhioUSA
| | - Bradford C. Dickerson
- Department of NeurologyMassachusetts General Hospital and Harvard Medical SchoolBostonMassachusettsUSA
| | | | - Julie A. Fields
- Department of Psychiatry and PsychologyMayo ClinicRochesterMinnesotaUSA
| | - Nupur Ghoshal
- Center for Advanced Medicine Memory Diagnostic CenterWashington UniversitySaint LouisMissouriUSA
| | | | - Murray Grossman
- Department of NeurologyUniversity of PennsylvaniaPhiladelphiaPennsylvaniaUSA
| | - Matthew GH Hall
- Department of Neurology, Memory and Aging Center, University of California, San FranciscoWeill Institute for NeurosciencesSan FranciscoCaliforniaUSA
| | - Edward D. Huey
- Department of NeurologyColumbia UniversityNew YorkNew YorkUSA
| | - David Irwin
- Department of NeurologyUniversity of PennsylvaniaPhiladelphiaPennsylvaniaUSA
| | - Maria I. Lapid
- Department of Psychiatry and PsychologyMayo ClinicRochesterMinnesotaUSA
| | - Irene Litvan
- Department of NeurosciencesUniversity of CaliforniaSan DiegoCaliforniaUSA
| | - Ian R. Mackenzie
- Department of PathologyUniversity of British ColumbiaVancouverBritish ColumbiaCanada
| | | | - Mario F. Mendez
- Department of NeurologyUniversity of CaliforniaLos AngelesCaliforniaUSA
| | - Naomi Nevler
- Department of NeurologyUniversity of PennsylvaniaPhiladelphiaPennsylvaniaUSA
| | - Chiadi U. Onyike
- Department of Psychiatry and Behavioral SciencesJohns Hopkins UniversityBaltimoreMarylandUSA
| | - Belen Pascual
- Department of NeurologyHouston MethodistHoustonTexasUSA
| | - Peter Pressman
- Department of NeurologyUniversity of ColoradoAuroraColoradoUSA
| | - Katherine P. Rankin
- Department of Neurology, Memory and Aging Center, University of California, San FranciscoWeill Institute for NeurosciencesSan FranciscoCaliforniaUSA
| | - Buddhika Ratnasiri
- Department of Neurology, Memory and Aging Center, University of California, San FranciscoWeill Institute for NeurosciencesSan FranciscoCaliforniaUSA
| | - Julio C. Rojas
- Department of Neurology, Memory and Aging Center, University of California, San FranciscoWeill Institute for NeurosciencesSan FranciscoCaliforniaUSA
| | - Maria Carmela Tartaglia
- Tanz Centre for Research in Neurodegenerative Diseases, Division of NeurologyUniversity of TorontoTorontoOntarioCanada
| | - Bonnie Wong
- Department of NeurologyMassachusetts General Hospital and Harvard Medical SchoolBostonMassachusettsUSA
| | - Maria Luisa Gorno‐Tempini
- Department of Neurology, Memory and Aging Center, University of California, San FranciscoWeill Institute for NeurosciencesSan FranciscoCaliforniaUSA
| | | | - Howard J. Rosen
- Department of Neurology, Memory and Aging Center, University of California, San FranciscoWeill Institute for NeurosciencesSan FranciscoCaliforniaUSA
| | - Adam L. Boxer
- Department of Neurology, Memory and Aging Center, University of California, San FranciscoWeill Institute for NeurosciencesSan FranciscoCaliforniaUSA
| | - Adam M. Staffaroni
- Department of Neurology, Memory and Aging Center, University of California, San FranciscoWeill Institute for NeurosciencesSan FranciscoCaliforniaUSA
| |
Collapse
|
6
|
Chen MH, Cherian C, Elenjickal K, Rafizadeh CM, Ross MK, Leow A, DeLuca J. Real-time associations among MS symptoms and cognitive dysfunction using ecological momentary assessment. Front Med (Lausanne) 2023; 9:1049686. [PMID: 36714150 PMCID: PMC9877417 DOI: 10.3389/fmed.2022.1049686] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2022] [Accepted: 12/28/2022] [Indexed: 01/13/2023] Open
Abstract
Introduction Multiple sclerosis (MS) is characterized by a wide range of disabling symptoms, including cognitive dysfunction, fatigue, depression, anxiety, pain, and sleep difficulties. The current study aimed to examine real-time associations between non-cognitive and cognitive symptoms (latter measured both objectively and subjectively in real-time) using smartphone-administered ecological momentary assessment (EMA). Methods Forty-five persons with MS completed EMA four times per day for 3 weeks. For each EMA, participants completed mobile versions of the Trail-Making Test part B (mTMT-B) and a finger tapping task, as well as surveys about symptom severity. Multilevel models were conducted to account for within-person and within-day clustering. Results A total of 3,174 EMA sessions were collected; compliance rate was 84%. There was significant intra-day variability in mTMT-B performance (p < 0.001) and levels of self-reported fatigue (p < 0.001). When participants reported depressive symptoms that were worse than their usual levels, they also performed worse on the mTMT-B (p < 0.001), independent of upper extremity motor functioning. Other self-reported non-cognitive symptoms were not associated with real-time performance on the mTMT-B [p > 0.009 (Bonferroni-corrected)]. In contrast, when self-reported fatigue (p < 0.001), depression (p < 0.001), anxiety (p < 0.001), and pain (p < 0.001) were worse than the individual's typical levels, they also reported more severe cognitive dysfunction at the same time. Further, there was a statistical trend that self-reported cognitive dysfunction (not mTMT-B performance) predicted one's self-reported sense of accomplishment in real-time. Discussion The current study was the first to identify divergent factors that influence subjectively and objectively measured cognitive functioning in real time among persons with MS. Notably, it is when symptom severity was worse than the individual's usual levels (and not absolute levels) that led to cognitive fluctuations, which supports the use of EMA in MS symptom monitoring.
Collapse
Affiliation(s)
- Michelle H. Chen
- Institute for Health, Health Care Policy and Aging Research, Rutgers University, New Brunswick, NJ, United States,Department of Neurology, Robert Wood Johnson Medical School, Rutgers University, New Brunswick, NJ, United States,*Correspondence: Michelle H. Chen,
| | - Christine Cherian
- Institute for Health, Health Care Policy and Aging Research, Rutgers University, New Brunswick, NJ, United States
| | - Karen Elenjickal
- Institute for Health, Health Care Policy and Aging Research, Rutgers University, New Brunswick, NJ, United States
| | - Caroline M. Rafizadeh
- Kessler Foundation, East Hanover, NJ, United States,Department of Physical Medicine and Rehabilitation, New Jersey Medical School, Rutgers University, Newark, NJ, United States
| | - Mindy K. Ross
- Department of Psychiatry, University of Illinois at Chicago, Chicago, IL, United States
| | - Alex Leow
- Department of Psychiatry, University of Illinois at Chicago, Chicago, IL, United States
| | - John DeLuca
- Kessler Foundation, East Hanover, NJ, United States,Department of Physical Medicine and Rehabilitation, New Jersey Medical School, Rutgers University, Newark, NJ, United States
| |
Collapse
|
7
|
Depp CA, Kamarsu S, Filip TF, Parrish EM, Harvey PD, Granholm EL, Chalker S, Moore RC, Pinkham A. Ecological momentary facial emotion recognition in psychotic disorders. Psychol Med 2022; 52:2531-2539. [PMID: 33431072 PMCID: PMC8621678 DOI: 10.1017/s0033291720004419] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/24/2022]
Abstract
BACKGROUND Cognitive tasks delivered during ecological momentary assessment (EMA) may elucidate the short-term dynamics and contextual influences on cognition and judgements of performance. This paper provides initial validation of a smartphone task of facial emotion recognition in serious mental illness. METHODS A total of 86 participants with psychotic disorders (non-affective and affective psychosis), aged 19-65, were administered in-lab 'gold standard' affect recognition, neurocognition, and symptom assessments. They subsequently completed 10 days of the mobile facial emotion recognition task, assessing both accuracy and self-assessed performance, along with concurrent EMA of psychotic symptoms and mood. Validation focused on task adherence and predictors of adherence, gold standard convergent validity, and symptom and diagnostic group variation. RESULTS The mean rate of adherence to the task was 79%; no demographic or clinical variables predicted adherence. Convergent validity was observed with in-lab measures of facial emotion recognition, and no practice effects were observed on the mobile facial emotion recognition task. EMA reports of more severe voices, sadness, and paranoia were associated with worse performance, whereas mood more strongly associated with self-assessed performance. CONCLUSION The mobile facial emotion recognition task was tolerated and demonstrated convergent validity with in-lab measures of the same construct. Social cognitive performance, and biased judgements previously shown to predict function, can be evaluated in real-time in naturalistic environments.
Collapse
Affiliation(s)
- Colin A Depp
- University of California San Diego Department of Psychiatry, San Diego, California, USA
- Veterans Affairs San Diego Healthcare System, San Diego, California, USA
| | - Snigdha Kamarsu
- University of California San Diego Department of Psychiatry, San Diego, California, USA
| | - Tess F Filip
- University of California San Diego Department of Psychiatry, San Diego, California, USA
| | - Emma M Parrish
- University of California San Diego Department of Psychiatry, San Diego, California, USA
- San Diego State University/University of California San Diego Joint Doctoral Program in Clinical Psychology, San Diego, California, USA
| | - Philip D Harvey
- University of Miami Miller School of Medicine, Miami, FL, USA
- Research Service, Bruce W. Carter VA Medical Center, Miami, FL, USA
| | - Eric L Granholm
- University of California San Diego Department of Psychiatry, San Diego, California, USA
- Veterans Affairs San Diego Healthcare System, San Diego, California, USA
| | - Samantha Chalker
- Veterans Affairs San Diego Healthcare System, San Diego, California, USA
| | - Raeanne C Moore
- University of California San Diego Department of Psychiatry, San Diego, California, USA
| | - Amy Pinkham
- The University of Texas at Dallas, Dallas, TX, USA
| |
Collapse
|
8
|
Moore RC, Ackerman RA, Russell MT, Campbell LM, Depp CA, Harvey PD, Pinkham AE. Feasibility and validity of ecological momentary cognitive testing among older adults with mild cognitive impairment. Front Digit Health 2022; 4:946685. [PMID: 35990012 PMCID: PMC9390883 DOI: 10.3389/fdgth.2022.946685] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Accepted: 07/20/2022] [Indexed: 11/23/2022] Open
Abstract
It is critical to intervene early in the mild cognitive impairment (MCI) stage of the Alzheimer's disease trajectory, but traditional cognitive testing methods are costly, burdensome, and difficult to access. We examined adherence and validity data to a 30-day self-administered ecological momentary cognitive testing protocol among a sample of older adults with MCI and cognitively normal controls to evaluate feasibility, tolerability, and initial validity in comparison to standard neuropsychological tests. Participants included 48 participants with MCI (Mean age = 72 years, SD = 7 years) and 46 demographically-matched cognitively normal (NC) control participants (Mean age = 70 years, SD = 7 years). Participants completed traditional neuropsychological testing to determine MCI status, followed by 30 days of remote ecological momentary cognitive testing. Ecological momentary assessment (EMA) surveys were administered 3 times per day for 30 days (possible total = 90), and mobile cognitive tests were administered every other day (for a total of 15 administrations). Mobile cognitive tests included the Variable Difficulty List Memory Test (VLMT; measure of learning and memory), Memory Matrix (measure of visual working memory), and the Color Trick Test (measure of executive function). EMA and mobile cognitive test adherence, fatigue effects, mobile cognitive test performance and group differences, and psychometrics (reliability, convergent validity, ceiling effects, and practice effects) were examined. Overall mean-level adherence to the mobile cognitive tests was 85% and did not differ by MCI status. The reliability of stable between-person individual differences for the VLMT and Memory Matrix were very high. Moreover, although the reliability of within-person change for Memory Matrix was adequate, the corresponding reliability for VLMT was somewhat low. Averaged performance on the mobile cognitive tests was correlated with lab-based tests measuring the same construct. Participants with MCI performed worse than NCs on the VLMT and Color Trick Test, and there was no evidence of fatigue effects for these two tests. These findings support the feasibility and potential for ecological momentary cognitive testing to support clinical trials and for measuring cognitive changes over time in persons with increased risk for Alzheimer's disease such as those with MCI.
Collapse
Affiliation(s)
- Raeanne C. Moore
- Department of Psychiatry, University of California San Diego, La Jolla, CA, United States
- Correspondence: Raeanne C. Moore
| | - Robert A. Ackerman
- Department of Psychology, School of Behavioral and Brain Sciences, The University of Texas at Dallas, Richardson, TX, United States
| | - Madisen T. Russell
- Department of Psychology, School of Behavioral and Brain Sciences, The University of Texas at Dallas, Richardson, TX, United States
| | - Laura M. Campbell
- San Diego State University/University of California San Diego Joint Doctoral Program in Clinical Psychology, San Diego, CA, United States
| | - Colin A. Depp
- Department of Psychiatry, University of California San Diego, La Jolla, CA, United States
- Veterans Affairs San Diego Healthcare System, San Diego, CA, United States
| | - Philip D. Harvey
- Psychiatry and Behavioral Sciences, University of Miami Miller School of Medicine, Miami, FL
- Research Service, Bruce W. Carter VA Medical Center, Miami, FL, United States
| | - Amy E. Pinkham
- Department of Psychology, School of Behavioral and Brain Sciences, The University of Texas at Dallas, Richardson, TX, United States
| |
Collapse
|
9
|
Moore RC, Parrish EM, Van Patten R, Paolillo E, Filip TF, Bomyea J, Lomas D, Twamley EW, Eyler LT, Depp CA. Initial Psychometric Properties of 7 NeuroUX Remote Ecological Momentary Cognitive Tests Among People With Bipolar Disorder: Validation Study. J Med Internet Res 2022; 24:e36665. [PMID: 35904876 PMCID: PMC9377465 DOI: 10.2196/36665] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2022] [Revised: 04/25/2022] [Accepted: 05/29/2022] [Indexed: 01/23/2023] Open
Abstract
BACKGROUND As smartphone technology has become nearly ubiquitous, there is a growing body of literature suggesting that ecological momentary cognitive testing (EMCT) offers advantages over traditional pen-and-paper psychological assessment. We introduce a newly developed platform for the self-administration of cognitive tests in ecologically valid ways. OBJECTIVE The aim of this study is to develop a Health Insurance Portability and Accountability Act-compliant EMCT smartphone-based platform for the frequent and repeated testing of cognitive abilities in everyday life. This study examines the psychometric properties of 7 mobile cognitive tests covering domains of processing speed, visual working memory, recognition memory, and response inhibition within our platform among persons with and without bipolar disorder (BD). Ultimately, if shown to have adequate psychometric properties, EMCTs may be useful in research on BD and other neurological and psychiatric illnesses. METHODS A total of 45 persons with BD and 21 demographically comparable healthy volunteer participants (aged 18-65 years) completed smartphone-based EMCTs 3 times daily for 14 days. Each EMCT session lasted approximately 1.5 minutes. Only 2 to 3 tests were administered in any given session, no test was administered more than once per day, and alternate test versions were administered in each session. RESULTS The mean adherence to the EMCT protocol was 69.7% (SD 20.5%), resulting in 3965 valid and complete tests across the full sample. Participants were significantly more likely to miss tests on later versus earlier study days. Adherence did not differ by diagnostic status, suggesting that BD does not interfere with EMCT participation. In most tests, age and education were related to EMCT performance in expected directions. The average performances on most EMCTs were moderately to strongly correlated with the National Institutes of Health Toolbox Cognition Battery. Practice effects were observed in 5 tests, with significant differences in practice effects by BD status in 3 tests. CONCLUSIONS Although additional reliability and validity data are needed, this study provides initial psychometric support for EMCTs in the assessment of cognitive performance in real-world contexts in BD.
Collapse
Affiliation(s)
- Raeanne C Moore
- Department of Psychiatry, University of California San Diego, San Diego, CA, United States
| | - Emma M Parrish
- Department of Psychiatry, University of California San Diego, San Diego, CA, United States
- SDSU/UC San Diego Joint Doctoral Program in Clinical Psychology, San Diego, CA, United States
| | - Ryan Van Patten
- Psychiatry and Human Behavior, Brown University, Providence, RI, United States
- Providence VA Medical Center, Providence, RI, United States
| | - Emily Paolillo
- Department of Psychiatry, University of California San Diego, San Diego, CA, United States
- SDSU/UC San Diego Joint Doctoral Program in Clinical Psychology, San Diego, CA, United States
| | - Tess F Filip
- Department of Psychiatry, University of California San Diego, San Diego, CA, United States
| | - Jessica Bomyea
- Department of Psychiatry, University of California San Diego, San Diego, CA, United States
- VA San Diego Healthcare System, San Diego, CA, United States
| | - Derek Lomas
- Industrial Design Engineering, Delft University of Technology, Delft, Netherlands
| | - Elizabeth W Twamley
- Department of Psychiatry, University of California San Diego, San Diego, CA, United States
- VA San Diego Healthcare System, San Diego, CA, United States
| | - Lisa T Eyler
- Department of Psychiatry, University of California San Diego, San Diego, CA, United States
- VA San Diego Healthcare System, San Diego, CA, United States
| | - Colin A Depp
- Department of Psychiatry, University of California San Diego, San Diego, CA, United States
- VA San Diego Healthcare System, San Diego, CA, United States
| |
Collapse
|
10
|
Rominger C, Schwerdtfeger AR, Benedek M, Perchtold-Stefan CM, Fink A. Ecological Momentary Assessment of Creative Ideation. EUROPEAN PSYCHOLOGIST 2022. [DOI: 10.1027/1016-9040/a000471] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/22/2022]
Abstract
Abstract. Creative ideas in daily life show substantial variation in quality. Yet, most studies investigate the creative ideation process in highly controlled laboratory contexts, which challenges the ecological validity of creativity research findings. In this article, we advocate the use of ambulatory assessments of creative ideation to gain deeper insight into the variability of ideation processes (between- and within-subjects) in everyday life. We demonstrate this approach by the example of the ambulatory battery of creativity (ABC), which constitutes a reliable and valid approach to assess divergent thinking ability in the verbal and figural domain in everyday life context. Furthermore, it differentiates between-person and within-person variation of creative ideation performance. The first part of this paper will shortly describe the general approach using ABC as an example. In the second part, we use the 7 C’s heuristic to explore applications and implications of this novel method for creativity research. We focus on four C’s with special relevance for ambulatory assessment: Creator, Creating, Context, and Curricula. To this end, we review the findings of strongly controlled laboratory studies and discuss and illustrate applications of the ambulatory assessment. We conclude that the assessment of creative ideation performance in the field might help move the spotlight of creative ideation research from the laboratory to more naturalistic settings. This would increase the ecological validity of creative ideation research and facilitate fresh or unprecedented perspectives on past and future questions on a person’s creative potential and its moment-to-moment fluctuation.
Collapse
Affiliation(s)
| | | | | | | | - Andreas Fink
- Department of Psychology, University of Graz, Austria
| |
Collapse
|
11
|
Hsieh KL, Chen L, Sosnoff JJ. Mobile Technology for Falls Prevention in Older Adults. J Gerontol A Biol Sci Med Sci 2022; 78:861-868. [PMID: 35640254 PMCID: PMC10172979 DOI: 10.1093/gerona/glac116] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2021] [Indexed: 11/14/2022] Open
Abstract
Falls are the leading cause of accidental death in older adults that result from a complex interplay of risk factors. Recently, the need for person-centered approach utilizing personalization, prediction, prevention and participation, known as the P4 model, in fall prevention has been highlighted. Features of mobile technology make it a suitable technological infrastructure to employ such an approach. This narrative review aims to review the evidence for using mobile technology for personalized fall risk assessment and prevention since 2017 in older adults. We aim to identify lessons learned and future directions for using mobile technology as a fall risk assessment and prevention tool. Articles were searched in PubMed and Web of Science with search terms related to older adults, mobile technology, and falls prevention. A total of 23 articles were included. Articles were identified as those examining aspects of the P4 model including prediction (measurement of fall risk), personalization (usability), prevention, and participation. Mobile technology appears to be comparable to gold-standard technology in measuring well-known fall risk factors including static and dynamic balance. Seven applications were developed to measure different fall risk factors and tested for personalization, and/or participation aspects, and four were integrated into a falls prevention program. Mobile health technology offers an innovative solution to provide tailored fall risk screening, prediction, and participation. Future studies should incorporate multiple, objective fall risk measures and implement them in community settings to determine if mobile technology can offer tailored and scalable interventions.
Collapse
Affiliation(s)
- Katherine L Hsieh
- Department of Internal Medicine, Section of Gerontology and Geriatric Medicine, Wake Forest School of Medicine
| | - Lingjun Chen
- Department of Physical Therapy, Rehabilitation Science, and Athletic Training, University of Kansas Medical Center
| | - Jacob J Sosnoff
- Department of Physical Therapy, Rehabilitation Science, and Athletic Training, University of Kansas Medical Center
| |
Collapse
|
12
|
Weizenbaum EL, Fulford D, Torous J, Pinsky E, Kolachalama VB, Cronin-Golomb A. Smartphone-Based Neuropsychological Assessment in Parkinson's Disease: Feasibility, Validity, and Contextually Driven Variability in Cognition. J Int Neuropsychol Soc 2022; 28:401-413. [PMID: 33998438 PMCID: PMC10474573 DOI: 10.1017/s1355617721000503] [Citation(s) in RCA: 17] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
OBJECTIVES The prevalence of neurodegenerative disorders demands methods of accessible assessment that reliably captures cognition in daily life contexts. We investigated the feasibility of smartphone cognitive assessment in people with Parkinson's disease (PD), who may have cognitive impairment in addition to motor-related problems that limit attending in-person clinics. We examined how daily-life factors predicted smartphone cognitive performance and examined the convergent validity of smartphone assessment with traditional neuropsychological tests. METHODS Twenty-seven nondemented individuals with mild-moderate PD attended one in-lab session and responded to smartphone notifications over 10 days. The smartphone app queried participants 5x/day about their location, mood, alertness, exercise, and medication state and administered mobile games of working memory and executive function. RESULTS Response rate to prompts was high, demonstrating feasibility of the approach. Between-subject reliability was high on both cognitive games. Within-subject variability was higher for working memory than executive function. Strong convergent validity was seen between traditional tests and smartphone working memory but not executive function, reflecting the latter's ceiling effects. Participants performed better on mobile working memory tasks when at home and after recent exercise. Less self-reported daytime sleepiness and lower PD symptom burden predicted a stronger association between later time of day and higher smartphone test performance. CONCLUSIONS These findings support feasibility and validity of repeat smartphone assessments of cognition and provide preliminary evidence of the effects of context on cognitive variability in PD. Further development of this accessible assessment method could increase sensitivity and specificity regarding daily cognitive dysfunction for PD and other clinical populations.
Collapse
Affiliation(s)
- Emma L. Weizenbaum
- Department of Psychological and Brain Sciences, Boston University, Boston, MA, USA
| | - Daniel Fulford
- Department of Psychological and Brain Sciences, Boston University, Boston, MA, USA
- Department of Occupational Therapy and Rehabilitation Sciences, Boston University, Boston, MA, USA
| | - John Torous
- Department of Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | - Emma Pinsky
- Department of Psychological and Brain Sciences, Boston University, Boston, MA, USA
- Department of Psychology, Bryn Mawr College, Bryn Mawr, PA, USA
| | - Vijaya B. Kolachalama
- Section of Computational Biomedicine, Department of Medicine, Boston University School of Medicine, Boston, MA, USA
- Department of Computer Science, and Faculty of Computing and Data Sciences, Boston University Alzheimer’s Disease Center; Boston University, Boston, MA, USA
| | - Alice Cronin-Golomb
- Department of Psychological and Brain Sciences, Boston University, Boston, MA, USA
| |
Collapse
|
13
|
Zlatar ZZ, Campbell LM, Tang B, Gabin S, Heaton A, Higgins M, Swendsen J, Moore DJ, Moore RC. Daily Level Association of Physical Activity and Performance on Ecological Momentary Cognitive Tests in Free-living Environments: A Mobile Health Observational Study. JMIR Mhealth Uhealth 2022; 10:e33747. [PMID: 35099402 PMCID: PMC8845015 DOI: 10.2196/33747] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Revised: 11/23/2021] [Accepted: 12/09/2021] [Indexed: 01/04/2023] Open
Abstract
BACKGROUND Research suggests that physical activity (PA) has both acute and chronic beneficial effects on cognitive function in laboratory settings and under supervised conditions. Mobile health technologies make it possible to reliably measure PA and cognition in free-living environments, thus increasing generalizability and reach. Research is needed to determine whether the benefits of PA on cognitive function extend from the laboratory to real-world contexts. OBJECTIVE This observational study aims to examine the association between daily fluctuations in PA and cognitive performance using mobile health technologies in free-living environments. METHODS A total of 90 adults (mean age 59, SD 6.3 years; 65/90, 72% men) with various comorbidities (eg, cardiovascular risk and HIV) and different levels of baseline cognition (ranging from cognitively normal to impaired) completed ecological momentary cognitive tests (EMCTs) on a smartphone twice daily while wearing an accelerometer to capture PA levels for 14 days. Linear mixed-effects models examined the daily associations of PA with executive function and verbal learning EMCTs. Moderation analyses investigated whether the relationship between daily PA and daily performance on EMCTs changed as a function of baseline cognition, cardiovascular risk, and functional status (independent vs dependent). RESULTS Days with greater PA were associated with better (faster) performance on an executive function EMCT after covariate adjustment (estimate -0.013; β=-.16; P=.04). Moderation analyses (estimate 0.048; β=.58; P=.001) indicated that days with greater PA were associated with better (faster) executive function performance in individuals who were functionally dependent (effect size -0.53; P<.001) and not in functionally independent adults (effect size -0.01; P=.91). CONCLUSIONS EMCTs may be a sensitive tool for capturing daily-level PA-related fluctuations in cognitive performance in real-world contexts and could be a promising candidate for tracking cognitive performance in digital health interventions aimed at increasing PA. Further research is needed to determine individual characteristics that may moderate the association between daily PA and EMCT performance in free-living environments.
Collapse
Affiliation(s)
- Zvinka Z Zlatar
- Department of Psychiatry, University of California, San Diego, La Jolla, CA, United States
| | - Laura M Campbell
- San Diego Joint Doctoral Program in Clinical Psychology, San Diego State University/University of California, San Diego, CA, United States
| | - Bin Tang
- Department of Psychiatry, University of California, San Diego, La Jolla, CA, United States
| | - Spenser Gabin
- Department of Counseling and Marital and Family Therapy, University of San Diego, San Diego, CA, United States
| | - Anne Heaton
- Department of Psychiatry, University of California, San Diego, La Jolla, CA, United States
| | - Michael Higgins
- Herbert Wertheim School of Public Health and Human Longevity Science, University of California San Diego, La Jolla, CA, United States
| | - Joel Swendsen
- National Center for Scientific Research, University of Bordeaux, Bordeaux, France
- Ecole Pratique des Hautes Etudes PSL Research University, Paris, France
| | - David J Moore
- Department of Psychiatry, University of California, San Diego, La Jolla, CA, United States
| | - Raeanne C Moore
- Department of Psychiatry, University of California, San Diego, La Jolla, CA, United States
| |
Collapse
|
14
|
Wilson S, Milanini B, Javandel S, Nyamayaro P, Valcour V. Validity of Digital Assessments in Screening for HIV-Related Cognitive Impairment: a Review. Curr HIV/AIDS Rep 2021; 18:581-592. [PMID: 34820750 PMCID: PMC8612826 DOI: 10.1007/s11904-021-00585-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/13/2021] [Indexed: 10/31/2022]
Abstract
PURPOSE OF REVIEW While traditional neuropsychological tests are the gold standard in screening for HIV-related cognitive impairment, computerized neuropsychological assessment devices (CNADs) offer an alternative to these time- and resource-intensive batteries and may prove to be particularly useful for remote assessments or longitudinal monitoring. This review seeks to describe the benefits, limitations, and validity of CNADs in the evaluation of HIV-associated neurocognitive disorder (HAND). RECENT FINDINGS We identified eight CNADs that have undergone validity testing for cognitive impairment in the setting of HIV. Included among these are batteries that have been modeled after the traditional neuropsychological exam, as well as others that implement new technologies, such as simulated reality and daily ecological assessments in their testing. Currently, these digital batteries do not yet have the ability to supplant gold standard neuropsychological tests in screening for HAND. However, many have the potential to become effective clinical screening tools.
Collapse
Affiliation(s)
- Samuel Wilson
- Memory and Aging Center, Department of Neurology, University of California, San Francisco, 675 Nelson Rising Lane, Suite 190, San Francisco, CA, 94158, USA
| | - Benedetta Milanini
- Memory and Aging Center, Department of Neurology, University of California, San Francisco, 675 Nelson Rising Lane, Suite 190, San Francisco, CA, 94158, USA
| | - Shireen Javandel
- Memory and Aging Center, Department of Neurology, University of California, San Francisco, 675 Nelson Rising Lane, Suite 190, San Francisco, CA, 94158, USA
- Global Brain Health Institute, University of California, San Francisco, San Francisco, CA, USA
| | - Primrose Nyamayaro
- Global Brain Health Institute, University of California, San Francisco, San Francisco, CA, USA
- Faculty of Medicine and Health Sciences, University of Zimbabwe, Harare, Zimbabwe
| | - Victor Valcour
- Memory and Aging Center, Department of Neurology, University of California, San Francisco, 675 Nelson Rising Lane, Suite 190, San Francisco, CA, 94158, USA.
- Global Brain Health Institute, University of California, San Francisco, San Francisco, CA, USA.
| |
Collapse
|
15
|
Van Patten R, Iverson GL, Muzeau MA, VanRavenhorst-Bell HA. Test-Retest Reliability and Reliable Change Estimates for Four Mobile Cognitive Tests Administered Virtually in Community-Dwelling Adults. Front Psychol 2021; 12:734947. [PMID: 34744906 PMCID: PMC8566921 DOI: 10.3389/fpsyg.2021.734947] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2021] [Accepted: 09/23/2021] [Indexed: 11/13/2022] Open
Abstract
Objective: Remote mobile cognitive testing (MCT) is an expanding area of research, but psychometric data supporting these measures are limited. We provide preliminary data on test-retest reliability and reliable change estimates in four MCTs from SWAY Medical, Inc. Methods: Fifty-five adults from the U.S. Midwest completed the MCTs remotely on their personal mobile devices once per week for 3 consecutive weeks, while being supervised with a video-based virtual connection. The cognitive assessment measured simple reaction time ("Reaction Time"), go/no-go response inhibition ("Impulse Control"), timed visual processing ("Inspection Time"), and working memory ("Working Memory"). For each cognitive test except Working Memory, we analyzed both millisecond (ms) responses and an overall SWAY composite score. Results: The mean age of the sample was 26.69years (SD=9.89; range=18-58). Of the 55 adults, 38 (69.1%) were women and 49 (89.1%) used an iPhone. Friedman's ANOVAs examining differences across testing sessions were nonsignificant (ps>0.31). Intraclass correlations for Weeks 1-3 were: Reaction Time (ms): 0.83, Reaction Time (SWAY): 0.83, Impulse Control (ms): 0.68, Impulse Control (SWAY): 0.80, Inspection Time (ms): 0.75, Inspection Time (SWAY): 0.75, and Working Memory (SWAY): 0.88. Intraclass correlations for Weeks 1-2 were: Reaction Time (ms): 0.75, Reaction Time (SWAY): 0.74, Impulse Control (ms): 0.60, Impulse Control (SWAY): 0.76, Inspection Time (ms): 0.79, Inspection Time (SWAY): 0.79, and Working Memory (SWAY): 0.83. Natural distributions of difference scores were calculated and reliable change estimates are presented for 70, 80, and 90% CIs. Conclusion: Test-retest reliability was adequate or better for the MCTs in this virtual remote testing study. Reliable change estimates allow for the determination of whether a particular level of improvement or decline in performance is within the range of probable measurement error. Additional reliability and validity data are needed in other age groups.
Collapse
Affiliation(s)
- Ryan Van Patten
- Department of Physical Medicine and Rehabilitation, Harvard Medical School, Boston, MA, United States
- Spaulding Rehabilitation Hospital, Charlestown, MA, United States
| | - Grant L. Iverson
- Department of Physical Medicine and Rehabilitation, Harvard Medical School, Boston, MA, United States
- Spaulding Rehabilitation Hospital, Charlestown, MA, United States
- Home Base, A Red Sox Foundation and Massachusetts General Hospital Program, Charlestown, MA, United States
- Sports Concussion Program, MassGeneral Hospital for Children, Boston, MA, United States
- Spaulding Rehabilitation Institute, Charlestown, MA, United States
| | | | | |
Collapse
|
16
|
Use of digital health technologies to examine subjective and objective sleep with next-day cognition and daily indicators of health in persons with and without HIV. J Behav Med 2021; 45:62-75. [PMID: 34370189 PMCID: PMC8818628 DOI: 10.1007/s10865-021-00233-x] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2020] [Accepted: 05/27/2021] [Indexed: 01/08/2023]
Abstract
Most previous studies investigating sleep's association with health outcomes have relied on averaged sleep quality and laboratory-based health measures. This study examines the dynamic within-person relationships between subjective (Ecological Momentary Assessment) and objective sleep (actigraphy) on next-day cognition (subjective and objective), mood, and engagement in daily activities using linear mixed-effects regression modeling. Participants included 94 individuals (59 people with HIV, 35 HIV-) aged 50-74, assessed daily for 14 consecutive days/nights. Subjective and objective sleep were well correlated and were both associated with subjective ratings of cognition, but not objective cognition. Worse subjective sleep was associated with next-day lower happiness and higher depressed mood, and more pain, but was not related to next-day daily activities. Objective sleep was associated with next-day depressed mood and feelings of worry, and was positively associated with next-day television watching. Results provide evidence to support the utility of real-time assessment for sleep and functional outcomes that may lead to potential personalized interventions for individuals with and without HIV.
Collapse
|
17
|
Weiner L, Guidi A, Doignon-Camus N, Giersch A, Bertschy G, Vanello N. Vocal features obtained through automated methods in verbal fluency tasks can aid the identification of mixed episodes in bipolar disorder. Transl Psychiatry 2021; 11:415. [PMID: 34341338 PMCID: PMC8329226 DOI: 10.1038/s41398-021-01535-z] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/29/2020] [Revised: 07/05/2021] [Accepted: 07/26/2021] [Indexed: 02/07/2023] Open
Abstract
There is a lack of consensus on the diagnostic thresholds that could improve the detection accuracy of bipolar mixed episodes in clinical settings. Some studies have shown that voice features could be reliable biomarkers of manic and depressive episodes compared to euthymic states, but none thus far have investigated whether they could aid the distinction between mixed and non-mixed acute bipolar episodes. Here we investigated whether vocal features acquired via verbal fluency tasks could accurately classify mixed states in bipolar disorder using machine learning methods. Fifty-six patients with bipolar disorder were recruited during an acute episode (19 hypomanic, 8 mixed hypomanic, 17 with mixed depression, 12 with depression). Nine different trials belonging to four conditions of verbal fluency tasks-letter, semantic, free word generation, and associational fluency-were administered. Spectral and prosodic features in three conditions were selected for the classification algorithm. Using the leave-one-subject-out (LOSO) strategy to train the classifier, we calculated the accuracy rate, the F1 score, and the Matthews correlation coefficient (MCC). For depression versus mixed depression, the accuracy and F1 scores were high, i.e., respectively 0.83 and 0.86, and the MCC was of 0.64. For hypomania versus mixed hypomania, accuracy and F1 scores were also high, i.e., 0.86 and 0.75, respectively, and the MCC was of 0.57. Given the high rates of correctly classified subjects, vocal features quickly acquired via verbal fluency tasks seem to be reliable biomarkers that could be easily implemented in clinical settings to improve diagnostic accuracy.
Collapse
Affiliation(s)
- Luisa Weiner
- INSERM 1114, Strasbourg, France. .,University Hospital of Strasbourg, Strasbourg, France. .,Laboratoire de Psychologie des Cognitions, Université de Strasbourg, Strasbourg, France.
| | - Andrea Guidi
- grid.5395.a0000 0004 1757 3729Dipartimento di Ingegneria dell’Informazione, University of Pisa, Via G. Caruso 16, 56122 Pisa, Italy ,grid.5395.a0000 0004 1757 3729Research Center “E. Piaggio”, University of Pisa, Largo L, Lazzarino 1, 56122 Pisa, Italy
| | | | - Anne Giersch
- grid.7429.80000000121866389INSERM 1114, Strasbourg, France
| | - Gilles Bertschy
- grid.7429.80000000121866389INSERM 1114, Strasbourg, France ,grid.412220.70000 0001 2177 138XUniversity Hospital of Strasbourg, Strasbourg, France ,grid.11843.3f0000 0001 2157 9291Fédération de Médecine Translationnelle de Strasbourg, Université de Strasbourg, Strasbourg, France
| | - Nicola Vanello
- grid.5395.a0000 0004 1757 3729Dipartimento di Ingegneria dell’Informazione, University of Pisa, Via G. Caruso 16, 56122 Pisa, Italy ,grid.5395.a0000 0004 1757 3729Research Center “E. Piaggio”, University of Pisa, Largo L, Lazzarino 1, 56122 Pisa, Italy
| |
Collapse
|
18
|
Deng L, Zhang X, Gao Y, Turner D, Qian F, Lu H, Vermund SH, Zhang Y, Qian HZ. Association of HIV infection and cognitive impairment in older adults: A meta-analysis. Ageing Res Rev 2021; 68:101310. [PMID: 33640473 PMCID: PMC10767715 DOI: 10.1016/j.arr.2021.101310] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2020] [Revised: 01/27/2021] [Accepted: 02/22/2021] [Indexed: 12/13/2022]
Abstract
OBJECTIVE To synthesize evidence on the association between human immunodeficiency virus (HIV) infection and cognitive impairment in older adults. DESIGN Meta-analysis. PARTICIPANTS Adults aged 50 years or older. METHODS In this systematic literature review and meta-analysis, we searched PubMed, Scopus, Embase, and APA/PsycNet for studies published before July 21, 2020, that assessed the association between HIV-infection and cognitive impairment. We calculated pooled odds ratios (ORs) of cognitive impairment for people living with HIV (PLWH) and 95 % confidence intervals (CIs) using random-effect models and calculated pooled mean difference (MD) for major cognitive domains between PLWH and HIV-uninfected adults. We assessed risk of bias using the Newcastle-Ottawa scale. RESULTS Of the 4432 studies identified, 21 cross-sectional studies were eligible for the meta-analysis, including 15 examining global cognitive impairment. The meta-analysis showed that older PLWH were more likely to be cognitively impaired than HIV-uninfected controls (OR = 2.44, 95 % CI = [1.69, 3.53], number of estimates (k) = 15, I2 = 71 %). This higher likelihood was shown in studies from high income countries (OR = 2.63, 95 % CI = [1.76, 3.94], k = 12, I2 = 55 %), but not from upper-middle income countries (OR = 1.96, 95 % CI = [0.26, 14.68], k = 3, I2 = 91 %). PLWH had lower scores than HIV-uninfected adults in 5 out of 7 major cognitive domains, including executive function (MD = -0.42, 95 % CI = [-0.72, -0.11], k = 5, I2 = 32 %), processing speed (MD = -0.33, 95 % CI = [-0.59, -0.08], k = 6, I2 = 16 %), verbal (MD=-0.29, 95 % CI = [-0.48, -0.10], k = 6, I2 = 0%), recall (MD = -0.24, 95 % CI = [-0.38, -0.10], k = 6, I2 = 0%) and motor/psychomotor (MD = -0.38, 95 % CI = [-0.59, -0.16], k = 5, I2 = 31 %) performance. CONCLUSIONS/IMPLICATIONS Our meta-analysis provides empirical evidence that HIV infection is associated with an increased risk of cognitive impairment among older adults, especially in cognitive domains of executive function, processing speed, verbal, recall, and motor/psychomotor.
Collapse
Affiliation(s)
- Luojia Deng
- Department of Bioinformatics and Biostatistics, School of Life Sciences and Biotechnology, Shanghai Jiao Ting University, Shanghai, China.
| | - Xuezhixing Zhang
- Department of Bioinformatics and Biostatistics, School of Life Sciences and Biotechnology, Shanghai Jiao Ting University, Shanghai, China.
| | - Yanxiao Gao
- School of Public Health (Shenzhen), Sun Yat-sen University, Shenzhen, China.
| | - DeAnne Turner
- Center for Interdisciplinary Research on AIDS, Yale University, New Haven, CT, USA; School of Public Health, Yale University, New Haven, CT, USA.
| | - Frank Qian
- Department of Medicine, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA.
| | - Hui Lu
- Department of Bioinformatics and Biostatistics, School of Life Sciences and Biotechnology, Shanghai Jiao Ting University, Shanghai, China; SJTU-Yale Joint Center for Biostatistics and Data Science, Shanghai Jiao Tong University, Shanghai, China.
| | - Sten H Vermund
- School of Public Health, Yale University, New Haven, CT, USA.
| | - Yue Zhang
- Department of Bioinformatics and Biostatistics, School of Life Sciences and Biotechnology, Shanghai Jiao Ting University, Shanghai, China; SJTU-Yale Joint Center for Biostatistics and Data Science, Shanghai Jiao Tong University, Shanghai, China.
| | - Han-Zhu Qian
- School of Public Health, Yale University, New Haven, CT, USA; SJTU-Yale Joint Center for Biostatistics and Data Science, Shanghai Jiao Tong University, Shanghai, China.
| |
Collapse
|
19
|
Zainal NH, Newman MG. Depression and executive functioning bidirectionally impair one another across 9 years: Evidence from within-person latent change and cross-lagged models. Eur Psychiatry 2021; 64:e43. [PMID: 34134796 PMCID: PMC8278253 DOI: 10.1192/j.eurpsy.2021.2217] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/18/2021] [Revised: 06/05/2021] [Accepted: 06/07/2021] [Indexed: 01/17/2023] Open
Abstract
BACKGROUND Scar and vulnerability models assert that increased psychopathology may predict subsequent executive functioning (EF) deficits (and vice versa) over protracted timescales, yet most prior work on this topic has been cross-sectional. Thus, we tested the within- and between-person relations between EF, depression, and anxiety. METHODS Older adult participants (n = 856) were assessed across four waves, approximately 2 years apart. Performance-based EF and caregiver-rated symptom measures were administered. Bivariate latent change score and random-intercept cross-lagged panel models were conducted. RESULTS Within persons, random-intercept cross-lagged panel models revealed that prior greater depression forecasted lower subsequent EF, and vice versa (d = -0.292 vs. -0.292). Bivariate dual latent change score models showed that within-person rise in depression predicted EF decreases, and vice versa (d = -0.245 vs. -0.245). No within-person, cross-lagged, EF-anxiety relations emerged. Further, significant negative between-person EF-symptom relations were observed (d = -0.264 to -0.395). CONCLUSION Prospective, within-person findings offer some evidence for developmental scar and vulnerability models.
Collapse
Affiliation(s)
- Nur Hani Zainal
- National University of Singapore, Kent Ridge Campus, Singapore
| | | |
Collapse
|
20
|
Le TP, Moscardini E, Cowan T, Elvevåg B, Holmlund TB, Foltz PW, Tucker RP, Schwartz EK, Cohen AS. Predicting self-injurious thoughts in daily life using ambulatory assessment of state cognition. J Psychiatr Res 2021; 138:335-341. [PMID: 33895607 DOI: 10.1016/j.jpsychires.2021.04.013] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/11/2020] [Revised: 03/17/2021] [Accepted: 04/08/2021] [Indexed: 01/22/2023]
Abstract
Self-injurious thoughts (SITs) fluctuate considerably from moment to moment. As such, "static" and temporally stable predictors (e.g., demographic variables, prior history) are suboptimal in predicting imminent SITs. This concern is particularly true for "online" cognitive abilities, which are important for understanding SITs, but are typically measured using tests selected for temporal stability. Advances in ambulatory assessments (i.e., real-time assessment in a naturalistic environment) allow for measuring cognition with improved temporal resolution. The present study measured relationships between "state" cognitive performance, measured using an ambulatory-based Trail Making Test, and SITs. Self-reported state hope and social connectedness was also measured. Data were collected using a specially designed mobile application (administered 4x/week up to 28 days) in substance use inpatients (N = 99). Consistent with prior literature, state hope and social connectedness was significantly associated with state SITs. Importantly, poorer state cognitive performance also significantly predicted state SITs, independent of hallmark static and state self-report risk variables. These findings highlight the potential importance of "online" cognition to predict SITs. Ambulatory recording reflects an efficient, sensitive, and ecological valid methodology for evaluating subjective and objectives predictors of imminent SITs.
Collapse
Affiliation(s)
- Thanh P Le
- Department of Psychology, Louisiana State University, USA.
| | | | - Tovah Cowan
- Department of Psychology, Louisiana State University, USA
| | - Brita Elvevåg
- Department of Clinical Medicine, University of Tromsø - the Arctic University of Norway, Norway; The Norwegian Centre for eHealth Research, University Hospital of North Norway, Norway
| | - Terje B Holmlund
- Department of Clinical Medicine, University of Tromsø - the Arctic University of Norway, Norway
| | - Peter W Foltz
- Institue of Cognitive Science, University of Colorado Boulder, USA
| | | | | | - Alex S Cohen
- Department of Psychology, Louisiana State University, USA
| |
Collapse
|
21
|
Moore RC, Paolillo EW, Sundermann EE, Campbell LM, Delgadillo J, Heaton A, Swendsen J, Depp CA. Validation of the mobile verbal learning test: Illustration of its use for age and disease-related cognitive deficits. Int J Methods Psychiatr Res 2021; 30:e1859. [PMID: 33159488 PMCID: PMC7992286 DOI: 10.1002/mpr.1859] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/26/2020] [Revised: 09/30/2020] [Accepted: 10/06/2020] [Indexed: 11/09/2022] Open
Abstract
OBJECTIVE We developed a mobile cognitive test of verbal learning and memory, the mobile verbal learning test (mVLT), to allow for brief, repeated and portable delivery of a 12-item list learning test through a smartphone. This study examined the psychometric properties of the mVLT among older persons with and without human immunodeficiency virus (HIV). METHODS Sixty-eight persons with HIV and 36 HIV-negative individuals (aged 50-74) completed three trials of the mVLT on a smartphone once daily for 14 days. A different word list was administered each day. RESULTS Participants completed 80% of the 14 mVLT administrations, equating to 1166 valid and complete mVLTs. Neither adherence nor mean mVLT total score (number correct in 3 recall trials) differed by HIV status. No practice effects from repeated mVLT administration were observed, and there were moderately strong correlations of mVLT performance with performance on the in-lab version of the task and with traditional cognitive assessments of cognitive processes contributing to memory. We found evidence of within-person learning across mVLT trials, with persons with HIV demonstrating less learning from trials 1 to 3 compared to HIV-negative participants. CONCLUSIONS The mVLT is a valid method to assess learning in the real world in older adults with and without HIV.
Collapse
Affiliation(s)
- Raeanne C Moore
- Department of Psychiatry, University of California San Diego, San Diego, California, USA
| | - Emily W Paolillo
- Department of Psychiatry, University of California San Diego, San Diego, California, USA.,SDSU/UC San Diego Joint Doctoral Program in Clinical Psychology, San Diego, California, USA
| | - Erin E Sundermann
- Department of Psychiatry, University of California San Diego, San Diego, California, USA
| | - Laura M Campbell
- Department of Psychiatry, University of California San Diego, San Diego, California, USA.,SDSU/UC San Diego Joint Doctoral Program in Clinical Psychology, San Diego, California, USA
| | - Jeremy Delgadillo
- Advancing Diversity in Aging Research (ADAR) Program, San Diego State University, San Diego, California, USA
| | - Anne Heaton
- Department of Psychiatry, University of California San Diego, San Diego, California, USA
| | - Joel Swendsen
- National Center for Scientific Research, University of Bordeaux, EPHE PSL Research University, Bordeaux, France
| | - Colin A Depp
- Department of Psychiatry, University of California San Diego, San Diego, California, USA.,VA San Diego Healthcare System, San Diego, California, USA
| |
Collapse
|
22
|
Kohli M, Moore DJ, Moore RC. Using health technology to capture digital phenotyping data in HIV-associated neurocognitive disorders. AIDS 2021; 35:15-22. [PMID: 33048886 PMCID: PMC7718372 DOI: 10.1097/qad.0000000000002726] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Affiliation(s)
- Maulika Kohli
- San Diego State University/University of California, San Diego Joint Doctoral Program in Clinical Psychology
- HIV Neurobehavioral Research Program, Department of Psychiatry, University of California, San Diego, San Diego, California, USA
| | - David J Moore
- HIV Neurobehavioral Research Program, Department of Psychiatry, University of California, San Diego, San Diego, California, USA
| | - Raeanne C Moore
- HIV Neurobehavioral Research Program, Department of Psychiatry, University of California, San Diego, San Diego, California, USA
| |
Collapse
|
23
|
Campbell LM, Paolillo EW, Heaton A, Tang B, Depp CA, Granholm E, Heaton RK, Swendsen J, Moore DJ, Moore RC. Daily Activities Related to Mobile Cognitive Performance in Middle-Aged and Older Adults: An Ecological Momentary Cognitive Assessment Study. JMIR Mhealth Uhealth 2020; 8:e19579. [PMID: 32969829 PMCID: PMC7545331 DOI: 10.2196/19579] [Citation(s) in RCA: 26] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2020] [Revised: 08/05/2020] [Accepted: 08/06/2020] [Indexed: 12/12/2022] Open
Abstract
Background Daily activities have been associated with neurocognitive performance. However, much of this research has used in-person neuropsychological testing that requires participants to travel to a laboratory or clinic, which may not always be feasible and does not allow for the examination of real-time relationships between cognition and behavior. Thus, there is a need to understand the real-time relationship between activities in the real world and neurocognitive functioning to improve tracking of symptoms or disease states and aid in the early identification of neurocognitive deficits among at-risk individuals. Objective We used a smartphone-based ecological momentary cognitive assessment (EMCA) platform to examine real-time relationships between daily activities and neurocognitive performance (executive functioning and verbal learning) in the everyday environment of middle-aged and older adults with and without HIV. Methods A total of 103 adults aged 50-74 years (67 persons with HIV; mean age 59 years, SD 6.4) were recruited from the University of California, San Diego HIV Neurobehavioral Research Program and the San Diego community. Participants completed our EMCA protocol for 14 days. Participants reported their current daily activities 4 times per day; following 2 of the 4 daily ecological momentary assessment (EMA) surveys, participants were administered the mobile Color-Word Interference Test (mCWIT) and mobile Verbal Learning Test (mVLT), each once per day. Activities were categorized into cognitively stimulating activities, passive leisure activities, and instrumental activities of daily living (IADLs). We used multilevel modeling to examine the same-survey and lagged within-person and between-person effects of each activity type on mobile cognitive performance. Results On average, participants completed 91% of the EMA surveys, 85% of the mCWIT trials, and 80% of the mVLT trials, and they reported engaging in cognitively stimulating activities on 17% of surveys, passive leisure activities on 33% of surveys, and IADLs on 20% of surveys. Adherence and activity percentages did not differ by HIV status. Within-persons, engagement in cognitively stimulating activities was associated with better mCWIT performance (β=−1.12; P=.007), whereas engagement in passive leisure activities was associated with worse mCWIT performance (β=.94; P=.005). There were no lagged associations. At the aggregate between-person level, a greater percentage of time spent in cognitively stimulating activities was associated with better mean mVLT performance (β=.07; P=.02), whereas a greater percentage of time spent in passive leisure activities was associated with worse mean mVLT performance (β=−.07; P=.01). IADLs were not associated with mCWIT or mVLT performance. Conclusions Smartphones present unique opportunities for assessing neurocognitive performance and behavior in middle-aged and older adults’ own environment. Measurement of cognition and daily functioning outside of clinical settings may generate novel insights on the dynamic association of daily behaviors and neurocognitive performance and may add new dimensions to understanding the complexity of human behavior.
Collapse
Affiliation(s)
- Laura M Campbell
- SDSU/UC San Diego Joint Doctoral Program in Clinical Psychology, San Diego, CA, United States.,Department of Psychiatry, University of California San Diego, San Diego, CA, United States
| | - Emily W Paolillo
- SDSU/UC San Diego Joint Doctoral Program in Clinical Psychology, San Diego, CA, United States.,Department of Psychiatry, University of California San Diego, San Diego, CA, United States
| | - Anne Heaton
- Department of Psychiatry, University of California San Diego, San Diego, CA, United States
| | - Bin Tang
- Department of Psychiatry, University of California San Diego, San Diego, CA, United States
| | - Colin A Depp
- Department of Psychiatry, University of California San Diego, San Diego, CA, United States
| | - Eric Granholm
- Department of Psychiatry, University of California San Diego, San Diego, CA, United States.,VA San Diego Healthcare System, San Diego, CA, United States
| | - Robert K Heaton
- Department of Psychiatry, University of California San Diego, San Diego, CA, United States
| | - Joel Swendsen
- CNRS UMR, University of Bordeaux, Bordeaux, France.,National Center for Scientific Research, Ecole Pratique des Hautes Etudes, PSL Research University, Paris, France
| | - David J Moore
- Department of Psychiatry, University of California San Diego, San Diego, CA, United States
| | - Raeanne C Moore
- Department of Psychiatry, University of California San Diego, San Diego, CA, United States
| |
Collapse
|