1
|
Linardon J, Chen K, Gajjar S, Eadara A, Wang S, Flathers M, Burns J, Torous J. Smartphone digital phenotyping in mental health disorders: A review of raw sensors utilized, machine learning processing pipelines, and derived behavioral features. Psychiatry Res 2025; 348:116483. [PMID: 40187059 DOI: 10.1016/j.psychres.2025.116483] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/10/2024] [Revised: 03/18/2025] [Accepted: 04/01/2025] [Indexed: 04/07/2025]
Abstract
With increased access to digital technology, there has been a surge in the use of and interest in digital phenotyping as a tool to calculate various features from raw smart device data. However, the increased usage of digital phenotyping has created confusion. The vast number of sensors that can be utilized to collect passive data, and diverse methods utilized to convert that sensor data into features has introduced conflicting results and conclusions into the literature. Consequently, there is an identified need for standardizing how digital phenotyping data is measured and collected. This review evaluates the different sensors and methods utilized in digital phenotyping research across 112 papers, with the goal of finding the most common platforms, sensors, and methods for each behavioral measure. This should help guide future digital phenotyping research, and resolve some existing confusion in the field. Information on each study's data sensor variables were tracked and consolidated into a double-coded Codebook. Variables assessed included but were not limited to data sensors, features extracted from data sensors, statistical methods used, phone type, patient access to phones, and characteristics of patient population. This review found that most studies used Android devices (n = 67) or both Android and iPhone (n = 38) with an average duration of 14.3 weeks. The GPS sensor was also found to be the most frequently used sensor. This review underscores the need for standardization in methodological reporting, sensor utilization, and feature extraction across mental health studies.
Collapse
Affiliation(s)
- Jake Linardon
- SEED Lifespan Strategic Research Centre, School of Psychology, Faculty of Health, Deakin University, Geelong, Australia
| | - Kelly Chen
- Beth Israel Deaconess Medical Center, Harvard Medical School, 330 Brookline Ave, Boston, MA, 02115, Boston, MA, USA
| | - Shruti Gajjar
- Beth Israel Deaconess Medical Center, Harvard Medical School, 330 Brookline Ave, Boston, MA, 02115, Boston, MA, USA
| | - Amrik Eadara
- Beth Israel Deaconess Medical Center, Harvard Medical School, 330 Brookline Ave, Boston, MA, 02115, Boston, MA, USA
| | - Shiwei Wang
- Beth Israel Deaconess Medical Center, Harvard Medical School, 330 Brookline Ave, Boston, MA, 02115, Boston, MA, USA
| | - Matthew Flathers
- Beth Israel Deaconess Medical Center, Harvard Medical School, 330 Brookline Ave, Boston, MA, 02115, Boston, MA, USA
| | - James Burns
- Beth Israel Deaconess Medical Center, Harvard Medical School, 330 Brookline Ave, Boston, MA, 02115, Boston, MA, USA
| | - John Torous
- Beth Israel Deaconess Medical Center, Harvard Medical School, 330 Brookline Ave, Boston, MA, 02115, Boston, MA, USA.
| |
Collapse
|
2
|
Raje A, Rozatkar AR, Mehta UM, Shrivastava R, Bondre A, Ahmad MA, Malviya A, Sen Y, Tugnawat D, Bhan A, Modak T, Das N, Nagendra S, Lane E, Castillo J, Naslund JA, Torous J, Choudhary S. Designing smartphone-based cognitive assessments for schizophrenia: Perspectives from a multisite study. Schizophr Res Cogn 2025; 40:100347. [PMID: 39995813 PMCID: PMC11848491 DOI: 10.1016/j.scog.2025.100347] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2024] [Revised: 02/03/2025] [Accepted: 02/03/2025] [Indexed: 02/26/2025]
Abstract
Introduction Cognitive deficits represent a core symptom of schizophrenia and a principal contributor to illness disability, yet evaluating cognition in routine clinical settings is often not feasible as cognitive assessments take longer than a standard doctor's visit. Using smartphones to assess cognition in schizophrenia offers the advantages of convenience in that patients can complete assessments outside of the clinic, temporality in that longitudinal trends can be identified, and contextuality in that cognitive scores can be interpreted with other measures captured by the phone (e.g. sleep). The current study aims to design a battery of cognitive assessments corresponding to the MATRICs Consensus Battery of Cognition (MCCB), in partnership with people living with schizophrenia. Methodology Focus group discussions (FGDs) and interviews were conducted with people diagnosed with schizophrenia across three sites (Boston, Bhopal, and Bangalore) to help design, refine, and assess the proposed smartphone battery of cognitive tests on the mindLAMP app. Interviews were conducted between December 2023 and March 2024. Inductive thematic analysis was used to analyze data. Results Participants found the app and its proposed cognitive assessments to be acceptable, helpful, and easy to use. They particularly found the gamified nature of the cognitive tests to be appealing and engaging. However, they also proposed ways to further increase engagement by including more information about each cognitive test, more visual instructions, and more information about scoring. Across all sites, there were many similarities in themes. Discussion & conclusion People living with schizophrenia, from different sites in the US and India, appear interested in using smartphone apps to track their cognition. Thematic analysis reinforces the importance of feedback and data sharing, although this presents a challenge, given the novel nature of smartphone-based cognitive measures that have not yet been standardized or validated.
Collapse
Affiliation(s)
| | | | | | | | | | | | | | | | | | | | - Tamonud Modak
- All India Institute of Medical Sciences, Bhopal, India
| | - Nabagata Das
- National Institute of Mental Health and Neurosciences, Bengaluru, India
| | | | - Erlend Lane
- Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, USA
| | - Juan Castillo
- Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, USA
| | - John A. Naslund
- Department of Global Health and Social Medicine, Harvard Medical School, Boston, USA
| | - John Torous
- Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, USA
| | - Soumya Choudhary
- National Institute of Mental Health and Neurosciences, Bengaluru, India
| |
Collapse
|
3
|
Torous J, Linardon J, Goldberg SB, Sun S, Bell I, Nicholas J, Hassan L, Hua Y, Milton A, Firth J. The evolving field of digital mental health: current evidence and implementation issues for smartphone apps, generative artificial intelligence, and virtual reality. World Psychiatry 2025; 24:156-174. [PMID: 40371757 PMCID: PMC12079407 DOI: 10.1002/wps.21299] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 05/16/2025] Open
Abstract
The expanding domain of digital mental health is transitioning beyond traditional telehealth to incorporate smartphone apps, virtual reality, and generative artificial intelligence, including large language models. While industry setbacks and methodological critiques have highlighted gaps in evidence and challenges in scaling these technologies, emerging solutions rooted in co-design, rigorous evaluation, and implementation science offer promising pathways forward. This paper underscores the dual necessity of advancing the scientific foundations of digital mental health and increasing its real-world applicability through five themes. First, we discuss recent technological advances in digital phenotyping, virtual reality, and generative artificial intelligence. Progress in this latter area, specifically designed to create new outputs such as conversations and images, holds unique potential for the mental health field. Given the spread of smartphone apps, we then evaluate the evidence supporting their utility across various mental health contexts, including well-being, depression, anxiety, schizophrenia, eating disorders, and substance use disorders. This broad view of the field highlights the need for a new generation of more rigorous, placebo-controlled, and real-world studies. We subsequently explore engagement challenges that hamper all digital mental health tools, and propose solutions, including human support, digital navigators, just-in-time adaptive interventions, and personalized approaches. We then analyze implementation issues, emphasizing clinician engagement, service integration, and scalable delivery models. We finally consider the need to ensure that innovations work for all people and thus can bridge digital health disparities, reviewing the evidence on tailoring digital tools for historically marginalized populations and low- and middle-income countries. Regarding digital mental health innovations as tools to augment and extend care, we conclude that smartphone apps, virtual reality, and large language models can positively impact mental health care if deployed correctly.
Collapse
Affiliation(s)
- John Torous
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | - Jake Linardon
- SEED Lifespan Strategic Research Centre, School of Psychology, Faculty of Health, Deakin University, Geelong, VIC, Australia
| | - Simon B Goldberg
- Department of Counseling Psychology and Center for Healthy Minds, University of Wisconsin, Madison, WI, USA
| | - Shufang Sun
- Department of Behavioral and Social Sciences, Brown University School of Public Health, Providence, RI, USA
- Mindfulness Center, Brown University, Providence, RI, USA
- Center for Global Public Health, Brown University, Providence, RI, USA
| | - Imogen Bell
- Orygen, Parkville, VIC, Australia
- Centre for Youth Mental Health, University of Melbourne, Melbourne, VIC, Australia
| | - Jennifer Nicholas
- Mindfulness Center, Brown University, Providence, RI, USA
- Centre for Youth Mental Health, University of Melbourne, Melbourne, VIC, Australia
| | - Lamiece Hassan
- School for Health Sciences, University of Manchester, Manchester, UK
| | - Yining Hua
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
- Department of Epidemiology, Harvard T.H. Chan School of Public Health, Boston, MA, USA
| | - Alyssa Milton
- Central Clinical School, Faculty of Medicine and Health, University of Sydney, Sydney, NSW, Australia
- Australian Research Council (ARC) Centre of Excellence for Children and Families Over the Life, Sydney, NSW, Australia
| | - Joseph Firth
- Division of Psychology and Mental Health, University of Manchester, and Greater Manchester Mental Health NHS Foundation Trust, Manchester Academic Health Science Centre, Manchester, UK
| |
Collapse
|
4
|
Zhang Y, Stewart C, Ranjan Y, Conde P, Sankesara H, Rashid Z, Sun S, Dobson RJB, Folarin AA. Large-scale digital phenotyping: Identifying depression and anxiety indicators in a general UK population with over 10,000 participants. J Affect Disord 2025; 375:412-422. [PMID: 39892753 DOI: 10.1016/j.jad.2025.01.124] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/24/2024] [Revised: 01/24/2025] [Accepted: 01/26/2025] [Indexed: 02/04/2025]
Abstract
BACKGROUND Digital phenotyping offers a novel and cost-efficient approach for managing depression and anxiety. Previous studies, often limited to small-to-medium or specific populations, may lack generalizability. METHODS We conducted a cross-sectional analysis of data from 10,129 participants recruited from a UK-based general population between June 2020 and August 2022. Participants shared wearable (Fitbit) data and self-reported questionnaires on depression, anxiety, and mood via a study app. We examined correlations between mental health scores and wearable-derived features, demographics, health variables, and mood assessments. Unsupervised clustering was used to identify behavioural patterns associated with depression and anxiety. Furthermore, we employed XGBoost machine learning models to predict depression and anxiety severity and compared the performance using different subsets of features. RESULTS We observed significant associations between the severity of depression and anxiety with several factors, including mood, age, gender, BMI, sleep patterns, physical activity, and heart rate. Clustering analysis revealed that participants simultaneously exhibiting lower physical activity levels and higher heart rates reported more severe symptoms. Prediction models incorporating all types of variables achieved the best performance (R2 = 0.41, MAE = 3.42 for depression; R2 = 0.31, MAE = 3.50 for anxiety) compared to those using subsets of variables. Several wearable-derived features were observed to have non-linear relationships with depression and anxiety in the prediction models. LIMITATIONS Data collection during the COVID-19 pandemic may introduce biases. CONCLUSION This study identified several indicators for depression and anxiety and highlighted the potential of digital phenotyping and machine learning technologies for rapid screening of mental disorders in general populations.
Collapse
Affiliation(s)
- Yuezhou Zhang
- Department of Biostatistics & Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom.
| | - Callum Stewart
- Department of Biostatistics & Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
| | - Yatharth Ranjan
- Department of Biostatistics & Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
| | - Pauline Conde
- Department of Biostatistics & Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
| | - Heet Sankesara
- Department of Biostatistics & Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
| | - Zulqarnain Rashid
- Department of Biostatistics & Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom
| | - Shaoxiong Sun
- Department of Biostatistics & Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom; Department of Computer Science, University of Sheffield, Sheffield, United Kingdom
| | - Richard J B Dobson
- Department of Biostatistics & Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom; Institute of Health Informatics, University College London, London, United Kingdom; NIHR Maudsley Biomedical Research Centre at South London and Maudsley NHS Foundation Trust, London, United Kingdom; NIHR Biomedical Research Centre at University College London Hospitals, NHS Foundation Trust, London, United Kingdom; Health Data Research UK London, University College London, London, United Kingdom
| | - Amos A Folarin
- Department of Biostatistics & Health Informatics, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, United Kingdom; Institute of Health Informatics, University College London, London, United Kingdom; NIHR Maudsley Biomedical Research Centre at South London and Maudsley NHS Foundation Trust, London, United Kingdom; NIHR Biomedical Research Centre at University College London Hospitals, NHS Foundation Trust, London, United Kingdom; Health Data Research UK London, University College London, London, United Kingdom.
| |
Collapse
|
5
|
Tartaglia J, Jaghab B, Ismail M, Hänsel K, Meter AV, Kirschenbaum M, Sobolev M, Kane JM, Tang SX. Assessing Health Technology Literacy and Attitudes of Patients in an Urban Outpatient Psychiatry Clinic: Cross-Sectional Survey Study. JMIR Ment Health 2024; 11:e63034. [PMID: 39753220 PMCID: PMC11729776 DOI: 10.2196/63034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/07/2024] [Revised: 10/18/2024] [Accepted: 10/19/2024] [Indexed: 01/18/2025] Open
Abstract
BACKGROUND Digital health technologies are increasingly being integrated into mental health care. However, the adoption of these technologies can be influenced by patients' digital literacy and attitudes, which may vary based on sociodemographic factors. This variability necessitates a better understanding of patient digital literacy and attitudes to prevent a digital divide, which can worsen existing health care disparities. OBJECTIVE This study aimed to assess digital literacy and attitudes toward digital health technologies among a diverse psychiatric outpatient population. In addition, the study sought to identify clusters of patients based on their digital literacy and attitudes, and to compare sociodemographic characteristics among these clusters. METHODS A survey was distributed to adult psychiatric patients with various diagnoses in an urban outpatient psychiatry program. The survey included a demographic questionnaire, a digital literacy questionnaire, and a digital health attitudes questionnaire. Multiple linear regression analyses were used to identify predictors of digital literacy and attitudes. Cluster analysis was performed to categorize patients based on their responses. Pairwise comparisons and one-way ANOVA were conducted to analyze differences between clusters. RESULTS A total of 256 patients were included in the analysis. The mean age of participants was 32 (SD 12.6, range 16-70) years. The sample was racially and ethnically diverse: White (100/256, 38.9%), Black (39/256, 15.2%), Latinx (44/256, 17.2%), Asian (59/256, 23%), and other races and ethnicities (15/256, 5.7%). Digital literacy was high for technologies such as smartphones, videoconferencing, and social media (items with >75%, 193/256 of participants reporting at least some use) but lower for health apps, mental health apps, wearables, and virtual reality (items with <42%, 108/256 reporting at least some use). Attitudes toward using technology in clinical care were generally positive (9 out of 10 items received >75% positive score), particularly for communication with providers and health data sharing. Older age (P<.001) and lower educational attainment (P<.001) negatively predicted digital literacy scores, but no demographic variables predicted attitude scores. Cluster analysis identified 3 patient groups. Relative to the other clusters, cluster 1 (n=30) had lower digital literacy and intermediate acceptance of digital technology. Cluster 2 (n=50) had higher literacy and lower acceptance. Cluster 3 (n=176) displayed both higher literacy and acceptance. Significant between-cluster differences were observed in mean age and education level between clusters (P<.001), with cluster 1 participants being older and having lower levels of formal education. CONCLUSIONS High digital literacy and acceptance of digital technologies were observed among our patients, indicating a generally positive outlook for digital health clinics. Our results also found that patients of older age and lower formal levels of educational attainment had lower digital literacy, highlighting the need for targeted interventions to support those who may struggle with adopting digital health tools.
Collapse
Affiliation(s)
- Julia Tartaglia
- Department of Psychiatry, Northwell Health, Zucker Hillside Hospital, Glen Oaks, NY, United States
- Department of Psychiatry, Weill Cornell Medical College, New York, NY, United States
| | - Brendan Jaghab
- Department of Psychiatry, Northwell Health, Zucker Hillside Hospital, Glen Oaks, NY, United States
| | - Mohamed Ismail
- Department of Psychiatry, Northwell Health, Zucker Hillside Hospital, Glen Oaks, NY, United States
| | - Katrin Hänsel
- Department of Psychiatry, Northwell Health, Zucker Hillside Hospital, Glen Oaks, NY, United States
| | - Anna Van Meter
- Department of Psychiatry, Northwell Health, Zucker Hillside Hospital, Glen Oaks, NY, United States
- Department of Child and Adolescent Psychiatry, School of Medicine, NYU Grossman, New York, NY, United States
| | - Michael Kirschenbaum
- Department of Psychiatry, Northwell Health, Zucker Hillside Hospital, Glen Oaks, NY, United States
| | - Michael Sobolev
- Department of Psychiatry, Northwell Health, Zucker Hillside Hospital, Glen Oaks, NY, United States
- Cornell Tech, Cornell University, New York, NY, United States
| | - John M Kane
- Department of Psychiatry, Northwell Health, Zucker Hillside Hospital, Glen Oaks, NY, United States
| | - Sunny X Tang
- Department of Psychiatry, Northwell Health, Zucker Hillside Hospital, Glen Oaks, NY, United States
| |
Collapse
|
6
|
Terhorst Y, Knauer J, Philippi P, Baumeister H. The Relation Between Passively Collected GPS Mobility Metrics and Depressive Symptoms: Systematic Review and Meta-Analysis. J Med Internet Res 2024; 26:e51875. [PMID: 39486026 PMCID: PMC11568401 DOI: 10.2196/51875] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/11/2023] [Revised: 07/02/2024] [Accepted: 07/26/2024] [Indexed: 11/03/2024] Open
Abstract
BACKGROUND The objective, unobtrusively collected GPS features (eg, homestay and distance) from everyday devices like smartphones may offer a promising augmentation to current assessment tools for depression. However, to date, there is no systematic and meta-analytical evidence on the associations between GPS features and depression. OBJECTIVE This study aimed to investigate the between-person and within-person correlations between GPS mobility and activity features and depressive symptoms, and to critically review the quality and potential publication bias in the field. METHODS We searched MEDLINE, PsycINFO, Embase, CENTRAL, ACM, IEEE Xplore, PubMed, and Web of Science to identify eligible articles focusing on the correlations between GPS features and depression from December 6, 2022, to March 24, 2023. Inclusion and exclusion criteria were applied in a 2-stage inclusion process conducted by 2 independent reviewers (YT and JK). To be eligible, studies needed to report correlations between wearable-based GPS variables (eg, total distance) and depression symptoms measured with a validated questionnaire. Studies with underage persons and other mental health disorders were excluded. Between- and within-person correlations were analyzed using random effects models. Study quality was determined by comparing studies against the STROBE (Strengthening the Reporting of Observational studies in Epidemiology) guidelines. Publication bias was investigated using Egger test and funnel plots. RESULTS A total of k=19 studies involving N=2930 participants were included in the analysis. The mean age was 38.42 (SD 18.96) years with 59.64% (SD 22.99%) of participants being female. Significant between-person correlations between GPS features and depression were identified: distance (r=-0.25, 95% CI -0.29 to -0.21), normalized entropy (r-0.17, 95% CI -0.29 to -0.04), location variance (r-0.17, 95% CI -0.26 to -0.04), entropy (r=-0.13, 95% CI -0.23 to -0.04), number of clusters (r=-0.11, 95% CI -0.18 to -0.03), and homestay (r=0.10, 95% CI 0.00 to 0.19). Studies reporting within-correlations (k=3) were too heterogeneous to conduct meta-analysis. A deficiency in study quality and research standards was identified: all studies followed exploratory observational designs, but no study referenced or fully adhered to the international guidelines for reporting observational studies (STROBE). A total of 79% (k=15) of the studies were underpowered to detect a small correlation (r=.20). Results showed evidence for potential publication bias. CONCLUSIONS Our results provide meta-analytical evidence for between-person correlations of GPS mobility and activity features and depression. Hence, depression diagnostics may benefit from adding GPS mobility and activity features as an integral part of future assessment and expert tools. However, confirmatory studies for between-person correlations and further research on within-person correlations are needed. In addition, the methodological quality of the evidence needs to improve. TRIAL REGISTRATION OSF Registeries cwder; https://osf.io/cwder.
Collapse
Affiliation(s)
- Yannik Terhorst
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, University Ulm, Ulm, Germany
- Department of Psychology, Ludwig Maximilian University of Munich, Munich, Germany
- German Center for Mental Health (DZPG), Partner Site Munich-Augsburg, Munich, Germany
| | - Johannes Knauer
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, University Ulm, Ulm, Germany
| | - Paula Philippi
- Department of Clinical Child and Adolescent Psychology and Psychotherapy, Institute of Psychology, University of Wuppertal, Wuppertal, Germany
| | - Harald Baumeister
- Department of Clinical Psychology and Psychotherapy, Institute of Psychology and Education, University Ulm, Ulm, Germany
| |
Collapse
|
7
|
Shvetcov A, Funke Kupper J, Zheng WY, Slade A, Han J, Whitton A, Spoelma M, Hoon L, Mouzakis K, Vasa R, Gupta S, Venkatesh S, Newby J, Christensen H. Passive sensing data predicts stress in university students: a supervised machine learning method for digital phenotyping. Front Psychiatry 2024; 15:1422027. [PMID: 39252756 PMCID: PMC11381371 DOI: 10.3389/fpsyt.2024.1422027] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/23/2024] [Accepted: 07/31/2024] [Indexed: 09/11/2024] Open
Abstract
Introduction University students are particularly susceptible to developing high levels of stress, which occur when environmental demands outweigh an individual's ability to cope. The growing advent of mental health smartphone apps has led to a surge in use by university students seeking ways to help them cope with stress. Use of these apps has afforded researchers the unique ability to collect extensive amounts of passive sensing data including GPS and step detection. Despite this, little is known about the relationship between passive sensing data and stress. Further, there are no established methodologies or tools to predict stress from passive sensing data in this group. Methods In this study, we establish a clear machine learning-based methodological pipeline for processing passive sensing data and extracting features that may be relevant in the context of mental health. Results We then use this methodology to determine the relationship between passive sensing data and stress in university students. Discussion In doing so, we offer the first proof-of-principle data for the utility of our methodological pipeline and highlight that passive sensing data can indeed digitally phenotype stress in university students. Clinical trial registration Australia New Zealand Clinical Trials Registry (ANZCTR), identifier ACTRN12621001223820.
Collapse
Affiliation(s)
- Artur Shvetcov
- Black Dog Institute, University of New South Wales, Sydney, NSW, Australia
| | - Joost Funke Kupper
- Applied Artificial Intelligence Institute, Deakin University, Burwood, VIC, Australia
| | - Wu-Yi Zheng
- Black Dog Institute, University of New South Wales, Sydney, NSW, Australia
| | - Aimy Slade
- Black Dog Institute, University of New South Wales, Sydney, NSW, Australia
| | - Jin Han
- Black Dog Institute, University of New South Wales, Sydney, NSW, Australia
| | - Alexis Whitton
- Black Dog Institute, University of New South Wales, Sydney, NSW, Australia
| | - Michael Spoelma
- Black Dog Institute, University of New South Wales, Sydney, NSW, Australia
| | - Leonard Hoon
- Applied Artificial Intelligence Institute, Deakin University, Burwood, VIC, Australia
| | - Kon Mouzakis
- Applied Artificial Intelligence Institute, Deakin University, Burwood, VIC, Australia
| | - Rajesh Vasa
- Applied Artificial Intelligence Institute, Deakin University, Burwood, VIC, Australia
| | - Sunil Gupta
- Applied Artificial Intelligence Institute, Deakin University, Geelong, VIC, Australia
| | - Svetha Venkatesh
- Applied Artificial Intelligence Institute, Deakin University, Geelong, VIC, Australia
| | - Jill Newby
- Black Dog Institute, University of New South Wales, Sydney, NSW, Australia
| | - Helen Christensen
- Black Dog Institute, University of New South Wales, Sydney, NSW, Australia
| |
Collapse
|
8
|
Langener AM, Bringmann LF, Kas MJ, Stulp G. Predicting Mood Based on the Social Context Measured Through the Experience Sampling Method, Digital Phenotyping, and Social Networks. ADMINISTRATION AND POLICY IN MENTAL HEALTH AND MENTAL HEALTH SERVICES RESEARCH 2024; 51:455-475. [PMID: 38200262 PMCID: PMC11196304 DOI: 10.1007/s10488-023-01328-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 11/22/2023] [Indexed: 01/12/2024]
Abstract
Social interactions are essential for well-being. Therefore, researchers increasingly attempt to capture an individual's social context to predict well-being, including mood. Different tools are used to measure various aspects of the social context. Digital phenotyping is a commonly used technology to assess a person's social behavior objectively. The experience sampling method (ESM) can capture the subjective perception of specific interactions. Lastly, egocentric networks are often used to measure specific relationship characteristics. These different methods capture different aspects of the social context over different time scales that are related to well-being, and combining them may be necessary to improve the prediction of well-being. Yet, they have rarely been combined in previous research. To address this gap, our study investigates the predictive accuracy of mood based on the social context. We collected intensive within-person data from multiple passive and self-report sources over a 28-day period in a student sample (Participants: N = 11, ESM measures: N = 1313). We trained individualized random forest machine learning models, using different predictors included in each model summarized over different time scales. Our findings revealed that even when combining social interactions data using different methods, predictive accuracy of mood remained low. The average coefficient of determination over all participants was 0.06 for positive and negative affect and ranged from - 0.08 to 0.3, indicating a large amount of variance across people. Furthermore, the optimal set of predictors varied across participants; however, predicting mood using all predictors generally yielded the best predictions. While combining different predictors improved predictive accuracy of mood for most participants, our study highlights the need for further work using larger and more diverse samples to enhance the clinical utility of these predictive modeling approaches.
Collapse
Affiliation(s)
- Anna M Langener
- Groningen Institute for Evolutionary Life Sciences, University of Groningen, Groningen, The Netherlands.
- Department of Psychometrics and Statistics, Faculty of Behavioural and Social Sciences, University of Groningen, Groningen, The Netherlands.
- Faculty of Science and Engineering, Nijenborgh 7, 9747 AG, Groningen, The Netherlands.
| | - Laura F Bringmann
- Department of Psychometrics and Statistics, Faculty of Behavioural and Social Sciences, University of Groningen, Groningen, The Netherlands
- Interdisciplinary Center Psychopathology and Emotion Regulation, (ICPE), University Medical Center Groningen, University of Groningen, Groningen, The Netherlands
| | - Martien J Kas
- Groningen Institute for Evolutionary Life Sciences, University of Groningen, Groningen, The Netherlands
| | - Gert Stulp
- Department of Sociology & Inter-University Center for Social Science Theory and Methodology, Grote Rozenstraat 31, 9712 TS, Groningen, The Netherlands
| |
Collapse
|
9
|
Zierer C, Behrendt C, Lepach-Engelhardt AC. Digital biomarkers in depression: A systematic review and call for standardization and harmonization of feature engineering. J Affect Disord 2024; 356:438-449. [PMID: 38583596 DOI: 10.1016/j.jad.2024.03.163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Revised: 03/21/2024] [Accepted: 03/28/2024] [Indexed: 04/09/2024]
Abstract
BACKGROUND General physicians misclassify depression in more than half of the cases. Researchers have explored the feasibility of leveraging passively collected data points, also called digital biomarkers, to provide more granular understanding of depression phenotypes as well as a more objective assessment of disease. METHOD This paper provides a systematic review following the PRISMA guidelines (Page et al., 2021) to understand which digital biomarkers might be relevant for passive screening of depression. Pubmed and PsycInfo were systematically searched for studies published from 2019 to early 2024, resulting in 161 records assessed for eligibility. Excluded were intervention studies, studies focusing on a different disease or those with a lack of passive data collection. 74 studies remained for a quality assessment, after which 27 studies were included. RESULTS The review shows that depressed participants' real-life behavior such as reduced communication with others can be tracked by passive data. Machine learning models for the classification of depression have shown accuracies up to 0.98, surpassing the quality of many standardized assessment methods. LIMITATIONS Inconsistency of outcome reporting of current studies does not allow for drawing statistical conclusions regarding effectiveness of individual included features. The Covid-19 pandemic might have impacted the ongoing studies between 2020 and 2022. CONCLUSION While digital biomarkers allow real-life tracking of participant's behavior and symptoms, further work is required to align the feature engineering of digital biomarkers. With shown high accuracies of assessments, connecting digital biomarkers with clinical practice can be a promising method of detecting symptoms of depression automatically.
Collapse
Affiliation(s)
- Carolin Zierer
- Department of Psychology, PFH Private University of Applied Sciences, Göttingen, Lower Saxony, Germany
| | - Corinna Behrendt
- Department of Psychology, PFH Private University of Applied Sciences, Göttingen, Lower Saxony, Germany.
| | | |
Collapse
|
10
|
Choi A, Ooi A, Lottridge D. Digital Phenotyping for Stress, Anxiety, and Mild Depression: Systematic Literature Review. JMIR Mhealth Uhealth 2024; 12:e40689. [PMID: 38780995 PMCID: PMC11157179 DOI: 10.2196/40689] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2022] [Revised: 10/03/2022] [Accepted: 09/27/2023] [Indexed: 05/25/2024] Open
Abstract
BACKGROUND Unaddressed early-stage mental health issues, including stress, anxiety, and mild depression, can become a burden for individuals in the long term. Digital phenotyping involves capturing continuous behavioral data via digital smartphone devices to monitor human behavior and can potentially identify milder symptoms before they become serious. OBJECTIVE This systematic literature review aimed to answer the following questions: (1) what is the evidence of the effectiveness of digital phenotyping using smartphones in identifying behavioral patterns related to stress, anxiety, and mild depression? and (2) in particular, which smartphone sensors are found to be effective, and what are the associated challenges? METHODS We used the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) process to identify 36 papers (reporting on 40 studies) to assess the key smartphone sensors related to stress, anxiety, and mild depression. We excluded studies conducted with nonadult participants (eg, teenagers and children) and clinical populations, as well as personality measurement and phobia studies. As we focused on the effectiveness of digital phenotyping using smartphones, results related to wearable devices were excluded. RESULTS We categorized the studies into 3 major groups based on the recruited participants: studies with students enrolled in universities, studies with adults who were unaffiliated to any particular organization, and studies with employees employed in an organization. The study length varied from 10 days to 3 years. A range of passive sensors were used in the studies, including GPS, Bluetooth, accelerometer, microphone, illuminance, gyroscope, and Wi-Fi. These were used to assess locations visited; mobility; speech patterns; phone use, such as screen checking; time spent in bed; physical activity; sleep; and aspects of social interactions, such as the number of interactions and response time. Of the 40 included studies, 31 (78%) used machine learning models for prediction; most others (n=8, 20%) used descriptive statistics. Students and adults who experienced stress, anxiety, or depression visited fewer locations, were more sedentary, had irregular sleep, and accrued increased phone use. In contrast to students and adults, less mobility was seen as positive for employees because less mobility in workplaces was associated with higher performance. Overall, travel, physical activity, sleep, social interaction, and phone use were related to stress, anxiety, and mild depression. CONCLUSIONS This study focused on understanding whether smartphone sensors can be effectively used to detect behavioral patterns associated with stress, anxiety, and mild depression in nonclinical participants. The reviewed studies provided evidence that smartphone sensors are effective in identifying behavioral patterns associated with stress, anxiety, and mild depression.
Collapse
Affiliation(s)
- Adrien Choi
- School of Computer Science, Faculty of Science, University of Auckland, Auckland, New Zealand
| | - Aysel Ooi
- School of Computer Science, Faculty of Science, University of Auckland, Auckland, New Zealand
| | - Danielle Lottridge
- School of Computer Science, Faculty of Science, University of Auckland, Auckland, New Zealand
| |
Collapse
|
11
|
Lim CT, Fuchs C, Torous J. Integrated Digital Mental Health Care: A Vision for Addressing Population Mental Health Needs. Int J Gen Med 2024; 17:359-365. [PMID: 38318335 PMCID: PMC10840519 DOI: 10.2147/ijgm.s449474] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2023] [Accepted: 01/10/2024] [Indexed: 02/07/2024] Open
Abstract
The unmet need for mental health care continues to rise across the world. This article synthesizes the evidence supporting the components of a hypothetical model of integrated digital mental health care to meet population-wide mental health needs. This proposed model integrates two approaches to broadening timely access to effective care: integrated, primary care-based mental health services and digital mental health tools. The model solves for several of the key challenges historically faced by digital health, through promoting digital literacy and access, the curation of evidence-based digital tools, integration into clinical practice, and electronic medical record integration. This model builds upon momentum toward the integration of mental health services within primary care and aligns with the principles of the Collaborative Care Model. Finally, the authors present the major next steps toward implementation of integrated digital mental health care at scale.
Collapse
Affiliation(s)
- Christopher T Lim
- Department of Psychiatry, Boston Medical Center, Boston University Chobanian & Avedisian School of Medicine, Boston, MA, USA
- Population Health Services, Boston Medical Center Health System, Boston, MA, USA
| | - Cara Fuchs
- Department of Psychiatry, Boston Medical Center, Boston University Chobanian & Avedisian School of Medicine, Boston, MA, USA
| | - John Torous
- Department of Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
12
|
Khoo LS, Lim MK, Chong CY, McNaney R. Machine Learning for Multimodal Mental Health Detection: A Systematic Review of Passive Sensing Approaches. SENSORS (BASEL, SWITZERLAND) 2024; 24:348. [PMID: 38257440 PMCID: PMC10820860 DOI: 10.3390/s24020348] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/25/2023] [Revised: 12/14/2023] [Accepted: 12/18/2023] [Indexed: 01/24/2024]
Abstract
As mental health (MH) disorders become increasingly prevalent, their multifaceted symptoms and comorbidities with other conditions introduce complexity to diagnosis, posing a risk of underdiagnosis. While machine learning (ML) has been explored to mitigate these challenges, we hypothesized that multiple data modalities support more comprehensive detection and that non-intrusive collection approaches better capture natural behaviors. To understand the current trends, we systematically reviewed 184 studies to assess feature extraction, feature fusion, and ML methodologies applied to detect MH disorders from passively sensed multimodal data, including audio and video recordings, social media, smartphones, and wearable devices. Our findings revealed varying correlations of modality-specific features in individualized contexts, potentially influenced by demographics and personalities. We also observed the growing adoption of neural network architectures for model-level fusion and as ML algorithms, which have demonstrated promising efficacy in handling high-dimensional features while modeling within and cross-modality relationships. This work provides future researchers with a clear taxonomy of methodological approaches to multimodal detection of MH disorders to inspire future methodological advancements. The comprehensive analysis also guides and supports future researchers in making informed decisions to select an optimal data source that aligns with specific use cases based on the MH disorder of interest.
Collapse
Affiliation(s)
- Lin Sze Khoo
- Department of Human-Centered Computing, Faculty of Information Technology, Monash University, Clayton, VIC 3800, Australia;
| | - Mei Kuan Lim
- School of Information Technology, Monash University Malaysia, Subang Jaya 46150, Malaysia; (M.K.L.); (C.Y.C.)
| | - Chun Yong Chong
- School of Information Technology, Monash University Malaysia, Subang Jaya 46150, Malaysia; (M.K.L.); (C.Y.C.)
| | - Roisin McNaney
- Department of Human-Centered Computing, Faculty of Information Technology, Monash University, Clayton, VIC 3800, Australia;
| |
Collapse
|
13
|
Stamatis CA, Meyerhoff J, Meng Y, Lin ZCC, Cho YM, Liu T, Karr CJ, Liu T, Curtis BL, Ungar LH, Mohr DC. Differential temporal utility of passively sensed smartphone features for depression and anxiety symptom prediction: a longitudinal cohort study. NPJ MENTAL HEALTH RESEARCH 2024; 3:1. [PMID: 38609548 PMCID: PMC10955925 DOI: 10.1038/s44184-023-00041-y] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/27/2023] [Accepted: 10/19/2023] [Indexed: 04/14/2024]
Abstract
While studies show links between smartphone data and affective symptoms, we lack clarity on the temporal scale, specificity (e.g., to depression vs. anxiety), and person-specific (vs. group-level) nature of these associations. We conducted a large-scale (n = 1013) smartphone-based passive sensing study to identify within- and between-person digital markers of depression and anxiety symptoms over time. Participants (74.6% female; M age = 40.9) downloaded the LifeSense app, which facilitated continuous passive data collection (e.g., GPS, app and device use, communication) across 16 weeks. Hierarchical linear regression models tested the within- and between-person associations of 2-week windows of passively sensed data with depression (PHQ-8) or generalized anxiety (GAD-7). We used a shifting window to understand the time scale at which sensed features relate to mental health symptoms, predicting symptoms 2 weeks in the future (distal prediction), 1 week in the future (medial prediction), and 0 weeks in the future (proximal prediction). Spending more time at home relative to one's average was an early signal of PHQ-8 severity (distal β = 0.219, p = 0.012) and continued to relate to PHQ-8 at medial (β = 0.198, p = 0.022) and proximal (β = 0.183, p = 0.045) windows. In contrast, circadian movement was proximally related to (β = -0.131, p = 0.035) but did not predict (distal β = 0.034, p = 0.577; medial β = -0.089, p = 0.138) PHQ-8. Distinct communication features (i.e., call/text or app-based messaging) related to PHQ-8 and GAD-7. Findings have implications for identifying novel treatment targets, personalizing digital mental health interventions, and enhancing traditional patient-provider interactions. Certain features (e.g., circadian movement) may represent correlates but not true prospective indicators of affective symptoms. Conversely, other features like home duration may be such early signals of intra-individual symptom change, indicating the potential utility of prophylactic intervention (e.g., behavioral activation) in response to person-specific increases in these signals.
Collapse
Affiliation(s)
- Caitlin A Stamatis
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies (CBITs), Feinberg School of Medicine, Northwestern University, Chicago, IL, USA.
| | - Jonah Meyerhoff
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies (CBITs), Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| | - Yixuan Meng
- Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA, USA
| | - Zhi Chong Chris Lin
- Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA, USA
| | - Young Min Cho
- Positive Psychology Center, University of Pennsylvania, Philadelphia, PA, USA
| | - Tony Liu
- Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA, USA
- Roblox Corporation, San Mateo, CA, USA
| | | | - Tingting Liu
- Positive Psychology Center, University of Pennsylvania, Philadelphia, PA, USA
- Technology & Translational Research Unit, National Institute on Drug Abuse (NIDA IRP), National Institutes of Health (NIH), Bethesda, MD, USA
| | - Brenda L Curtis
- Technology & Translational Research Unit, National Institute on Drug Abuse (NIDA IRP), National Institutes of Health (NIH), Bethesda, MD, USA
| | - Lyle H Ungar
- Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA, USA
- Positive Psychology Center, University of Pennsylvania, Philadelphia, PA, USA
| | - David C Mohr
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies (CBITs), Feinberg School of Medicine, Northwestern University, Chicago, IL, USA
| |
Collapse
|
14
|
Breitinger S, Gardea-Resendez M, Langholm C, Xiong A, Laivell J, Stoppel C, Harper L, Volety R, Walker A, D'Mello R, Byun AJS, Zandi P, Goes FS, Frye M, Torous J. Digital Phenotyping for Mood Disorders: Methodology-Oriented Pilot Feasibility Study. J Med Internet Res 2023; 25:e47006. [PMID: 38157233 PMCID: PMC10787337 DOI: 10.2196/47006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2023] [Revised: 09/04/2023] [Accepted: 11/20/2023] [Indexed: 01/03/2024] Open
Abstract
BACKGROUND In the burgeoning area of clinical digital phenotyping research, there is a dearth of literature that details methodology, including the key challenges and dilemmas in developing and implementing a successful architecture for technological infrastructure, patient engagement, longitudinal study participation, and successful reporting and analysis of diverse passive and active digital data streams. OBJECTIVE This article provides a narrative rationale for our study design in the context of the current evidence base and best practices, with an emphasis on our initial lessons learned from the implementation challenges and successes of this digital phenotyping study. METHODS We describe the design and implementation approach for a digital phenotyping pilot feasibility study with attention to synthesizing key literature and the reasoning for pragmatic adaptations in implementing a multisite study encompassing distinct geographic and population settings. This methodology was used to recruit patients as study participants with a clinician-validated diagnostic history of unipolar depression, bipolar I disorder, or bipolar II disorder, or healthy controls in 2 geographically distinct health care systems for a longitudinal digital phenotyping study of mood disorders. RESULTS We describe the feasibility of a multisite digital phenotyping pilot study for patients with mood disorders in terms of passively and actively collected phenotyping data quality and enrollment of patients. Overall data quality (assessed as the amount of sensor data obtained vs expected) was high compared to that in related studies. Results were reported on the relevant demographic features of study participants, revealing recruitment properties of age (mean subgroup age ranged from 31 years in the healthy control subgroup to 38 years in the bipolar I disorder subgroup), sex (predominance of female participants, with 7/11, 64% females in the bipolar II disorder subgroup), and smartphone operating system (iOS vs Android; iOS ranged from 7/11, 64% in the bipolar II disorder subgroup to 29/32, 91% in the healthy control subgroup). We also described implementation considerations around digital phenotyping research for mood disorders and other psychiatric conditions. CONCLUSIONS Digital phenotyping in affective disorders is feasible on both Android and iOS smartphones, and the resulting data quality using an open-source platform is higher than that in comparable studies. While the digital phenotyping data quality was independent of gender and race, the reported demographic features of study participants revealed important information on possible selection biases that may result from naturalistic research in this domain. We believe that the methodology described will be readily reproducible and generalizable to other study settings and patient populations given our data on deployment at 2 unique sites.
Collapse
Affiliation(s)
- Scott Breitinger
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, MN, United States
| | | | | | - Ashley Xiong
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, MN, United States
| | - Joseph Laivell
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, MN, United States
| | - Cynthia Stoppel
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, MN, United States
| | - Laura Harper
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, MN, United States
| | - Rama Volety
- Research Application Solutions Unit, Mayo Clinic, Rochester, MN, United States
| | - Alex Walker
- Johns Hopkins University, Baltimore, MD, United States
| | - Ryan D'Mello
- Beth Israel Deaconess Medical Center, Boston, MA, United States
| | | | - Peter Zandi
- Johns Hopkins University, Baltimore, MD, United States
| | | | - Mark Frye
- Department of Psychiatry and Psychology, Mayo Clinic, Rochester, MN, United States
| | - John Torous
- Beth Israel Deaconess Medical Center, Boston, MA, United States
| |
Collapse
|
15
|
Stamatis CA, Liu T, Meyerhoff J, Meng Y, Cho YM, Karr CJ, Curtis BL, Ungar LH, Mohr DC. Specific associations of passively sensed smartphone data with future symptoms of avoidance, fear, and physiological distress in social anxiety. Internet Interv 2023; 34:100683. [PMID: 37867614 PMCID: PMC10589746 DOI: 10.1016/j.invent.2023.100683] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/08/2023] [Revised: 09/21/2023] [Accepted: 10/11/2023] [Indexed: 10/24/2023] Open
Abstract
Background Prior literature links passively sensed information about a person's location, movement, and communication with social anxiety. These findings hold promise for identifying novel treatment targets, informing clinical care, and personalizing digital mental health interventions. However, social anxiety symptoms are heterogeneous; to identify more precise targets and tailor treatments, there is a need for personal sensing studies aimed at understanding differential predictors of the distinct subdomains of social anxiety. Our objective was to conduct a large-scale smartphone-based sensing study of fear, avoidance, and physiological symptoms in the context of trait social anxiety over time. Methods Participants (n = 1013; 74.6 % female; M age = 40.9) downloaded the LifeSense app, which collected continuous passive data (e.g., GPS, communication, app and device use) over 16 weeks. We tested a series of multilevel linear regression models to understand within- and between-person associations of 2-week windows of passively sensed smartphone data with fear, avoidance, and physiological distress on the self-reported Social Phobia Inventory (SPIN). A shifting sensor lag was applied to examine how smartphone features related to SPIN subdomains 2 weeks in the future (distal prediction), 1 week in the future (medial prediction), and 0 weeks in the future (proximal prediction). Results A decrease in time visiting novel places was a strong between-person predictor of social avoidance over time (distal β = -0.886, p = .002; medial β = -0.647, p = .029; proximal β = -0.818, p = .007). Reductions in call- and text-based communications were associated with social avoidance at both the between- (distal β = -0.882, p = .002; medial β = -0.932, p = .001; proximal β = -0.918, p = .001) and within- (distal β = -0.191, p = .046; medial β = -0.213, p = .028) person levels, as well as between-person fear of social situations (distal β = -0.860, p < .001; medial β = -0.892, p < .001; proximal β = -0.886, p < .001) over time. There were fewer significant associations of sensed data with physiological distress. Across the three subscales, smartphone data explained 9-12 % of the variance in social anxiety. Conclusion Findings have implications for understanding how social anxiety manifests in daily life, and for personalizing treatments. For example, a signal that someone is likely to begin avoiding social situations may suggest a need for alternative types of exposure-based interventions compared to a signal that someone is likely to begin experiencing increased physiological distress. Our results suggest that as a prophylactic means of targeting social avoidance, it may be helpful to deploy interventions involving social exposures in response to decreases in time spent visiting novel places.
Collapse
Affiliation(s)
- Caitlin A. Stamatis
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies (CBITs), Feinberg School of Medicine, Northwestern University, Chicago, IL, United States of America
| | - Tingting Liu
- Positive Psychology Center, University of Pennsylvania, Philadelphia, PA, United States of America
- Technology & Translational Research Unit, National Institute on Drug Abuse (NIDA IRP), National Institutes of Health (NIH), Bethesda, MD, United States of America
| | - Jonah Meyerhoff
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies (CBITs), Feinberg School of Medicine, Northwestern University, Chicago, IL, United States of America
| | - Yixuan Meng
- Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA, United States of America
| | - Young Min Cho
- Positive Psychology Center, University of Pennsylvania, Philadelphia, PA, United States of America
| | - Chris J. Karr
- Audacious Software, Chicago, IL, United States of America
| | - Brenda L. Curtis
- Technology & Translational Research Unit, National Institute on Drug Abuse (NIDA IRP), National Institutes of Health (NIH), Bethesda, MD, United States of America
| | - Lyle H. Ungar
- Positive Psychology Center, University of Pennsylvania, Philadelphia, PA, United States of America
- Department of Computer and Information Science, University of Pennsylvania, Philadelphia, PA, United States of America
| | - David C. Mohr
- Department of Preventive Medicine, Center for Behavioral Intervention Technologies (CBITs), Feinberg School of Medicine, Northwestern University, Chicago, IL, United States of America
| |
Collapse
|
16
|
Tully LM, Nye KE, Ereshefsky S, Tryon VL, Hakusui CK, Savill M, Niendam TA. Incorporating Community Partner Perspectives on eHealth Technology Data Sharing Practices for the California Early Psychosis Intervention Network: Qualitative Focus Group Study With a User-Centered Design Approach. JMIR Hum Factors 2023; 10:e44194. [PMID: 37962921 PMCID: PMC10685281 DOI: 10.2196/44194] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/10/2022] [Revised: 07/26/2023] [Accepted: 09/23/2023] [Indexed: 11/15/2023] Open
Abstract
BACKGROUND Increased use of eHealth technology and user data to drive early identification and intervention algorithms in early psychosis (EP) necessitates the implementation of ethical data use practices to increase user acceptability and trust. OBJECTIVE First, the study explored EP community partner perspectives on data sharing best practices, including beliefs, attitudes, and preferences for ethical data sharing and how best to present end-user license agreements (EULAs). Second, we present a test case of adopting a user-centered design approach to develop a EULA protocol consistent with community partner perspectives and priorities. METHODS We conducted an exploratory, qualitative, and focus group-based study exploring mental health data sharing and privacy preferences among individuals involved in delivering or receiving EP care within the California Early Psychosis Intervention Network. Key themes were identified through a content analysis of focus group transcripts. Additionally, we conducted workshops using a user-centered design approach to develop a EULA that addresses participant priorities. RESULTS In total, 24 participants took part in the study (14 EP providers, 6 clients, and 4 family members). Participants reported being receptive to data sharing despite being acutely aware of widespread third-party sharing across digital domains, the risk of breaches, and motives hidden in the legal language of EULAs. Consequently, they reported feeling a loss of control and a lack of protection over their data. Participants indicated these concerns could be mitigated through user-level control for data sharing with third parties and an understandable, transparent EULA, including multiple presentation modalities, text at no more than an eighth-grade reading level, and a clear definition of key terms. These findings were successfully integrated into the development of a EULA and data opt-in process that resulted in 88.1% (421/478) of clients who reviewed the video agreeing to share data. CONCLUSIONS Many of the factors considered pertinent to informing data sharing practices in a mental health setting are consistent among clients, family members, and providers delivering or receiving EP care. These community partners' priorities can be successfully incorporated into developing EULA practices that can lead to high voluntary data sharing rates.
Collapse
Affiliation(s)
- Laura M Tully
- Department of Psychiatry and Behavioral Sciences, University of California, Davis, Sacramento, CA, United States
| | - Kathleen E Nye
- Department of Psychiatry and Behavioral Sciences, University of California, Davis, Sacramento, CA, United States
| | - Sabrina Ereshefsky
- Department of Psychiatry and Behavioral Sciences, University of California, Davis, Sacramento, CA, United States
| | - Valerie L Tryon
- Department of Psychiatry and Behavioral Sciences, University of California, Davis, Sacramento, CA, United States
| | - Christopher Komei Hakusui
- Department of Psychiatry and Behavioral Sciences, University of California, Davis, Sacramento, CA, United States
| | - Mark Savill
- Department of Psychiatry and Behavioral Sciences, University of California, Davis, Sacramento, CA, United States
- Department of Psychiatry, University of California, San Francisco, San Francisco, CA, United States
| | - Tara A Niendam
- Department of Psychiatry and Behavioral Sciences, University of California, Davis, Sacramento, CA, United States
| |
Collapse
|
17
|
Oudin A, Maatoug R, Bourla A, Ferreri F, Bonnot O, Millet B, Schoeller F, Mouchabac S, Adrien V. Digital Phenotyping: Data-Driven Psychiatry to Redefine Mental Health. J Med Internet Res 2023; 25:e44502. [PMID: 37792430 PMCID: PMC10585447 DOI: 10.2196/44502] [Citation(s) in RCA: 12] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Revised: 07/10/2023] [Accepted: 08/21/2023] [Indexed: 10/05/2023] Open
Abstract
The term "digital phenotype" refers to the digital footprint left by patient-environment interactions. It has potential for both research and clinical applications but challenges our conception of health care by opposing 2 distinct approaches to medicine: one centered on illness with the aim of classifying and curing disease, and the other centered on patients, their personal distress, and their lived experiences. In the context of mental health and psychiatry, the potential benefits of digital phenotyping include creating new avenues for treatment and enabling patients to take control of their own well-being. However, this comes at the cost of sacrificing the fundamental human element of psychotherapy, which is crucial to addressing patients' distress. In this viewpoint paper, we discuss the advances rendered possible by digital phenotyping and highlight the risk that this technology may pose by partially excluding health care professionals from the diagnosis and therapeutic process, thereby foregoing an essential dimension of care. We conclude by setting out concrete recommendations on how to improve current digital phenotyping technology so that it can be harnessed to redefine mental health by empowering patients without alienating them.
Collapse
Affiliation(s)
- Antoine Oudin
- Infrastructure for Clinical Research in Neurosciences, Paris Brain Institute, Sorbonne University- Institut national de la santé et de la recherche médicale - Centre national de la recherche scientifique, Paris, France
- Department of Psychiatry, Pitié-Salpêtrière Hospital, Public Hospitals of Sorbonne University, Paris, France
| | - Redwan Maatoug
- Infrastructure for Clinical Research in Neurosciences, Paris Brain Institute, Sorbonne University- Institut national de la santé et de la recherche médicale - Centre national de la recherche scientifique, Paris, France
- Department of Psychiatry, Pitié-Salpêtrière Hospital, Public Hospitals of Sorbonne University, Paris, France
| | - Alexis Bourla
- Infrastructure for Clinical Research in Neurosciences, Paris Brain Institute, Sorbonne University- Institut national de la santé et de la recherche médicale - Centre national de la recherche scientifique, Paris, France
- Department of Psychiatry, Saint-Antoine Hospital, Public Hospitals of Sorbonne University, Paris, France
- Medical Strategy and Innovation Department, Clariane, Paris, France
- NeuroStim Psychiatry Practice, Paris, France
| | - Florian Ferreri
- Infrastructure for Clinical Research in Neurosciences, Paris Brain Institute, Sorbonne University- Institut national de la santé et de la recherche médicale - Centre national de la recherche scientifique, Paris, France
- Department of Psychiatry, Saint-Antoine Hospital, Public Hospitals of Sorbonne University, Paris, France
| | - Olivier Bonnot
- Department of Child and Adolescent Psychiatry, Nantes University Hospital, Nantes, France
- Pays de la Loire Psychology Laboratory, Nantes University, Nantes, France
| | - Bruno Millet
- Infrastructure for Clinical Research in Neurosciences, Paris Brain Institute, Sorbonne University- Institut national de la santé et de la recherche médicale - Centre national de la recherche scientifique, Paris, France
- Department of Psychiatry, Pitié-Salpêtrière Hospital, Public Hospitals of Sorbonne University, Paris, France
| | - Félix Schoeller
- Institute for Advanced Consciousness Studies, Santa Monica, CA, United States
- Media Lab, Massachusetts Institute of Technology, Cambridge, MA, United States
| | - Stéphane Mouchabac
- Infrastructure for Clinical Research in Neurosciences, Paris Brain Institute, Sorbonne University- Institut national de la santé et de la recherche médicale - Centre national de la recherche scientifique, Paris, France
- Department of Psychiatry, Saint-Antoine Hospital, Public Hospitals of Sorbonne University, Paris, France
| | - Vladimir Adrien
- Infrastructure for Clinical Research in Neurosciences, Paris Brain Institute, Sorbonne University- Institut national de la santé et de la recherche médicale - Centre national de la recherche scientifique, Paris, France
- Department of Psychiatry, Saint-Antoine Hospital, Public Hospitals of Sorbonne University, Paris, France
| |
Collapse
|
18
|
Langholm C, Kowatsch T, Bucci S, Cipriani A, Torous J. Exploring the Potential of Apple SensorKit and Digital Phenotyping Data as New Digital Biomarkers for Mental Health Research. Digit Biomark 2023; 7:104-114. [PMID: 37901364 PMCID: PMC10601905 DOI: 10.1159/000530698] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2023] [Accepted: 03/27/2023] [Indexed: 10/31/2023] Open
Abstract
The use of digital phenotyping continues to expand across all fields of health. By collecting quantitative data in real-time using devices such as smartphones or smartwatches, researchers and clinicians can develop a profile of a wide range of conditions. Smartphones contain sensors that collect data, such as GPS or accelerometer data, which can inform secondary metrics such as time spent at home, location entropy, or even sleep duration. These metrics, when used as digital biomarkers, are not only used to investigate the relationship between behavior and health symptoms but can also be used to support personalized and preventative care. Successful phenotyping requires consistent long-term collection of relevant and high-quality data. In this paper, we present the potential of newly available, for approved research, opt-in SensorKit sensors on iOS devices in improving the accuracy of digital phenotyping. We collected opt-in sensor data over 1 week from a single person with depression using the open-source mindLAMP app developed by the Division of Digital Psychiatry at Beth Israel Deaconess Medical Center. Five sensors from SensorKit were included. The names of the sensors, as listed in official documentation, include the following: phone usage, messages usage, visits, device usage, and ambient light. We compared data from these five new sensors from SensorKit to our current digital phenotyping data collection sensors to assess similarity and differences in both raw and processed data. We present sample data from all five of these new sensors. We also present sample data from current digital phenotyping sources and compare these data to SensorKit sensors when applicable. SensorKit offers great potential for health research. Many SensorKit sensors improve upon previously accessible features and produce data that appears clinically relevant. SensorKit sensors will likely play a substantial role in digital phenotyping. However, using these data requires advanced health app infrastructure and the ability to securely store high-frequency data.
Collapse
Affiliation(s)
- Carsten Langholm
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| | - Tobias Kowatsch
- Institute for Implementation Science in Health Care, University of Zurich, Zurich, Switzerland
- School of Medicine, University of St. Gallen, St. Gallen, Switzerland
- Center for Digital Health Interventions, Department of Management, Technology, and Economics at ETH Zurich, Zurich, Switzerland
| | - Sandra Bucci
- Department of Psychiatry, University of Oxford, Oxford, UK
| | - Andrea Cipriani
- Department of Psychiatry, University of Manchester, Manchester, UK
- Oxford Precision Psychiatry Lab, NIHR Oxford Health Biomedical Research Centre, Oxford, UK
- Oxford Health NHS Foundation Trust, Warneford Hospital, Oxford, UK
| | - John Torous
- Division of Digital Psychiatry, Beth Israel Deaconess Medical Center, Harvard Medical School, Boston, MA, USA
| |
Collapse
|
19
|
Lauvsnes ADF, Hansen TI, Ankill SØ, Bae SW, Gråwe RW, Braund TA, Larsen M, Langaas M. Mobile assessments of mood, executive functioning, and sensor-based smartphone activity, explain variability in substance use craving and relapse in patients with clinical substance use disorders – a pilot study. (Preprint). JMIR Form Res 2022. [DOI: 10.2196/45254] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/01/2023] Open
|
20
|
Currey D, Torous J. Digital Phenotyping Data to Predict Symptom Improvement and App Personalization: Protocol for a Prospective Study. JMIR Res Protoc 2022; 11:e37954. [PMID: 36445745 PMCID: PMC9748794 DOI: 10.2196/37954] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2022] [Revised: 07/18/2022] [Accepted: 10/27/2022] [Indexed: 11/30/2022] Open
Abstract
BACKGROUND Smartphone apps that capture surveys and sensors are increasingly being leveraged to collect data on clinical conditions. In mental health, this data could be used to personalize psychiatric support offered by apps so that they are more effective and engaging. Yet today, few mental health apps offer this type of support, often because of challenges associated with accurately predicting users' actual future mental health. OBJECTIVE In this protocol, we present a study design to explore engagement with mental health apps in college students, using the Technology Acceptance Model as a theoretical framework, and assess the accuracy of predicting mental health changes using digital phenotyping data. METHODS There are two main goals of this study. First, we present a logistic regression model fit on data from a prior study on college students and prospectively test this model on a new student cohort to assess its accuracy. Second, we will provide users with data-driven activity suggestions every 4 days to determine whether this type of personalization will increase engagement or attitudes toward the app compared to those receiving no personalized recommendations. RESULTS The study was completed in the spring of 2022, and the manuscript is currently in review at JMIR Publications. CONCLUSIONS This is one of the first digital phenotyping algorithms to be prospectively validated. Overall, our results will inform the potential of digital phenotyping data to serve as tailoring data in adaptive interventions and to increase rates of engagement. INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID) PRR1-10.2196/37954.
Collapse
Affiliation(s)
- Danielle Currey
- School of Medicine, Case Western Reserve University, Cleveland, OH, United States
| | - John Torous
- School of Medicine, Case Western Reserve University, Cleveland, OH, United States
| |
Collapse
|