Wearable, Environmental, and Smartphone-Based Passive Sensing for Mental Health Monitoring

Closing the loop between environment, brain and mental health: how far we might go in real-life assessments?

PURPOSE OF REVIEW

Environmental factors such as climate, urbanicity, and exposure to nature are becoming increasingly important influencers of mental health. Incorporating data gathered from real-life contexts holds promise to substantially enhance laboratory experiments by providing a more comprehensive understanding of everyday behaviors in natural environments. We provide an up-to-date review of current technological and methodological developments in mental health assessments, neuroimaging and environmental sensing.

RECENT FINDINGS

Mental health research progressed in recent years towards integrating tools, such as smartphone based mental health assessments or mobile neuroimaging, allowing just-in-time daily assessments. Moreover, they are increasingly enriched by dynamic measurements of the environment, which are already being integrated with mental health assessments. To ensure ecological validity and accuracy it is crucial to capture environmental data with a high spatio-temporal granularity. Simultaneously, as a supplement to experimentally controlled conditions, there is a need for a better understanding of cognition in daily life, particularly regarding our brain's responses in natural settings.

SUMMARY

The presented overview on the developments and feasibility of "real-life" approaches for mental health and brain research and their potential to identify relationships along the mental health-environment-brain axis informs strategies for real-life individual and dynamic assessments.

Sensing behavior change in chronic pain: a scoping review of sensor technology for use in daily life

ABSTRACT

Technology offers possibilities for quantification of behaviors and physiological changes of relevance to chronic pain, using wearable sensors and devices suitable for data collection in daily life contexts. We conducted a scoping review of wearable and passive sensor technologies that sample data of psychological interest in chronic pain, including in social situations. Sixty articles met our criteria from the 2783 citations retrieved from searching. Three-quarters of recruited people were with chronic pain, mostly musculoskeletal, and the remainder with acute or episodic pain; those with chronic pain had a mean age of 43 (few studies sampled adolescents or children) and 60% were women. Thirty-seven studies were performed in laboratory or clinical settings and the remainder in daily life settings. Most used only 1 type of technology, with 76 sensor types overall. The commonest was accelerometry (mainly used in daily life contexts), followed by motion capture (mainly in laboratory settings), with a smaller number collecting autonomic activity, vocal signals, or brain activity. Subjective self-report provided "ground truth" for pain, mood, and other variables, but often at a different timescale from the automatically collected data, and many studies reported weak relationships between technological data and relevant psychological constructs, for instance, between fear of movement and muscle activity. There was relatively little discussion of practical issues: frequency of sampling, missing data for human or technological reasons, and the users' experience, particularly when users did not receive data in any form. We conclude the review with some suggestions for content and process of future studies in this field.

Optimizing Outcomes in Psychotherapy for Anxiety Disorders Using Smartphone-Based and Passive Sensing Features: Protocol for a Randomized Controlled Trial

BACKGROUND

Psychotherapies, such as cognitive behavioral therapy (CBT), currently have the strongest evidence of durable symptom changes for most psychological disorders, such as anxiety disorders. Nevertheless, only about half of individuals treated with CBT benefit from it. Predictive algorithms, including digital assessments and passive sensing features, could better identify patients who would benefit from CBT, and thus, improve treatment choices.

OBJECTIVE

This study aims to establish predictive features that forecast responses to transdiagnostic CBT in anxiety disorders and to investigate key mechanisms underlying treatment responses.

METHODS

This study is a 2-armed randomized controlled clinical trial. We include patients with anxiety disorders who are randomized to either a transdiagnostic CBT group or a waitlist (referred to as WAIT). We index key features to predict responses prior to starting treatment using subjective self-report questionnaires, experimental tasks, biological samples, ecological momentary assessments, activity tracking, and smartphone-based passive sensing to derive a multimodal feature set for predictive modeling. Additional assessments take place weekly at mid- and posttreatment and at 6- and 12-month follow-ups to index anxiety and depression symptom severity. We aim to include 150 patients, randomized to CBT versus WAIT at a 3:1 ratio. The data set will be subject to full feature and important features selected by minimal redundancy and maximal relevance feature selection and then fed into machine leaning models, including eXtreme gradient boosting, pattern recognition network, and k-nearest neighbors to forecast treatment response. The performance of the developed models will be evaluated. In addition to predictive modeling, we will test specific mechanistic hypotheses (eg, association between self-efficacy, daily symptoms obtained using ecological momentary assessments, and treatment response) to elucidate mechanisms underlying treatment response.

RESULTS

The trial is now completed. It was approved by the Cantonal Ethics Committee, Zurich. The results will be disseminated through publications in scientific peer-reviewed journals and conference presentations.

CONCLUSIONS

The aim of this trial is to improve current CBT treatment by precise forecasting of treatment response and by understanding and potentially augmenting underpinning mechanisms and personalizing treatment.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03945617; https://clinicaltrials.gov/ct2/show/results/NCT03945617.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/42547.

Ethological computational psychiatry: Challenges and opportunities

Studying the intricacies of individual subjects' moods and cognitive processing over extended periods of time presents a formidable challenge in medicine. While much of systems neuroscience appropriately focuses on the link between neural circuit functions and well-constrained behaviors over short timescales (e.g., trials, hours), many mental health conditions involve complex interactions of mood and cognition that are non-stationary across behavioral contexts and evolve over extended timescales. Here, we discuss opportunities, challenges, and possible future directions in computational psychiatry to quantify non-stationary continuously monitored behaviors. We suggest that this exploratory effort may contribute to a more precision-based approach to treating mental disorders and facilitate a more robust reverse translation across animal species. We conclude with ethical considerations for any field that aims to bridge artificial intelligence and patient monitoring.

Ethical considerations for integrating multimodal computer perception and neurotechnology

Background

Artificial intelligence (AI)-based computer perception technologies (e.g., digital phenotyping and affective computing) promise to transform clinical approaches to personalized care in psychiatry and beyond by offering more objective measures of emotional states and behavior, enabling precision treatment, diagnosis, and symptom monitoring. At the same time, passive and continuous nature by which they often collect data from patients in non-clinical settings raises ethical issues related to privacy and self-determination. Little is known about how such concerns may be exacerbated by the integration of neural data, as parallel advances in computer perception, AI, and neurotechnology enable new insights into subjective states. Here, we present findings from a multi-site NCATS-funded study of ethical considerations for translating computer perception into clinical care and contextualize them within the neuroethics and neurorights literatures.

Methods

We conducted qualitative interviews with patients (n = 20), caregivers (n = 20), clinicians (n = 12), developers (n = 12), and clinician developers (n = 2) regarding their perspective toward using PC in clinical care. Transcripts were analyzed in MAXQDA using Thematic Content Analysis.

Results

Stakeholder groups voiced concerns related to (1) perceived invasiveness of passive and continuous data collection in private settings; (2) data protection and security and the potential for negative downstream/future impacts on patients of unintended disclosure; and (3) ethical issues related to patients' limited versus hyper awareness of passive and continuous data collection and monitoring. Clinicians and developers highlighted that these concerns may be exacerbated by the integration of neural data with other computer perception data.

Discussion

Our findings suggest that the integration of neurotechnologies with existing computer perception technologies raises novel concerns around dignity-related and other harms (e.g., stigma, discrimination) that stem from data security threats and the growing potential for reidentification of sensitive data. Further, our findings suggest that patients' awareness and preoccupation with feeling monitored via computer sensors ranges from hypo- to hyper-awareness, with either extreme accompanied by ethical concerns (consent vs. anxiety and preoccupation). These results highlight the need for systematic research into how best to implement these technologies into clinical care in ways that reduce disruption, maximize patient benefits, and mitigate long-term risks associated with the passive collection of sensitive emotional, behavioral and neural data.

Deep learning in voice analysis for diagnosing vocal cord pathologies: a systematic review

OBJECTIVES

With smartphones and wearable devices becoming ubiquitous, they offer an opportunity for large-scale voice sampling. This systematic review explores the application of deep learning models for the automated analysis of voice samples to detect vocal cord pathologies.

METHODS

We conducted a systematic literature review following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) reporting guidelines. We searched MEDLINE and Embase databases for original publications on deep learning applications for diagnosing vocal cord pathologies between 2002 and 2022. Risk of bias was assessed using Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2).

RESULTS

Out of the 14 studies that met the inclusion criteria, data from a total of 3037 patients were analyzed. All studies were retrospective. Deep learning applications targeted Reinke's edema, nodules, polyps, cysts, unilateral cord paralysis, and vocal fold cancer detection. Most pathologies had detection accuracy above 90%. Thirteen studies (93%) exhibited a high risk of bias and concerns about applicability.

CONCLUSIONS

Technology holds promise for enhancing the screening and diagnosis of vocal cord pathologies. While current research is limited, the presented studies offer proof of concept for developing larger-scale solutions.

Residential mobility restrictions and adverse mental health outcomes during the COVID-19 pandemic in the UK

During the COVID-19 pandemic, several governments tried to contain the spread of SARS-CoV-2, the virus that causes COVID-19, with lockdowns that prohibited leaving one's residence unless carrying out a few essential services. We investigate the relationship between limitations to mobility and mental health in the UK during the first year and a half of the pandemic using a unique combination of high-frequency mobility data from Google and monthly longitudinal data collected through the Understanding Society survey. We find a strong and statistically robust correlation between mobility data and mental health survey data and show that increased residential stationarity is associated with the deterioration of mental wellbeing even when regional COVID-19 prevalence and lockdown stringency are controlled for. The relationship is heterogeneous, as higher levels of distress are seen in young, healthy people living alone; and in women, especially if they have young children.

Mobile sensing to advance tumor modeling in cancer patients: A conceptual framework

As mobile and wearable devices continue to grow in popularity, there is strong yet unrealized potential to harness people's mobile sensing data to improve our understanding of their cellular and biologically-based diseases. Breakthrough technical innovations in tumor modeling, such as the three dimensional tumor microenvironment system (TMES), allow researchers to study the behavior of tumor cells in a controlled environment that closely mimics the human body. Although patients' health behaviors are known to impact their tumor growth through circulating hormones (cortisol, melatonin), capturing this process is a challenge to rendering realistic tumor models in the TMES or similar tumor modeling systems. The goal of this paper is to propose a conceptual framework that unifies researchers from digital health, data science, oncology, and cellular signaling, in a common cause to improve cancer patients' treatment outcomes through mobile sensing. In support of our framework, existing studies indicate that it is feasible to use people's mobile sensing data to approximate their underlying hormone levels. Further, it was found that when cortisol is cycled through the TMES based on actual patients' cortisol levels, there is a significant increase in pancreatic tumor cell growth compared to when cortisol levels are at normal healthy levels. Taken together, findings from these studies indicate that continuous monitoring of people's hormone levels through mobile sensing may improve experimentation in the TMES, by informing how hormones should be introduced. We hope our framework inspires digital health researchers in the psychosocial sciences to consider how their expertise can be applied to advancing outcomes across levels of inquiry, from behavioral to cellular.

Digital measures of respiratory and upper limb function in spinal muscular atrophy: design, feasibility, reliability, and preliminary validity of a smartphone sensor-based assessment suite

Spinal muscular atrophy (SMA) is characterized by progressive muscle weakness and paralysis. Motor function is monitored in the clinical setting using assessments including the 32-item Motor Function Measure (MFM-32), but changes in disease severity between clinical visits may be missed. Digital health technologies may assist evaluation of disease severity by bridging gaps between clinical visits. We developed a smartphone sensor-based assessment suite, comprising nine tasks, to assess motor and muscle function in people with SMA. We used data from the risdiplam phase 2 JEWELFISH trial to assess the test-retest reliability and convergent validity of each task. In the first 6 weeks, 116 eligible participants completed assessments on a median of 6.3 days per week. Eight of the nine tasks demonstrated good or excellent test-retest reliability (intraclass correlation coefficients >0.75 and >0.9, respectively). Seven tasks showed a significant association (P < 0.05) with related clinical measures of motor function (individual items from the MFM-32 or Revised Upper Limb Module scales) and seven showed significant association (P < 0.05) with disease severity measured using the MFM-32 total score. This cross-sectional study supports the feasibility, reliability, and validity of using smartphone-based digital assessments to measure function in people living with SMA.

Digital tools to support mental health: a survey study in psychosis

BACKGROUND

There is a notable a gap between promising research findings and implementation of digital health tools. Understanding and addressing barriers to use is key to widespread implementation.

METHODS

A survey was administered to a self-selecting sample in-person (n = 157) or online (n = 58), with questions examining: i) ownership and usage rates of digital devices among people with psychosis; ii) interest in using technology to engage with mental health services; and iii) facilitators of and barriers to using digital tools in a mental healthcare context.

RESULTS

Device ownership: Virtually all participants owned a mobile phone (95%) or smartphone (90%), with Android phones slightly more prevalent than iPhones. Only a minority owned a fitness tracker (15%) or smartwatch (13%). Device ownership was significantly lower in unemployed people and those without secondary education. Device cost and paranoid ideation were barriers to ownership. Technology and mental health services: Most participants (88%) said they would willingly try a mental health app. Symptom monitoring apps were most popular, then appointment reminders and medication reminders. Half the sample would prefer an app alongside face-to-face support; the other half preferred remote support or no other mental health support. Facilitators: Participants thought using a mental health app could increase their understanding of psychosis generally, and of their own symptoms. They valued the flexibility of digital tools in enabling access to support anywhere, anytime. Barriers: Prominent barriers to using mental health apps were forgetting, lack of motivation, security concerns, and concerns it would replace face-to-face care. Overall participants reported no substantial effects of technology on their mental health, although a quarter said using a phone worsened paranoid ideation. A third used technology more when psychotic symptoms were higher, whereas a third used it less. Around half used technology more when experiencing low mood.

CONCLUSIONS

Our findings suggest rapidly increasing device ownership among people with psychosis, mirroring patterns in the general population. Smartphones appear appropriate for delivering internet-enabled support for psychosis. However, for a sub-group of people with psychosis, the sometimes complex interaction between technology and mental health may act as a barrier to engagement, alongside more prosaic factors such as forgetting.

Wearable technologies for health research: Opportunities, limitations, and practical and conceptual considerations

One of the most notable limitations of laboratory-based health research is its inability to continuously monitor health-relevant physiological processes as individuals go about their daily lives. As a result, we have generated large amounts of data with unknown generalizability to real-world situations and also created a schism between where data are collected (i.e., in the lab) and where we need to intervene to prevent disease (i.e., in the field). Devices using noninvasive wearable technology are changing all of this, however, with their ability to provide high-frequency assessments of peoples' ever-changing physiological states in daily life in a manner that is relatively noninvasive, affordable, and scalable. Here, we discuss critical points that every researcher should keep in mind when using these wearables in research, spanning device and metric decisions, hardware and software selection, and data quality and sampling rate issues, using research on stress and health as an example throughout. We also address usability and participant acceptability issues, and how wearable "digital biomarker" and behavioral data can be integrated to enhance basic science and intervention studies. Finally, we summarize 10 key questions that should be addressed to make every wearable study as strong as possible. Collectively, keeping these points in mind can improve our ability to study the psychobiology of human health, and to intervene, precisely where it matters most: in peoples' daily lives.

Harnessing Artificial Intelligence: Strategies for Mental Health Nurses in Optimizing Psychiatric Patient Care

This narrative review explores the transformative impact of Artificial Intelligence (AI) on mental health nursing, particularly in enhancing psychiatric patient care. AI technologies present new strategies for early detection, risk assessment, and improving treatment adherence in mental health. They also facilitate remote patient monitoring, bridge geographical gaps, and support clinical decision-making. The evolution of virtual mental health assistants and AI-enhanced therapeutic interventions are also discussed. These technological advancements reshape the nurse-patient interactions while ensuring personalized, efficient, and high-quality care. The review also addresses AI's ethical and responsible use in mental health nursing, emphasizing patient privacy, data security, and the balance between human interaction and AI tools. As AI applications in mental health care continue to evolve, this review encourages continued innovation while advocating for responsible implementation, thereby optimally leveraging the potential of AI in mental health nursing.

Revolutionizing stress-related disorder regulation through neuroinformatics and data analysis: An editorial

Collapse

Smartphone-Based Passive Sensing in Monitoring Patients With Cancer: A Systematic Review

PURPOSE

Patients with cancer are prone to frequent unplanned hospital visits because of disease or treatment complications. Smartphone-based passive sensing (SBPS) comprises data collection using smartphone sensors or device usage patterns, which may be an affordable and burdenless technique for remote monitoring of patients with cancer and timely detection of safety events. The aim of this article was to systematically review the published literature to identify the current state of SBPS in oncology care and research.

METHODS

A literature search was done with cutoff date July 29, 2022, using six different databases. Articles were included if they reported original studies using SBPS in patients with cancer or cancer survivors. Data extracted from studies included type of sensors used, cancer type, study objectives, and main findings.

RESULTS

Twelve studies were included, the oldest report being from 2017. The most frequent of the nine analyzed sensors and smartphone analytics was the accelerometer (eight studies) and geolocation (eight studies), followed by call logs (two studies). Breast cancer was the most studied cancer type (eight studies with 111 patients), followed by GI cancers (six studies with 133 patients). All studies aiming for feasibility concluded that SBPS in oncology was feasible (seven studies). SBPS was used as a monitoring tool, with passively sensed data being correlated with adverse events, symptom burden, cancer-related fatigue, decision conflict, recovery trends after surgery, or psychosocial impact. SBPS was also used in one study as a predictive tool for health deterioration.

CONCLUSION

SBPS shows early promise in oncology, although it cannot yet replace traditional tools to monitor quality of life and clinical outcomes. For this, validation of SBPS will be required. Therefore, further research is warranted with this developing technique.

Using machine learning with intensive longitudinal data to predict depression and suicidal ideation among medical interns over time

BACKGROUND

Use of intensive longitudinal methods (e.g. ecological momentary assessment, passive sensing) and machine learning (ML) models to predict risk for depression and suicide has increased in recent years. However, these studies often vary considerably in length, ML methods used, and sources of data. The present study examined predictive accuracy for depression and suicidal ideation (SI) as a function of time, comparing different combinations of ML methods and data sources.

METHODS

Participants were 2459 first-year training physicians (55.1% female; 52.5% White) who were provided with Fitbit wearable devices and assessed daily for mood. Linear [elastic net regression (ENR)] and non-linear (random forest) ML algorithms were used to predict depression and SI at the first-quarter follow-up assessment, using two sets of variables (daily mood features only, daily mood features + passive-sensing features). To assess accuracy over time, models were estimated iteratively for each of the first 92 days of internship, using data available up to that point in time.

RESULTS

ENRs using only the daily mood features generally had the best accuracy for predicting mental health outcomes, and predictive accuracy within 1 standard error of the full 92 day models was attained by weeks 7-8. Depression at 92 days could be predicted accurately (area under the curve >0.70) after only 14 days of data collection.

CONCLUSIONS

Simpler ML methods may outperform more complex methods until passive-sensing features become better specified. For intensive longitudinal studies, there may be limited predictive value in collecting data for more than 2 months.

Acceptability of Personal Sensing Among People With Alcohol Use Disorder: Observational Study

BACKGROUND

Personal sensing may improve digital therapeutics for mental health care by facilitating early screening, symptom monitoring, risk prediction, and personalized adaptive interventions. However, further development and the use of personal sensing requires a better understanding of its acceptability to people targeted for these applications.

OBJECTIVE

We aimed to assess the acceptability of active and passive personal sensing methods in a sample of people with moderate to severe alcohol use disorder using both behavioral and self-report measures. This sample was recruited as part of a larger grant-funded project to develop a machine learning algorithm to predict lapses.

METHODS

Participants (N=154; n=77, 50% female; mean age 41, SD 11.9 years; n=134, 87% White and n=150, 97% non-Hispanic) in early recovery (1-8 weeks of abstinence) were recruited to participate in a 3-month longitudinal study. Participants were modestly compensated for engaging with active (eg, ecological momentary assessment [EMA], audio check-in, and sleep quality) and passive (eg, geolocation, cellular communication logs, and SMS text message content) sensing methods that were selected to tap into constructs from the Relapse Prevention model by Marlatt. We assessed 3 behavioral indicators of acceptability: participants' choices about their participation in the study at various stages in the procedure, their choice to opt in to provide data for each sensing method, and their adherence to a subset of the active methods (EMA and audio check-in). We also assessed 3 self-report measures of acceptability (interference, dislike, and willingness to use for 1 year) for each method.

RESULTS

Of the 192 eligible individuals screened, 191 consented to personal sensing. Most of these individuals (169/191, 88.5%) also returned 1 week later to formally enroll, and 154 participated through the first month follow-up visit. All participants in our analysis sample opted in to provide data for EMA, sleep quality, geolocation, and cellular communication logs. Out of 154 participants, 1 (0.6%) did not provide SMS text message content and 3 (1.9%) did not provide any audio check-ins. The average adherence rate for the 4 times daily EMA was .80. The adherence rate for the daily audio check-in was .54. Aggregate participant ratings indicated that all personal sensing methods were significantly more acceptable (all P<.001) compared with neutral across subjective measures of interference, dislike, and willingness to use for 1 year. Participants did not significantly differ in their dislike of active methods compared with passive methods (P=.23). However, participants reported a higher willingness to use passive (vs active) methods for 1 year (P=.04).

CONCLUSIONS

These results suggest that active and passive sensing methods are acceptable for people with alcohol use disorder over a longer period than has previously been assessed. Important individual differences were observed across people and methods, indicating opportunities for future improvement.

Recent Progress in Micro- and Nanotechnology-Enabled Sensors for Biomedical and Environmental Challenges

Micro- and nanotechnology-enabled sensors have made remarkable advancements in the fields of biomedicine and the environment, enabling the sensitive and selective detection and quantification of diverse analytes. In biomedicine, these sensors have facilitated disease diagnosis, drug discovery, and point-of-care devices. In environmental monitoring, they have played a crucial role in assessing air, water, and soil quality, as well as ensured food safety. Despite notable progress, numerous challenges persist. This review article addresses recent developments in micro- and nanotechnology-enabled sensors for biomedical and environmental challenges, focusing on enhancing basic sensing techniques through micro/nanotechnology. Additionally, it explores the applications of these sensors in addressing current challenges in both biomedical and environmental domains. The article concludes by emphasizing the need for further research to expand the detection capabilities of sensors/devices, enhance sensitivity and selectivity, integrate wireless communication and energy-harvesting technologies, and optimize sample preparation, material selection, and automated components for sensor design, fabrication, and characterization.

Exploring digital biomarkers of illness activity in mood episodes: hypotheses generating and model development study

BACKGROUND

Depressive and manic episodes within bipolar disorder (BD) and major depressive disorder (MDD) involve altered mood, sleep, and activity alongside physiological alterations that wearables can capture.

OBJECTIVE

We explored whether physiological wearable data could predict: (aim 1) the severity of an acute affective episode at the intra-individual level, (aim 2) the polarity of an acute affective episode and euthymia among different individuals. Secondarily, we explored which physiological data were related to the prior predictions, generalization across patients, and associations between affective symptoms and physiological data.

METHODS

We conducted a prospective exploratory observational study including patients with BD and MDD on acute affective episodes (manic, depressed, and mixed) whose physiological data were recorded with a research-grade wearable (Empatica E4) across three consecutive timepoints (acute, response, and remission of episode). Euthymic patients and healthy controls (HC) were recorded during a single session (∼48 hours). Manic and depressive symptoms were assessed with standardized psychometric scales. Physiological wearable data included the following channels: acceleration (ACC), temperature (TEMP), blood volume pulse (BVP), heart rate (HR), and electrodermal activity (EDA). For data pre-processing, invalid physiological data were removed using a rule-based filter, channels were time-aligned at 1 second time units and then segmented window lengths of 32 seconds, since those parameters showed the best performances. We developed deep learning predictive models, assessed channels' individual contribution using permutation feature importance analysis, and computed physiological data to psychometric scales' items normalized mutual information (NMI). We present a novel fully automated method for analysis of physiological data from a research-grade wearable device, including a rule-based filter for invalid data and a viable supervised learning pipeline for time-series analyses.

RESULTS

35 sessions (1,512 hours) from 12 patients (manic, depressed, mixed, and euthymic) and 7 HC (age 39.7±12.6; 31.6% female) were analyzed. (aim 1) The severity of mood episodes was predicted with moderate (62%-85%) accuracies. (aim 2) The polarity of episodes was predicted with moderate (70%) accuracy. The most relevant features for the former tasks were ACC, EDA, and HR. Kendall W showed fair agreement (0.383) in feature importance across classification tasks. Generalization of the former models were of overall low accuracy, with better results for the intra-individual models. "Increased motor activity" was associated with ACC (NMI>0.55), "aggressive behavior" with EDA (NMI=1.0), "insomnia" with ACC (NMI∼0.6), "motor inhibition" with ACC (NMI∼0.75), and "psychic anxiety" with EDA (NMI=0.52).

CONCLUSIONS

Physiological data from wearables show potential to identify mood episodes and specific symptoms of mania and depression quantitatively, both in BD and MDD. Motor activity and stress-related physiological data (EDA and HR) stand out as potential digital biomarkers for predicting mania and depression respectively. These findings represent a promising pathway towards personalized psychiatry, in which physiological wearable data could allow early identification and intervention of mood episodes.

CLINICALTRIAL

A Novel Approach to Clustering Accelerometer Data for Application in Passive Predictions of Changes in Depression Severity

The treatment of mood disorders, which can become a lifelong process, varies widely in efficacy between individuals. Most options to monitor mood rely on subjective self-reports and clinical visits, which can be burdensome and may not portray an accurate representation of what the individual is experiencing. A passive method to monitor mood could be a useful tool for those with these disorders. Some previously proposed models utilized sensors from smartphones and wearables, such as the accelerometer. This study examined a novel approach of processing accelerometer data collected from smartphones only while participants of the open-science branch of the BiAffect study were typing. The data were modeled by von Mises-Fisher distributions and weighted networks to identify clusters relating to different typing positions unique for each participant. Longitudinal features were derived from the clustered data and used in machine learning models to predict clinically relevant changes in depression from clinical and typing measures. Model accuracy was approximately 95%, with 97% area under the ROC curve (AUC). The accelerometer features outperformed the vast majority of clinical and typing features, which suggested that this new approach to analyzing accelerometer data could contribute towards unobtrusive detection of changes in depression severity without the need for clinical input.

An Observational Pilot Study using a Digital Phenotyping Approach in Patients with Major Depressive Disorder Treated with Trazodone

This 8-week study was designed to explore any correlation between a passive data collection approach using a wearable device (i.e., digital phenotyping), active data collection (patient's questionnaires), and a traditional clinical evaluation [Montgomery-Åsberg Depression Rating Scale (MADRS)] in patients with major depressive disorder (MDD) treated with trazodone once a day (OAD). Overall, 11 out of 30 planned patients were enrolled. Passive parameters measured by the wearable device included number of steps, distance walked, calories burned, and sleep quality. A relationship between the sleep score (derived from passively measured data) and MADRS score was observed, as was a relationship between data collected actively (assessing depression, sleep, anxiety, and warning signs) and MADRS score. Despite the limited sample size, the efficacy and safety results were consistent with those previously reported for trazodone. The small population in this study limits the conclusions that can be drawn about the correlation between the digital phenotyping approach and traditional clinical evaluation; however, the positive trends observed suggest the need to increase synergies among clinicians, patients, and researchers to overcome the cultural barriers toward implementation of digital tools in the clinical setting. This study is a step toward the use of digital data in monitoring symptoms of depression, and the preliminary data obtained encourage further investigations of a larger population of patients monitored over a longer period of time.

Digitally filling the access gap in mental health care: An investigation of the association between rurality and online engagement with validated self-report screens across the United States

Mental health disorders are highly prevalent, yet few persons receive access to treatment; this is compounded in rural areas where mental health services are limited. The proliferation of online mental health screening tools are considered a key strategy to increase identification, diagnosis, and treatment of mental illness. However, research on real-world effectiveness, especially in hard to reach rural communities, is limited. Accordingly, the current work seeks to test the hypothesis that online screening use is greater in rural communities with limited mental health resources. The study utilized a national, online, population-based cohort consisting of Microsoft Bing search engine users across 18 months in the United States (representing approximately one-third of all internet searches), in conjunction with user-matched data of completed online mental health screens for anxiety, bipolar, depression, and psychosis (N = 4354) through Mental Health America, a leading non-profit mental health organization in the United States. Rank regression modeling was leveraged to characterize U.S. county-level screen completion rates as a function of rurality, health-care availability, and sociodemographic variables. County-level rurality and mental health care availability alone explained 42% of the variance in MHA screen completion rate (R2 = 0.42, p < 5.0 × 10-6). The results suggested that online screening was more prominent in underserved rural communities, therefore presenting as important tools with which to bridge mental health-care gaps in rural, resource-deficient areas.

The Use of Passive Smartphone Data to Monitor Anxiety and Depression Among College Students in Real-World Settings: Protocol for a Systematic Review

BACKGROUND

College students are particularly at risk of depression and anxiety. These disorders have a serious impact on public health and affect patients' daily lives. The potential for using smartphones to monitor these mental conditions, providing passively collected physiological and behavioral data, has been reported among the general population. However, research on the use of passive smartphone data to monitor anxiety and depression among specific populations of college students has never been reviewed.

OBJECTIVE

This review's objectives are (1) to provide an overview of the use of passive smartphone data to monitor depression and anxiety among college students, given their specific type of smartphone use and living setting, and (2) to evaluate the different methods used to assess those smartphone data, including their strengths and limitations.

METHODS

This review will follow the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. Two independent investigators will review English-language, full-text, peer-reviewed papers extracted from PubMed and Web of Science that measure passive smartphone data and levels of depression or anxiety among college students. A preliminary search was conducted in February 2022 as a proof of concept.

RESULTS

Our preliminary search identified 115 original articles, 8 of which met our eligibility criteria. Our planned full study will include an article selection flowchart, tables, and figures representing the main information extracted on the use of passive smartphone data to monitor anxiety and depression among college students.

CONCLUSIONS

The planned review will summarize the published research on using passive smartphone data to monitor anxiety and depression among college students. The review aims to better understand whether and how passive smartphone data are associated with indicators of depression and anxiety among college students. This could be valuable in order to provide a digital solution for monitoring mental health issues in this specific population by enabling easier identification and follow-up of the patients.

TRIAL REGISTRATION

PROSPERO CRD42022316263; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=316263.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/38785.

Evaluating Conversational Agents for Mental Health: Scoping Review of Outcomes and Outcome Measurement Instruments (Preprint)

BACKGROUND

Rapid proliferation of mental health interventions delivered through conversational agents (CAs) calls for high-quality evidence to support their implementation and adoption. Selecting appropriate outcomes, instruments for measuring outcomes, and assessment methods are crucial for ensuring that interventions are evaluated effectively and with a high level of quality.

OBJECTIVE

We aimed to identify the types of outcomes, outcome measurement instruments, and assessment methods used to assess the clinical, user experience, and technical outcomes in studies that evaluated the effectiveness of CA interventions for mental health.

METHODS

We undertook a scoping review of the relevant literature to review the types of outcomes, outcome measurement instruments, and assessment methods in studies that evaluated the effectiveness of CA interventions for mental health. We performed a comprehensive search of electronic databases, including PubMed, Cochrane Central Register of Controlled Trials, Embase (Ovid), PsychINFO, and Web of Science, as well as Google Scholar and Google. We included experimental studies evaluating CA mental health interventions. The screening and data extraction were performed independently by 2 review authors in parallel. Descriptive and thematic analyses of the findings were performed.

RESULTS

We included 32 studies that targeted the promotion of mental well-being (17/32, 53%) and the treatment and monitoring of mental health symptoms (21/32, 66%). The studies reported 203 outcome measurement instruments used to measure clinical outcomes (123/203, 60.6%), user experience outcomes (75/203, 36.9%), technical outcomes (2/203, 1.0%), and other outcomes (3/203, 1.5%). Most of the outcome measurement instruments were used in only 1 study (150/203, 73.9%) and were self-reported questionnaires (170/203, 83.7%), and most were delivered electronically via survey platforms (61/203, 30.0%). No validity evidence was cited for more than half of the outcome measurement instruments (107/203, 52.7%), which were largely created or adapted for the study in which they were used (95/107, 88.8%).

CONCLUSIONS

The diversity of outcomes and the choice of outcome measurement instruments employed in studies on CAs for mental health point to the need for an established minimum core outcome set and greater use of validated instruments. Future studies should also capitalize on the affordances made available by CAs and smartphones to streamline the evaluation and reduce participants' input burden inherent to self-reporting.

Measuring Daily Activity Rhythms in Young Adults at Risk of Affective Instability Using Passively Collected Smartphone Data: Observational Study

BACKGROUND

Irregularities in circadian rhythms have been associated with adverse health outcomes. The regularity of rhythms can be quantified using passively collected smartphone data to provide clinically relevant biomarkers of routine.

OBJECTIVE

This study aims to develop a metric to quantify the regularity of activity rhythms and explore the relationship between routine and mood, as well as demographic covariates, in an outpatient psychiatric cohort.

METHODS

Passively sensed smartphone data from a cohort of 38 young adults from the Penn or Children's Hospital of Philadelphia Lifespan Brain Institute and Outpatient Psychiatry Clinic at the University of Pennsylvania were fitted with 2-state continuous-time hidden Markov models representing active and resting states. The regularity of routine was modeled as the hour-of-the-day random effects on the probability of state transition (ie, the association between the hour-of-the-day and state membership). A regularity score, Activity Rhythm Metric, was calculated from the continuous-time hidden Markov models and regressed on clinical and demographic covariates.

RESULTS

Regular activity rhythms were associated with longer sleep durations (P=.009), older age (P=.001), and mood (P=.049).

CONCLUSIONS

Passively sensed Activity Rhythm Metrics are an alternative to existing metrics but do not require burdensome survey-based assessments. Low-burden, passively sensed metrics based on smartphone data are promising and scalable alternatives to traditional measurements.

A Machine Learning Approach for Continuous Mining of Nonidentifiable Smartphone Data to Create a Novel Digital Biomarker Detecting Generalized Anxiety Disorder: Prospective Cohort Study

BACKGROUND

Anxiety is one of the leading causes of mental health disability around the world. Currently, a majority of the population who experience anxiety go undiagnosed or untreated. New and innovative ways of diagnosing and monitoring anxiety have emerged using smartphone sensor-based monitoring as a metric for the management of anxiety. This is a novel study as it adds to the field of research through the use of nonidentifiable smartphone usage to help detect and monitor anxiety remotely and in a continuous and passive manner.

OBJECTIVE

This study aims to evaluate the accuracy of a novel mental behavioral profiling metric derived from smartphone usage for the identification and tracking of generalized anxiety disorder (GAD).

METHODS

Smartphone data and self-reported 7-item GAD anxiety assessments were collected from 229 participants using an Android operating system smartphone in an observational study over an average of 14 days (SD 29.8). A total of 34 features were mined to be constructed as a potential digital phenotyping marker from continuous smartphone usage data. We further analyzed the correlation of these digital behavioral markers against each item of the 7-item Generalized Anxiety Disorder Scale (GAD-7) and its influence on the predictions of machine learning algorithms.

RESULTS

A total of 229 participants were recruited in this study who had completed the GAD-7 assessment and had at least one set of passive digital data collected within a 24-hour period. The mean GAD-7 score was 11.8 (SD 5.7). Regression modeling was tested against classification modeling and the highest prediction accuracy was achieved from a binary XGBoost classification model (precision of 73%-81%; recall of 68%-87%; F₁-score of 71%-79%; accuracy of 76%; area under the curve of 80%). Nonparametric permutation testing with Pearson correlation results indicated that the proposed metric (Mental Health Similarity Score [MHSS]) had a colinear relationship between GAD-7 Items 1, 3 and 7.

CONCLUSIONS

The proposed MHSS metric demonstrates the feasibility of using passively collected nonintrusive smartphone data and machine learning-based data mining techniques to track an individuals' daily anxiety levels with a 76% accuracy that directly relates to the GAD-7 scale.

Lessons learned from psychosocial support and mental health surveys during the 10 years since the Great East Japan Earthquake: Establishing evidence-based disaster psychiatry

Post-disaster mental health and psychosocial support have drawn attention in Japan after the 1995 Great Hanshin-Awaji Earthquake, with mental health care centers for the affected communities being organized. After the catastrophe, a reconstruction budget was allocated to organize mental health care centers to provide psychosocial support for communities affected by the 2007 Chūetsu offshore earthquake, the 2011 Great East Japan Earthquake, and the 2016 Kumamoto Earthquake. There were several major improvements in post-disaster mental health measures after the Great East Japan Earthquake. The Disaster Psychiatric Assistance Team system was organized after the earthquake to orchestrate disaster response related to the psychiatric health system and mental health of the affected communities. Special mental health care efforts were drawn to the communities affected by the nuclear power plant accident through Chemical, Biological, Radiological, Nuclear, and high yield Explosives, being succeeded by measures against the coronavirus pandemic. As another new movement after the Great East Japan Earthquake, the number of surveys involving communities affected by disasters has soared. More than 10 times the number of scientific publications were made in English during the decade following the Great East Japan Earthquake, compared with the previous decades. In this review, we examined the results and issues acquired in the 10 years since the Great East Japan Earthquake, proposing evidence-based disaster psychiatry as the direction of future mental health measures related to emergency preparedness and response.

Is Speech the New Blood? Recent Progress in AI-Based Disease Detection From Audio in a Nutshell

In recent years, advancements in the field of artificial intelligence (AI) have impacted several areas of research and application. Besides more prominent examples like self-driving cars or media consumption algorithms, AI-based systems have further started to gain more and more popularity in the health care sector, however whilst being restrained by high requirements for accuracy, robustness, and explainability. Health-oriented AI research as a sub-field of digital health investigates a plethora of human-centered modalities. In this article, we address recent advances in the so far understudied but highly promising audio domain with a particular focus on speech data and present corresponding state-of-the-art technologies. Moreover, we give an excerpt of recent studies on the automatic audio-based detection of diseases ranging from acute and chronic respiratory diseases via psychiatric disorders to developmental disorders and neurodegenerative disorders. Our selection of presented literature shows that the recent success of deep learning methods in other fields of AI also more and more translates to the field of digital health, albeit expert-designed feature extractors and classical ML methodologies are still prominently used. Limiting factors, especially for speech-based disease detection systems, are related to the amount and diversity of available data, e. g., the number of patients and healthy controls as well as the underlying distribution of age, languages, and cultures. Finally, we contextualize and outline application scenarios of speech-based disease detection systems as supportive tools for health-care professionals under ethical consideration of privacy protection and faulty prediction.

What Are We Measuring When We Evaluate Digital Interventions for Improving Lifestyle? A Scoping Meta-Review

Background: Lifestyle Medicine (LM) aims to address six main behavioral domains: diet/nutrition, substance use (SU), physical activity (PA), social relationships, stress management, and sleep. Digital Health Interventions (DHIs) have been used to improve these domains. However, there is no consensus on how to measure lifestyle and its intermediate outcomes aside from measuring each behavior separately. We aimed to describe (1) the most frequent lifestyle domains addressed by DHIs, (2) the most frequent outcomes used to measure lifestyle changes, and (3) the most frequent DHI delivery methods. Methods: We followed the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA-ScR) Extension for Scoping Reviews. A literature search was conducted using MEDLINE, Cochrane Library, EMBASE, and Web of Science for publications since 2010. We included systematic reviews and meta-analyses of clinical trials using DHI to promote health, behavioral, or lifestyle change. Results: Overall, 954 records were identified, and 72 systematic reviews were included. Of those, 35 conducted meta-analyses, 58 addressed diet/nutrition, and 60 focused on PA. Only one systematic review evaluated all six lifestyle domains simultaneously; 1 systematic review evaluated five lifestyle domains; 5 systematic reviews evaluated 4 lifestyle domains; 14 systematic reviews evaluated 3 lifestyle domains; and the remaining 52 systematic reviews evaluated only one or two domains. The most frequently evaluated domains were diet/nutrition and PA. The most frequent DHI delivery methods were smartphone apps and websites. Discussion: The concept of lifestyle is still unclear and fragmented, making it hard to evaluate the complex interconnections of unhealthy behaviors, and their impact on health. Clarifying this concept, refining its operationalization, and defining the reporting guidelines should be considered as the current research priorities. DHIs have the potential to improve lifestyle at primary, secondary, and tertiary levels of prevention-but most of them are targeting clinical populations. Although important advances have been made to evaluate DHIs, some of their characteristics, such as the rate at which they become obsolete, will require innovative research designs to evaluate long-term outcomes in health.

Wearable Sensing Systems for Monitoring Mental Health

Wearable systems for monitoring biological signals have opened the door to personalized healthcare and have advanced a great deal over the past decade with the development of flexible electronics, efficient energy storage, wireless data transmission, and information processing technologies. As there are cumulative understanding of mechanisms underlying the mental processes and increasing desire for lifetime mental wellbeing, various wearable sensors have been devised to monitor the mental status from physiological activities, physical movements, and biochemical profiles in body fluids. This review summarizes the recent progress in wearable healthcare monitoring systems that can be utilized in mental healthcare, especially focusing on the biochemical sensors (i.e., biomarkers associated with mental status, sensing modalities, and device materials) and discussing their promises and challenges.