Finding Significant Stress Episodes in a Discontinuous Time Series of Rapidly Varying Mobile Sensor Data

Predicting Obsessive-Compulsive Disorder Events in Children and Adolescents in the Wild using a Wearable Biosensor (Wrist Angel): Protocol for the Analysis Plan of a Nonrandomized Pilot Study

BACKGROUND

Physiological signals such as heart rate and electrodermal activity can provide insight into an individual's mental state, which are invaluable information for mental health care. Using recordings of physiological signals from wearable devices in the wild can facilitate objective monitoring of symptom severity and evaluation of treatment progress.

OBJECTIVE

We designed a study to evaluate the feasibility of predicting obsessive-compulsive disorder (OCD) events from physiological signals recorded using wrist-worn devices in the wild. Here, we present an analysis plan for the study to document our a priori hypotheses and increase the robustness of the findings of our planned study.

METHODS

In total, 18 children and adolescents aged between 8 and 16 years were included in this study. Nine outpatients with an OCD diagnosis were recruited from a child and adolescent mental health center. Nine youths without a psychiatric diagnosis were recruited from the catchment area. Patients completed a clinical interview to assess OCD severity, types of OCD, and number of OCD symptoms in the clinic. Participants wore a biosensor on their wrist for up to 8 weeks in their everyday lives. Patients were asked to press an event tag button on the biosensor when they were stressed by OCD symptoms. Participants without a psychiatric diagnosis were asked to press this button whenever they felt really scared. Before and after the 8-week observation period, participants wore the biosensor under controlled conditions of rest and stress in the clinic. Features are extracted from 4 different physiological signals within sliding windows to predict the distress event logged by participants during data collection. We will test the prediction models within participants across time and multiple participants. Model selection and estimation using 2-layer cross-validation are outlined for both scenarios.

RESULTS

Participants were included between December 2021 and December 2022. Participants included 10 female and 8 male participants with an even sex distribution between groups. Patients were aged between 10 and 16 years, and adolescents without a psychiatric diagnosis were between the ages of 8 and 16 years. Most patients had moderate to moderate to severe OCD, except for 1 patient with mild OCD.

CONCLUSIONS

The strength of the planned study is the investigation of predictions of OCD events in the wild. Major challenges of the study are the inherent noise of in-the-wild data and the lack of contextual knowledge associated with the recorded signals. This preregistered analysis plan discusses in detail how we plan to address these challenges and may help reduce interpretation bias of the upcoming results. If the obtained results from this study are promising, we will be closer to automated detection of OCD events outside of clinical experiments. This is an important tool for the assessment and treatment of OCD in youth.

TRIAL REGISTRATION

ClinicalTrials.gov NCT05064527; https://clinicaltrials.gov/study/NCT05064527.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/48571.

Detecting Social Contexts from Mobile Sensing Indicators in Virtual Interactions with Socially Anxious Individuals

Mobile sensing is a ubiquitous and useful tool to make inferences about individuals' mental health based on physiology and behavior patterns. Along with sensing features directly associated with mental health, it can be valuable to detect different features of social contexts to learn about social interaction patterns over time and across different environments. This can provide insight into diverse communities' academic, work and social lives, and their social networks. We posit that passively detecting social contexts can be particularly useful for social anxiety research, as it may ultimately help identify changes in social anxiety status and patterns of social avoidance and withdrawal. To this end, we recruited a sample of highly socially anxious undergraduate students (N=46) to examine whether we could detect the presence of experimentally manipulated virtual social contexts via wristband sensors. Using a multitask machine learning pipeline, we leveraged passively sensed biobehavioral streams to detect contexts relevant to social anxiety, including (1) whether people were in a social situation, (2) size of the social group, (3) degree of social evaluation, and (4) phase of social situation (anticipating, actively experiencing, or had just participated in an experience). Results demonstrated the feasibility of detecting most virtual social contexts, with stronger predictive accuracy when detecting whether individuals were in a social situation or not and the phase of the situation, and weaker predictive accuracy when detecting the level of social evaluation. They also indicated that sensing streams are differentially important to prediction based on the context being predicted. Our findings also provide useful information regarding design elements relevant to passive context detection, including optimal sensing duration, the utility of different sensing modalities, and the need for personalization. We discuss implications of these findings for future work on context detection (e.g., just-in-time adaptive intervention development).

mRisk: Continuous Risk Estimation for Smoking Lapse from Noisy Sensor Data with Incomplete and Positive-Only Labels

Passive detection of risk factors (that may influence unhealthy or adverse behaviors) via wearable and mobile sensors has created new opportunities to improve the effectiveness of behavioral interventions. A key goal is to find opportune moments for intervention by passively detecting rising risk of an imminent adverse behavior. But, it has been difficult due to substantial noise in the data collected by sensors in the natural environment and a lack of reliable label assignment of low- and high-risk states to the continuous stream of sensor data. In this paper, we propose an event-based encoding of sensor data to reduce the effect of noises and then present an approach to efficiently model the historical influence of recent and past sensor-derived contexts on the likelihood of an adverse behavior. Next, to circumvent the lack of any confirmed negative labels (i.e., time periods with no high-risk moment), and only a few positive labels (i.e., detected adverse behavior), we propose a new loss function. We use 1,012 days of sensor and self-report data collected from 92 participants in a smoking cessation field study to train deep learning models to produce a continuous risk estimate for the likelihood of an impending smoking lapse. The risk dynamics produced by the model show that risk peaks an average of 44 minutes before a lapse. Simulations on field study data show that using our model can create intervention opportunities for 85% of lapses with 5.5 interventions per day.

The Feasibility and Utility of Harnessing Digital Health to Understand Clinical Trajectories in Medication Treatment for Opioid Use Disorder: D-TECT Study Design and Methodological Considerations

Introduction

Across the U.S., the prevalence of opioid use disorder (OUD) and the rates of opioid overdoses have risen precipitously in recent years. Several effective medications for OUD (MOUD) exist and have been shown to be life-saving. A large volume of research has identified a confluence of factors that predict attrition and continued substance use during substance use disorder treatment. However, much of this literature has examined a small set of potential moderators or mediators of outcomes in MOUD treatment and may lead to over-simplified accounts of treatment non-adherence. Digital health methodologies offer great promise for capturing intensive, longitudinal ecologically-valid data from individuals in MOUD treatment to extend our understanding of factors that impact treatment engagement and outcomes.

Methods

This paper describes the protocol (including the study design and methodological considerations) from a novel study supported by the National Drug Abuse Treatment Clinical Trials Network at the National Institute on Drug Abuse (NIDA). This study (D-TECT) primarily seeks to evaluate the feasibility of collecting ecological momentary assessment (EMA), smartphone and smartwatch sensor data, and social media data among patients in outpatient MOUD treatment. It secondarily seeks to examine the utility of EMA, digital sensing, and social media data (separately and compared to one another) in predicting MOUD treatment retention, opioid use events, and medication adherence [as captured in electronic health records (EHR) and EMA data]. To our knowledge, this is the first project to include all three sources of digitally derived data (EMA, digital sensing, and social media) in understanding the clinical trajectories of patients in MOUD treatment. These multiple data streams will allow us to understand the relative and combined utility of collecting digital data from these diverse data sources. The inclusion of EHR data allows us to focus on the utility of digital health data in predicting objectively measured clinical outcomes.

Discussion

Results may be useful in elucidating novel relations between digital data sources and OUD treatment outcomes. It may also inform approaches to enhancing outcomes measurement in clinical trials by allowing for the assessment of dynamic interactions between individuals' daily lives and their MOUD treatment response.

Clinical Trial Registration

Identifier: NCT04535583.

Ecological momentary interventions for mental health: A scoping review

BACKGROUND

The development of mobile computing technology has enabled the delivery of psychological interventions while people go about their everyday lives. The original visions of the potential of these "ecological momentary interventions" were presented over a decade ago, and the widespread adoption of smartphones in the intervening years has led to a variety of research studies exploring the feasibility of these aspirations. However, there is a dearth of research describing the different dimensions, characteristics, and features of these interventions, as constructed.

OBJECTIVE

To provide an overview of the definitions given for "ecological momentary interventions" in the treatment of common mental health disorders, and describe the set of technological and interaction possibilities which have been used in the design of these interventions.

METHODS

A systematic search identified relevant literature published between 2009 and 2020 in the PubMed, PsycInfo, and ACM Guide to the Computing Literature databases. Following screening, data were extracted from eligible articles using a standardized extraction worksheet. Selected articles were then thematically categorized.

RESULTS

The search identified 583 articles of which 64 met the inclusion criteria. The interventions target a range of mental health problems, with diverse aims, intervention designs and evaluation approaches. The studies employed a variety of features for intervention delivery, but recent research is overwhelmingly comprised of studies based on smartphone apps (30 of 42 papers that described an intervention). Twenty two studies employed sensors for the collection of data in order to provide just-in-time support or predict psychological states.

CONCLUSIONS

With the shift towards smartphone apps, the vision for EMIs has begun to be realised. Recent years have seen increased exploration of the use of sensors and machine learning, but the role of humans in the delivery of EMI is also varied. The variety of capabilities exhibited by EMIs motivates development of a more precise vocabulary for capturing both automatic and human tailoring of these interventions.

mPulse Mobile Sensing Model for Passive Detection of Impulsive Behavior: Exploratory Prediction Study

BACKGROUND

Mobile health technology has demonstrated the ability of smartphone apps and sensors to collect data pertaining to patient activity, behavior, and cognition. It also offers the opportunity to understand how everyday passive mobile metrics such as battery life and screen time relate to mental health outcomes through continuous sensing. Impulsivity is an underlying factor in numerous physical and mental health problems. However, few studies have been designed to help us understand how mobile sensors and self-report data can improve our understanding of impulsive behavior.

OBJECTIVE

The objective of this study was to explore the feasibility of using mobile sensor data to detect and monitor self-reported state impulsivity and impulsive behavior passively via a cross-platform mobile sensing application.

METHODS

We enrolled 26 participants who were part of a larger study of impulsivity to take part in a real-world, continuous mobile sensing study over 21 days on both Apple operating system (iOS) and Android platforms. The mobile sensing system (mPulse) collected data from call logs, battery charging, and screen checking. To validate the model, we used mobile sensing features to predict common self-reported impulsivity traits, objective mobile behavioral and cognitive measures, and ecological momentary assessment (EMA) of state impulsivity and constructs related to impulsive behavior (ie, risk-taking, attention, and affect).

RESULTS

Overall, the findings suggested that passive measures of mobile phone use such as call logs, battery charging, and screen checking can predict different facets of trait and state impulsivity and impulsive behavior. For impulsivity traits, the models significantly explained variance in sensation seeking, planning, and lack of perseverance traits but failed to explain motor, urgency, lack of premeditation, and attention traits. Passive sensing features from call logs, battery charging, and screen checking were particularly useful in explaining and predicting trait-based sensation seeking. On a daily level, the model successfully predicted objective behavioral measures such as present bias in delay discounting tasks, commission and omission errors in a cognitive attention task, and total gains in a risk-taking task. Our models also predicted daily EMA questions on positivity, stress, productivity, healthiness, and emotion and affect. Perhaps most intriguingly, the model failed to predict daily EMA designed to measure previous-day impulsivity using face-valid questions.

CONCLUSIONS

The study demonstrated the potential for developing trait and state impulsivity phenotypes and detecting impulsive behavior from everyday mobile phone sensors. Limitations of the current research and suggestions for building more precise passive sensing models are discussed.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03006653; https://clinicaltrials.gov/ct2/show/NCT03006653.

Automated Detection of Stressful Conversations Using Wearable Physiological and Inertial Sensors

Stressful conversation is a frequently occurring stressor in our daily life. Stressors not only adversely affect our physical and mental health but also our relationships with family, friends, and coworkers. In this paper, we present a model to automatically detect stressful conversations using wearable physiological and inertial sensors. We conducted a lab and a field study with cohabiting couples to collect ecologically valid sensor data with temporally-precise labels of stressors. We introduce the concept of stress cycles, i.e., the physiological arousal and recovery, within a stress event. We identify several novel features from stress cycles and show that they exhibit distinguishing patterns during stressful conversations when compared to physiological response due to other stressors. We observe that hand gestures also show a distinct pattern when stress occurs due to stressful conversations. We train and test our model using field data collected from 38 participants. Our model can determine whether a detected stress event is due to a stressful conversation with an F1-score of 0.83, using features obtained from only one stress cycle, facilitating intervention delivery within 3.9 minutes since the start of a stressful conversation.

Evaluating the Reproducibility of Physiological Stress Detection Models

Recent advances in wearable sensor technologies have led to a variety of approaches for detecting physiological stress. Even with over a decade of research in the domain, there still exist many significant challenges, including a near-total lack of reproducibility across studies. Researchers often use some physiological sensors (custom-made or off-the-shelf), conduct a study to collect data, and build machine-learning models to detect stress. There is little effort to test the applicability of the model with similar physiological data collected from different devices, or the efficacy of the model on data collected from different studies, populations, or demographics. This paper takes the first step towards testing reproducibility and validity of methods and machine-learning models for stress detection. To this end, we analyzed data from 90 participants, from four independent controlled studies, using two different types of sensors, with different study protocols and research goals. We started by evaluating the performance of models built using data from one study and tested on data from other studies. Next, we evaluated new methods to improve the performance of stress-detection models and found that our methods led to a consistent increase in performance across all studies, irrespective of the device type, sensor type, or the type of stressor. Finally, we developed and evaluated a clustering approach to determine the stressed/not-stressed classification when applying models on data from different studies, and found that our approach performed better than selecting a threshold based on training data. This paper's thorough exploration of reproducibility in a controlled environment provides a critical foundation for deeper study of such methods, and is a prerequisite for tackling reproducibility in free-living conditions.

Can We Ditch Feature Engineering? End-to-End Deep Learning for Affect Recognition from Physiological Sensor Data

To further extend the applicability of wearable sensors in various domains such as mobile health systems and the automotive industry, new methods for accurately extracting subtle physiological information from these wearable sensors are required. However, the extraction of valuable information from physiological signals is still challenging—smartphones can count steps and compute heart rate, but they cannot recognize emotions and related affective states. This study analyzes the possibility of using end-to-end multimodal deep learning (DL) methods for affect recognition. Ten end-to-end DL architectures are compared on four different datasets with diverse raw physiological signals used for affect recognition, including emotional and stress states. The DL architectures specialized for time-series classification were enhanced to simultaneously facilitate learning from multiple sensors, each having their own sampling frequency. To enable fair comparison among the different DL architectures, Bayesian optimization was used for hyperparameter tuning. The experimental results showed that the performance of the models depends on the intensity of the physiological response induced by the affective stimuli, i.e., the DL models recognize stress induced by the Trier Social Stress Test more successfully than they recognize emotional changes induced by watching affective content, e.g., funny videos. Additionally, the results showed that the CNN-based architectures might be more suitable than LSTM-based architectures for affect recognition from physiological sensors.

Hybrid System of Emotion Evaluation in Physiotherapeutic Procedures

Nowadays, the dynamic development of technology allows for the design of systems based on various information sources and their integration into hybrid expert systems. One of the areas of research where such systems are especially helpful is emotion analysis. The sympathetic nervous system controls emotions, while its function is directly reflected by the electrodermal activity (EDA) signal. The presented study aimed to develop a tool and propose a physiological data set to complement the psychological data. The study group consisted of 41 students aged from 19 to 26 years. The presented research protocol was based on the acquisition of the electrodermal activity signal using the Empatica E4 device during three exercises performed in a prototype Disc4Spine system and using the psychological research methods. Different methods (hierarchical and non-hierarchical) of subsequent data clustering and optimisation in the context of emotions experienced were analysed. The best results were obtained for the k-means classifier during Exercise 3 (80.49%) and for the combination of the EDA signal with negative emotions (80.48%). A comparison of accuracy of the k-means classification with the independent division made by a psychologist revealed again the best results for negative emotions (78.05%).

Stress Tracker-Detecting Acute Stress From a Trackpad: Controlled Study

Background

Stress is a risk factor associated with physiological and mental health problems. Unobtrusive, continuous stress sensing would enable precision health monitoring and proactive interventions, but current sensing methods are often inconvenient, expensive, or suffer from limited adherence. Prior work has shown the possibility to detect acute stress using biomechanical models derived from passive logging of computer input devices.

Objective

Our objective is to detect acute stress from passive movement measurements of everyday interactions on a laptop trackpad: (1) click, (2) steer, and (3) drag and drop.

Methods

We built upon previous work, detecting acute stress through the biomechanical analyses of canonical computer mouse interactions and extended it to study similar interactions with the trackpad. A total of 18 participants carried out 40 trials each of three different types of movement—(1) click, (2) steer, and (3) drag and drop—under both relaxed and stressed conditions.

Results

The mean and SD of the contact area under the finger were higher when clicking trials were performed under stressed versus relaxed conditions (mean area: P=.009, effect size=0.76; SD area: P=.01, effect size=0.69). Further, our results show that as little as 4 clicks on a trackpad can be used to detect binary levels of acute stress (ie, whether it is present or not).

Conclusions

We present evidence that scalable, inexpensive, and unobtrusive stress sensing can be done via repurposing passive monitoring of computer trackpad usage.

Toward Emotion Recognition From Physiological Signals in the Wild: Approaching the Methodological Issues in Real-Life Data Collection

Emotion, mood, and stress recognition (EMSR) has been studied in laboratory settings for decades. In particular, physiological signals are widely used to detect and classify affective states in lab conditions. However, physiological reactions to emotional stimuli have been found to differ in laboratory and natural settings. Thanks to recent technological progress (e.g., in wearables) the creation of EMSR systems for a large number of consumers during their everyday activities is increasingly possible. Therefore, datasets created in the wild are needed to insure the validity and the exploitability of EMSR models for real-life applications. In this paper, we initially present common techniques used in laboratory settings to induce emotions for the purpose of physiological dataset creation. Next, advantages and challenges of data collection in the wild are discussed. To assess the applicability of existing datasets to real-life applications, we propose a set of categories to guide and compare at a glance different methodologies used by researchers to collect such data. For this purpose, we also introduce a visual tool called Graphical Assessment of Real-life Application-Focused Emotional Dataset (GARAFED). In the last part of the paper, we apply the proposed tool to compare existing physiological datasets for EMSR in the wild and to show possible improvements and future directions of research. We wish for this paper and GARAFED to be used as guidelines for researchers and developers who aim at collecting affect-related data for real-life EMSR-based applications.

THE STRATIFIED MICRO-RANDOMIZED TRIAL DESIGN: SAMPLE SIZE CONSIDERATIONS FOR TESTING NESTED CAUSAL EFFECTS OF TIME-VARYING TREATMENTS

Technological advancements in the field of mobile devices and wearable sensors have helped overcome obstacles in the delivery of care, making it possible to deliver behavioral treatments anytime and anywhere. Here, we discuss our work on the design of a mobile health smoking cessation intervention study with the goal of assessing whether reminders, delivered at times of stress, result in a reduction/prevention of stress in the near-term, and whether this effect changes with time in study. Multiple statistical challenges arose in this effort, leading to the development of the stratified micro-randomized trial design. In these designs, each individual is randomized to treatment repeatedly at times determined by predictions of risk. These risk times may be impacted by prior treatment. We describe the statistical challenges and detail how they can be met.

Technologies for Opioid Use Disorder Management: Mobile App Search and Scoping Review

Background

Advances in technology engender the investigation of technological solutions to opioid use disorder (OUD). However, in comparison to chronic disease management, the application of mobile health (mHealth) to OUD has been limited.

Objective

The overarching aim of our research was to design OUD management technologies that utilize wearable sensors to provide continuous monitoring capabilities. The objectives of this study were to (1) document the currently available opioid-related mHealth apps, (2) review past and existing technology solutions that address OUD, and (3) discuss opportunities for technological withdrawal management solutions.

Methods

We used a two-phase parallel search approach: (1) an app search to determine the availability of opioid-related mHealth apps and (2) a scoping review of relevant literature to identify relevant technologies and mHealth apps used to address OUD.

Results

The app search revealed a steady rise in app development, with most apps being clinician-facing. Most of the apps were designed to aid in opioid dose conversion. Despite the availability of these apps, the scoping review found no study that investigated the efficacy of mHealth apps to address OUD.

Conclusions

Our findings highlight a general gap in technological solutions of OUD management and the potential for mHealth apps and wearable sensors to address OUD.

Continuous Detection of Physiological Stress with Commodity Hardware

Timely detection of an individual's stress level has the potential to improve stress management, thereby reducing the risk of adverse health consequences that may arise due to mismanagement of stress. Recent advances in wearable sensing have resulted in multiple approaches to detect and monitor stress with varying levels of accuracy. The most accurate methods, however, rely on clinical-grade sensors to measure physiological signals; they are often bulky, custom made, and expensive, hence limiting their adoption by researchers and the general public. In this article, we explore the viability of commercially available off-the-shelf sensors for stress monitoring. The idea is to be able to use cheap, nonclinical sensors to capture physiological signals and make inferences about the wearer's stress level based on that data. We describe a system involving a popular off-the-shelf heart rate monitor, the Polar H7; we evaluated our system with 26 participants in both a controlled lab setting with three well-validated stress-inducing stimuli and in free-living field conditions. Our analysis shows that using the off-the-shelf sensor alone, we were able to detect stressful events with an F1-score of up to 0.87 in the lab and 0.66 in the field, on par with clinical-grade sensors.

SmokingOpp: Detecting the Smoking 'Opportunity' Context Using Mobile Sensors

Context plays a key role in impulsive adverse behaviors such as fights, suicide attempts, binge-drinking, and smoking lapse. Several contexts dissuade such behaviors, but some may trigger adverse impulsive behaviors. We define these latter contexts as 'opportunity' contexts, as their passive detection from sensors can be used to deliver context-sensitive interventions. In this paper, we define the general concept of 'opportunity' contexts and apply it to the case of smoking cessation. We operationalize the smoking 'opportunity' context, using self-reported smoking allowance and cigarette availability. We show its clinical utility by establishing its association with smoking occurrences using Granger causality. Next, we mine several informative features from GPS traces, including the novel location context of smoking spots, to develop the SmokingOpp model for automatically detecting the smoking 'opportunity' context. Finally, we train and evaluate the SmokingOpp model using 15 million GPS points and 3,432 self-reports from 90 newly abstinent smokers in a smoking cessation study.

Feature-Based Online Representation Algorithm for Streaming Time Series Similarity Search

With the rapid development of information technology, we have already access to the era of big data. Time series is a sequence of data points associated with numerical values and successive timestamps. Time series not only has the traditional big data features, but also can be continuously generated in a high speed. Therefore, it is very time- and resource-consuming to directly apply the traditional time series similarity search methods on the raw time series data. In this paper, we propose a novel online segmenting algorithm for streaming time series, which has a relatively high performance on feature representation and similarity search. Extensive experimental results on different typical time series datasets have demonstrated the superiority of our method.

Ambulatory Smoking Habits Investigation based on Physiology and Context (ASSIST) using wearable sensors and mobile phones: protocol for an observational study

INTRODUCTION

Smoking prevalence continues to be high over the world and smoking-induced diseases impose a heavy burden on the medical care system. As believed by many researchers, a promising way to promote healthcare and well-being at low cost for the large vulnerable smoking population is through eHealth solutions by providing self-help information about smoking cessation. But in the absence of first-hand knowledge about smoking habits in daily life settings, systems built on these methods often fail to deliver proactive and tailored interventions for different users and situations over time, thus resulting in low efficacy. To fill the gap, an observational study has been developed on the theme of objective and non-biased monitoring of smoking habits in a longitudinal and ambulatory mode. This paper presents the study protocol. The primary objective of the study is to reveal the contextual and physiological pattern of different smoking behaviours using wearable sensors and mobile phones. The secondary objectives are to (1) analyse cue factors and contextual situations of smoking events; (2) describe smoking types with regard to users' characteristics and (3) compare smoking types between and within subjects.

METHODS AND ANALYSES

This is an observational study aimed at reaching 100 participants. Inclusion criteria are adults aged between 18 and 65 years, current smoker and office worker. The primary outcome is a collection of a diverse and inclusive data set representing the daily smoking habits of the general smoking population from similar social context. Data analysation will revolve around our primary and secondary objectives. First, linear regression and linear mixed model will be used to estimate whether a factor or pattern have consistent (p value<0.05) correlation with smoking. Furthermore, multivariate multilevel analysis will be used to examine the influence of smokers' characteristics (sex, age, education, socioeconomic status, nicotine dependence, attitudes towards smoking, quit attempts, etc), contextual factors, and physical and emotional statuses on their smoking habits. Most recent machine learning techniques will also be explored to combine heterogeneous data for classification of smoking events and prediction of craving.

ETHICS AND DISSEMINATION

The study was designed together by an interdisciplinary group of researchers, including psychologist, psychiatrist, engineer and user involvement coordinator. The protocol was reviewed and approved by the ethical review board of UZ Leuven on 18 April 2016, with an approval number S60078. The study will allow us to characterise the types of smokers and triggering events. These findings will be disseminated through peer-reviewed articles.

The chippers, the quitters, and the highly symptomatic: A 12-month longitudinal study of DSM-5 opioid- and cocaine-use problems in a community sample

BACKGROUND

Individual trajectories of drug use and drug-related problems are highly heterogeneous. There is no standard taxonomy of these trajectories, but one could be developed by defining natural categories based on changes in symptoms of substance-use disorders over time.

METHODS

Our study was conducted in a community sample in Baltimore, Maryland. At baseline, all participants were using opioids and/or cocaine, but none were in treatment. Drug use and symptomatology were assessed again at 12 months (N = 115).

RESULTS

We defined Quitters as participants who had not used for at least 30 days at follow-up (17%). For the remaining participants, we performed longitudinal cluster analysis on DSM symptom-counts, identifying three trajectory clusters: newly or persistently Symptomatic (40%) participants, Chippers (21.5%) with few symptoms, and Converted Chippers (21.5%) with improved symptom counts. Logistic regression showed that profiles of Quitters did not resemble Chippers, but instead resembled Symptomatic participants, having high probability of disorderly home neighborhood, nonwhite race, and negative mood. Quitters tended to have two protective factors: initiating opioid-agonist treatment during the study (r_effect = 0.25, CL95 0.02-0.48) and lack of polydrug use (r_effect = 0.25, CL95 0.004-0.49). Converted Chippers tended to be white, with orderly home neighborhoods and less negative mood (r_effects 0.24 to 0.31, CL95 0.01-0.54).

CONCLUSIONS

Changes in DSM symptomology provided a meaningful measure of individual trajectories. Quitters shared psychosocial characteristics with Symptomatic participants, but not with participants who continued to use with few symptoms. This suggests that Quitters abstained out of necessity, not because their problems were less severe.

Mobile Phone and Wearable Sensor-Based mHealth Approaches for Psychiatric Disorders and Symptoms: Systematic Review

BACKGROUND

Mobile Therapeutic Attention for Patients with Treatment-Resistant Schizophrenia (m-RESIST) is an EU Horizon 2020-funded project aimed at designing and validating an innovative therapeutic program for treatment-resistant schizophrenia. The program exploits information from mobile phones and wearable sensors for behavioral tracking to support intervention administration.

OBJECTIVE

To systematically review original studies on sensor-based mHealth apps aimed at uncovering associations between sensor data and symptoms of psychiatric disorders in order to support the m-RESIST approach to assess effectiveness of behavioral monitoring in therapy.

METHODS

A systematic review of the English-language literature, according to the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines, was performed through Scopus, PubMed, Web of Science, and the Cochrane Central Register of Controlled Trials databases. Studies published between September 1, 2009, and September 30, 2018, were selected. Boolean search operators with an iterative combination of search terms were applied.

RESULTS

Studies reporting quantitative information on data collected from mobile use and/or wearable sensors, and where that information was associated with clinical outcomes, were included. A total of 35 studies were identified; most of them investigated bipolar disorders, depression, depression symptoms, stress, and symptoms of stress, while only a few studies addressed persons with schizophrenia. The data from sensors were associated with symptoms of schizophrenia, bipolar disorders, and depression.

CONCLUSIONS

Although the data from sensors demonstrated an association with the symptoms of schizophrenia, bipolar disorders, and depression, their usability in clinical settings to support therapeutic intervention is not yet fully assessed and needs to be scrutinized more thoroughly.

Understanding stress reports in daily life: a coordinated analysis of factors associated with the frequency of reporting stress

Although stress is a common experience in everyday life, a clear understanding of how often an individual experiences and reports stress is lacking. Notably, there is little information regarding factors that may influence how frequently stress is reported, including which stress dimension is measured (i.e., stressors-did an event happen, subjective stress-how stressed do you feel, conditional stress-how stressful a stressor was) and the temporal features of that assessment (i.e., time of day, day of study, weekday vs. weekend day). The purpose of the present study was to conduct a coordinated analysis of five independent ecological momentary assessment studies utilizing varied stress reporting dimensions and temporal features. Results indicated that, within days, stress was reported at different frequencies depending on the stress dimension. Stressors were reported on 15-32% of momentary reports made within a day; across days, the frequency ranged from 42 to 76% of days. Depending on the cutoff, subjective stress was reported more frequently ranging about 8-56% of all moments within days, and 40-90% of days. Likewise, conditional stress ranged from just 3% of moments to 22%, and 11-69% of days. For the temporal features, stress was reported more frequently on weekdays (compared to weekend days) and on days earlier in the study (relative to days later in the study); time of day was inconsistently related to stress reports. In sum, stress report frequency depends in part on how stress is assessed. As such, researchers may wish to measure stress in multiple ways and, in the case of subjective and conditional stress with multiple operational definitions, to thoroughly characterize the frequency of stress reporting.

Just-in-Time but Not Too Much: Determining Treatment Timing in Mobile Health

There is a growing scientific interest in the use and development of just-in-time adaptive interventions in mobile health. These mobile interventions typically involve treatments, such as reminders, activity suggestions and motivational messages, delivered via notifications on a smartphone or a wearable to help users make healthy decisions in the moment. To be effective in influencing health, the combination of the right treatment and right delivery time is likely critical. A variety of prediction/detection algorithms have been developed with the goal of pinpointing the best delivery times. The best delivery times might be times of greatest risk and/or times at which the user might be most receptive to the treatment notifications. In addition, to avoid over burdening users, there is often a constraint on the number of treatments that should be provided per time interval (e.g., day or week). Yet there may be many more times at which the user is predicted or detected to be at risk and/or receptive. The goal then is to spread treatment uniformly across all of these times. In this paper, we introduce a method that spreads the treatment uniformly across the delivery times. This method can also be used to provide data for learning whether the treatments are effective at the delivery times. This work is motivated by our work on two mobile health studies, a smoking cessation study and a physical activity study.

Combining ecological momentary assessment with objective, ambulatory measures of behavior and physiology in substance-use research

Whereas substance-use researchers have long combined self-report with objective measures of behavior and physiology inside the laboratory, developments in mobile/wearable electronic technology are increasingly allowing for the collection of both subjective and objective information in participants' daily lives. For self-report, ecological momentary assessment (EMA), as implemented on contemporary smartphones or personal digital assistants, can provide researchers with near-real-time information on participants' behavior and mood in their natural environments. Data from portable/wearable electronic sensors measuring participants' internal and external environments can be combined with EMA (e.g., by timestamps recorded on questionnaires) to provide objective information useful in determining the momentary context of behavior and mood and/or validating participants' self-reports. Here, we review three objective ambulatory monitoring techniques that have been combined with EMA, with a focus on detecting drug use and/or measuring the behavioral or physiological correlates of mental events (i.e., emotions, cognitions): (1) collection and processing of biological samples in the field to measure drug use or participants' physiological activity (e.g., hypothalamic-pituitary-adrenal axis activity); (2) global positioning system (GPS) location information to link environmental characteristics (disorder/disadvantage, retail drug outlets) to drug use and affect; (3) ambulatory electronic physiological monitoring (e.g., electrocardiography) to detect drug use and mental events, as advances in machine learning algorithms make it possible to distinguish target changes from confounds (e.g., physical activity). Finally, we consider several other mobile/wearable technologies that hold promise to be combined with EMA, as well as potential challenges faced by researchers working with multiple mobile/wearable technologies simultaneously in the field.

The use of ambulatory assessment in smoking cessation

Ambulatory assessment of smoking behavior has greatly advanced our knowledge of the smoking cessation process. The current article first provides a brief overview of ecological momentary assessment for smoking cessation and highlights some of the primary advantages and scientific advancements made from this data collection method. Next, a discussion of how certain data collection tools (i.e., smoking topography and carbon monoxide detection) that have been traditionally used in lab-based settings are now being used to collect data in the real world. The second half of the paper focuses on the use of wearable wireless sensors to collect data during the smoking cessation process. Details regarding how these sensor-based technologies work, their application to newer tobacco products, and their potential to be used as intervention tools are discussed. Specific focus is placed on the opportunity to utilize novel intervention approaches, such as Just-In-Time Adaptive Interventions, to intervene upon smoking behavior. Finally, a discussion of some of the current challenges and limitations related to using sensor-based tools for smoking cessation are presented, along with suggestions for future research in this area.

Perceptions of Neighborhood Mediate the Relationship Between PTSD Symptoms and Coping in a Neighborhood-Matched Substance-Using Sample

OBJECTIVES

People with substance use problems living in neighborhoods with high levels of disorder are disproportionately likely to experience trauma and develop PTSD symptoms. We sought to evaluate the relationships between objective neighborhood disorder, perceptions of neighborhood, and the use of maladaptive coping behaviors among both non-substance-using and substance-using participants with and without PTSD symptoms.

METHODS

Participants (255 non-drug users [NDUs], 168 marijuana and/or alcohol users [MAUs], and 273 opioid and/or stimulant users) completed the Addiction Severity Index, PTSD Checklist-Civilian Version, The COPE Inventory, and the Perceived Neighborhood Scale. The Neighborhood Inventory for Environmental Typology (NIfETy) was used to objectively assess neighborhood disorder at participants' home addresses. Regression modeling was used to assess within-group predictors of PTSD and test for mediation in the relationships between PTSD, perceptions of neighborhood, and coping behaviors.

RESULTS

In NDUs, lower sense of community partially mediated the relationship between PTSD symptoms and using mental disengagement to cope. In MAUs, higher levels of perceived crime partially mediated the individual relationships between PTSD symptoms and using mental disengagement, focusing on and venting emotions, and using substances to cope. Opioid and/or stimulant users with PTSD symptoms reported using higher levels of mental disengagement, focusing on and venting emotions, and substances to cope and perceived a higher degree of crime; no mediation was inferred.

CONCLUSION

Perceptions of community and crime may be more predictive of PTSD symptoms than objectively measured neighborhood disorder. These perceptions partially mediate the relationship between maladaptive coping behaviors and PTSD symptoms.

mCerebrum: A Mobile Sensing Software Platform for Development and Validation of Digital Biomarkers and Interventions

The development and validation studies of new multisensory biomarkers and sensor-triggered interventions requires collecting raw sensor data with associated labels in the natural field environment. Unlike platforms for traditional mHealth apps, a software platform for such studies needs to not only support high-rate data ingestion, but also share raw high-rate sensor data with researchers, while supporting high-rate sense-analyze-act functionality in real-time. We present mCerebrum, a realization of such a platform, which supports high-rate data collections from multiple sensors with realtime assessment of data quality. A scalable storage architecture (with near optimal performance) ensures quick response despite rapidly growing data volume. Micro-batching and efficient sharing of data among multiple source and sink apps allows reuse of computations to enable real-time computation of multiple biomarkers without saturating the CPU or memory. Finally, it has a reconfigurable scheduler which manages all prompts to participants that is burden- and context-aware. With a modular design currently spanning 23+ apps, mCerebrum provides a comprehensive ecosystem of system services and utility apps. The design of mCerebrum has evolved during its concurrent use in scientific field studies at ten sites spanning 106,806 person days. Evaluations show that compared with other platforms, mCerebrum's architecture and design choices support 1.5 times higher data rates and 4.3 times higher storage throughput, while causing 8.4 times lower CPU usage.

CCS Concepts

• Human-centered computing → Ubiquitous and mobile computing; Ubiquitous and mobile computing systems and tools; • Computer systems organization → Embedded and cyber-physical systems.

ACM Reference format

Syed Monowar Hossain, Timothy Hnat, Nazir Saleheen, Nusrat Jahan Nasrin, Joseph Noor, Bo-Jhang Ho, Tyson Condie, Mani Srivastava, and Santosh Kumar. 2017. mCerebrum: A Mobile Sensing Software Platform for Development and Validation of Digital Biomarkers and Interventions. In Proceedings of SenSys '17, Delft, Netherlands, November 6-8, 2017, 14 pages.

Context and craving during stressful events in the daily lives of drug-dependent patients

RATIONALE

Knowing how stress manifests in the lives of people with substance-use disorders could help inform mobile "just in time" treatment.

OBJECTIVES

The purpose of this paper is to examine discrete episodes of stress, as distinct from the fluctuations in background stress assessed in most EMA studies.

METHODS

For up to 16 weeks, outpatients on opioid-agonist treatment carried smartphones on which they initiated an entry whenever they experienced a stressful event (SE) and when randomly prompted (RP) three times daily. Participants reported the severity of stress and craving and the context of the report (location, activities, companions). Decomposition of covariance was used to separate within-person from between-person effects; r _effect sizes below are within-person.

RESULTS

Participants (158 of 182; 87%) made 1787 stress-event entries. Craving for opioids increased with stress severity (r _effect = 0.50). Stress events tended to occur in social company (with acquaintances, 0.63, friends, 0.17, or on the phone, 0.41) rather than with family (spouse, -0.14; child, -0.18), and in places with more overall activity (bars, 0.32; outside, 0.28; walking, 0.28) and more likelihood of unexpected experiences (with strangers, 0.17). Being on the internet was slightly protective (-0.22). Our prior finding that being at the workplace protects against background stress in our participants was partly supported in these stressful-event data.

CONCLUSIONS

The contexts of specific stressful events differ from those we have seen in prior studies of ongoing background stress. However, both are associated with drug craving.

Feasibility of a Secure Wireless Sensing Smartwatch Application for the Self-Management of Pediatric Asthma

To address the need for asthma self-management in pediatrics, the authors present the feasibility of a mobile health (mHealth) platform built on their prior work in an asthmatic adult and child. Real-time asthma attack risk was assessed through physiological and environmental sensors. Data were sent to a cloud via a smartwatch application (app) using Health Insurance Portability and Accountability Act (HIPAA)-compliant cryptography and combined with online source data. A risk level (high, medium or low) was determined using a random forest classifier and then sent to the app to be visualized as animated dragon graphics for easy interpretation by children. The feasibility of the system was first tested on an adult with moderate asthma, then usability was examined on a child with mild asthma over several weeks. It was found during feasibility testing that the system is able to assess asthma risk with 80.10 ± 14.13% accuracy. During usability testing, it was able to continuously collect sensor data, and the child was able to wear, easily understand and enjoy the use of the system. If tested in more individuals, this system may lead to an effective self-management program that can reduce hospitalization in those who suffer from asthma.

The utility of geographically-explicit ecological momentary assessment: from description to intervention

Kirchner and Shiffman do the field a service by summarizing the path from ecological momentary assessment (EMA) to what they term geographically-explicit ecological momentary assessment (GEMA). I will comment on a few things that struck me in their review, then add a few points about moving from assessment to intervention.

iSurvive: An Interpretable, Event-time Prediction Model for mHealth

An important mobile health (mHealth) task is the use of multimodal data, such as sensor streams and self-report, to construct interpretable time-to-event predictions of, for example, lapse to alcohol or illicit drug use. Interpretability of the prediction model is important for acceptance and adoption by domain scientists, enabling model outputs and parameters to inform theory and guide intervention design. Temporal latent state models are therefore attractive, and so we adopt the continuous time hidden Markov model (CT-HMM) due to its ability to describe irregular arrival times of event data. Standard CT-HMMs, however, are not specialized for predicting the time to a future event, the key variable for mHealth interventions. Also, standard emission models lack a sufficiently rich structure to describe multimodal data and incorporate domain knowledge. We present iSurvive, an extension of classical survival analysis to a CT-HMM. We present a parameter learning method for GLM emissions and survival model fitting, and present promising results on both synthetic data and an mHealth drug use dataset.

Utilizing a Wristband Sensor to Measure the Stress Level for People with Dementia

Stress is a common problem that affects most people with dementia and their caregivers. Stress symptoms for people with dementia are often measured by answering a checklist of questions by the clinical staff who work closely with the person with the dementia. This process requires a lot of effort with continuous observation of the person with dementia over the long term. This article investigates the effectiveness of using a straightforward method, based on a single wristband sensor to classify events of “Stressed” and “Not stressed” for people with dementia. The presented system calculates the stress level as an integer value from zero to five, providing clinical information of behavioral patterns to the clinical staff. Thirty staff members participated in this experiment, together with six residents suffering from dementia, from two nursing homes. The residents were equipped with the wristband sensor during the day, and the staff were writing observation notes during the experiment to serve as ground truth. Experimental evaluation showed relationships between staff observations and sensor analysis, while stress level thresholds adjusted to each individual can serve different scenarios.

mCrave: Continuous Estimation of Craving During Smoking Cessation

Craving usually precedes a lapse for impulsive behaviors such as overeating, drinking, smoking, and drug use. Passive estimation of craving from sensor data in the natural environment can be used to assist users in coping with craving. In this paper, we take the first steps towards developing a computational model to estimate cigarette craving (during smoking abstinence) at the minute-level using mobile sensor data. We use 2,012 hours of sensor data and 1,812 craving self-reports from 61 participants in a smoking cessation study. To estimate craving, we first obtain a continuous measure of stress from sensor data. We find that during hours of day when craving is high, stress associated with self-reported high craving is greater than stress associated with low craving. We use this and other insights to develop feature functions, and encode them as pattern detectors in a Conditional Random Field (CRF) based model to infer craving probabilities.