What Affects the Completion of Ecological Momentary Assessments in Chronic Pain Research? An Individual Patient Data Meta-Analysis

Recruitment and retention of adolescents for an ecological momentary assessment measurement burst mental health study: The MHIM engagement strategy

INTRODUCTION

Recruitment and long-term retention of adolescent participants in longitudinal research are challenging and may be especially so in studies involving remote measurement and biosampling components. The ability to effectively recruit and retain participants can be supported by the use of specific evidence-based engagement strategies that are built in from the earliest stages.

METHODS

Informed by a review of the evidence on effective engagement strategies and consultations with adolescents (via two Young Person Advisory Groups [YPAGs]; ages 11-13 and 14-17), the current protocol describes the planned participant engagement strategy for the Mental Health in the Moment Study: a multimodal measurement burst study of adolescent mental health across ages 11-19.

RESULTS

The protocol incorporates engagement strategies in four key domains: consultations/co-design with the target population, incentives, relationship-building and burden/barrier reduction. In addition to describing general engagement strategies in longitudinal studies, we also discuss specific concerns regarding engagement in data collection methods such as biosampling and ecological momentary assessment where a paucity of evidence exists.

CONCLUSION

Engagement strategies for adolescent mental health studies should be based on existing evidence and consultations with adolescents. We present our approach in developing the planned engagement strategies and also discuss limitations and future directions in engaging adolescents in longitudinal research.

PATIENT OR PUBLIC CONTRIBUTION

The study design for this project places a strong emphasis on the active engagement of adolescents throughout its development. Specifically, the feedback and suggestions provided by the YPAGs have been instrumental in refining our strategies for maximising the recruitment and retention of participants.

The Effect of Everyday-Life Social Contact on Pain

Pain is a biopsychosocial phenomenon, resulting from the interplay between physiological and psychological processes and social factors. Given that humans constantly interact with others, the effect of social factors is particularly relevant. Documenting the significance of the social modulation of pain, an increasing number of studies have investigated the effect of social contact on subjective pain intensity and pain-related physiological changes. While evidence suggests that social contact can alleviate pain, contradictory findings indicate an increase in pain intensity and a deterioration of pain coping strategies. This evidence primarily stems from studies examining the effect of social contact on pain within highly controlled laboratory conditions. Moreover, pain assessments often rely on one-time subjective reports of average pain intensity across a predefined period. Ecological momentary assessments (EMAs) can circumvent these problems, as they can capture diverse aspects of behavior and experiences multiple times a day, in real time, with high resolution, and within naturalistic and ecologically valid settings. These multiple measures allow for the examination of fluctuations of pain symptoms throughout the day in relation to affective, cognitive, behavioral, and social factors. In this opinion paper, we review the current state and future relevance of EMA-based social pain research in daily life. Specifically, we examine whether everyday-life social support reduces or enhances pain. The first part of the paper provides a comprehensive overview of the use of EMA in pain research and summarizes the main findings. The review of the relatively limited number of existing EMA studies shows that the association between pain and social contact in everyday life depends on numerous factors, including pain syndromes, temporal dynamics, the nature of social interactions, and characteristics of the interaction partners. In line with laboratory research, there is evidence that everyday-life social contact can alleviate, but also intensify pain, depending on the type of social support. Everyday-life emotional support seems to reduce pain, while extensive solicitous support was found to have opposite effects. Moreover, positive short-term effects of social support can be overshadowed by other symptoms such as fatigue. Overall, gathering and integrating experiences from a patient's social environment can offer valuable insights. These insights can help interpret dynamics in pain intensity and accompanying symptoms such as depression or fatigue. We conclude that factors determining the reducing versus enhancing effects of social contact on pain need to be investigated more thoroughly. We advocate EMA as the assessment method of the future and highlight open questions that should be addressed in future EMA studies on pain and the potential of ecological momentary interventions for pain treatment.

Momentary Factors and Study Characteristics Associated With Participant Burden and Protocol Adherence: Ecological Momentary Assessment

BACKGROUND

Ecological momentary assessment (EMA) has become a popular mobile health study design to understand the lived experiences of dynamic environments. The numerous study design choices available to EMA researchers, however, may quickly increase participant burden and could affect overall adherence, which could limit the usability of the collected data.

OBJECTIVE

This study quantifies what study design, participant attributes, and momentary factors may affect self-reported burden and adherence.

METHODS

The EMA from the Phase 1 Family Matters Study (n=150 adult Black, Hmong, Latino or Latina, Native American, Somali, and White caregivers; n=1392 observation days) was examined to understand how participant self-reported survey burden was related to both design and momentary antecedents of adherence. The daily burden was measured by the question "Overall, how difficult was it for you to fill out the surveys today?" on a 5-item Likert scale (0=not at all and 4=extremely). Daily protocol adherence was defined as completing at least 2 signal-contingent surveys, 1 event-contingent survey, and 1 end-of-day survey each. Stress and mood were measured earlier in the day, sociodemographic and psychosocial characteristics were reported using a comprehensive cross-sectional survey, and EMA timestamps for weekends and weekdays were used to parameterize time-series models to evaluate prospective correlates of end-of-day study burden.

RESULTS

The burden was low at 1.2 (SD 1.14) indicating "a little" burden on average. Participants with elevated previous 30-day chronic stress levels (mean burden difference: 0.8; P=.04), 1 in 5 more immigrant households (P=.02), and the language primarily spoken in the home (P=.04; 3 in 20 more non-English-speaking households) were found to be population attributes of elevated moderate-high burden. Current and 1-day lagged nonadherence were correlated with elevated 0.39 and 0.36 burdens, respectively (P=.001), and the association decayed by the second day (β=0.08; P=.47). Unit increases in momentary antecedents, including daily depressed mood (P=.002) and across-day change in stress (P=.008), were positively associated with 0.15 and 0.07 higher end-of-day burdens after controlling for current-day adherence.

CONCLUSIONS

The 8-day EMA implementation appeared to capture momentary sources of stress and depressed mood without substantial burden to a racially or ethnically diverse and immigrant or refugee sample of parents. Attention to sociodemographic attributes (eg, EMA in the primary language of the caregiver) was important for minimizing participant burden and improving data quality. Momentary stress and depressed mood were strong determinants of participant-experienced EMA burden and may affect adherence to mobile health study protocols. There were no strong indicators of EMA design attributes that created a persistent burden for caregivers. EMA stands to be an important observational design to address dynamic public health challenges related to human-environment interactions when the design is carefully tailored to the study population and to study research objectives.

Comparisons of Self-Report With Objective Measurements Suggest Faster Responding but Little Change in Response Quality Over Time in Ecological Momentary Assessment Studies

Response times (RTs) to ecological momentary assessment (EMA) items often decrease after repeated EMA administration, but whether this is accompanied by lower response quality requires investigation. We examined the relationship between EMA item RTs and EMA response quality. In one data set, declining response quality was operationalized as decreasing correspondence over time between subjective and objective measures of blood glucose taken at the same time. In a second EMA study data set, declining response quality was operationalized as decreasing correspondence between subjective ratings of memory test performance and objective memory test scores. We assumed that measurement error in the objective measures did not increase across time, meaning that decreasing correspondence across days within a person could be attributed to lower response quality. RTs to EMA items decreased across study days, while no decrements in the mean response quality were observed. Decreasing EMA item RTs across study days did not appear problematic overall.

Compliance Trends in a 14-Week Ecological Momentary Assessment Study of Undergraduate Alcohol Drinkers

High compliance is a priority for successful ecological momentary assessment (EMA) research, but meta-analyses of between-study differences show that reasons for missed prompts remain unclear. We examined compliance data from a 14-week, 182-survey EMA study of undergraduate alcohol use to test differences over time and across survey types between participants with better and worse compliance rates, and to evaluate the impact of incentives on ongoing participation. Participants were N = 196 students (65.8% female; Mage = 20.6). Overall compliance was 76.5%, declining gradually from 88.9% to 70% over 14 weeks. Declines were faster in participants with lower overall compliance, but we found no demographic, personality, mental health, or substance use differences between participants with better versus worse compliance rates. Compliance varied by survey type, and unannounced bonus incentives did not impact compliance rates. Participants completed fewer surveys the week after winning a gift card. We offer recommendations for designing future EMA studies.

Accuracy in reporting incontinence in adults with spina bifida: A pilot study

BACKGROUND

The accuracy of self-reported urinary incontinence (UI) and fecal incontinence (FI) among adults with spina bifida (SB) is unknown. We aimed to quantify the accuracy of self-reported recall incontinence in the last 4 weeks using prospective diary data.

METHODS

Adults with SB were enrolled via patient advocacy groups in a larger 30-day smartphone-based ecological momentary assessment study of daily well-being and incontinence. We examined agreement between yes/no questions on exit questionnaires ("In the last 4 weeks, did you leak any urine and get your underwear, pads, pull-ups or disposable underwear wet?") and 30-day diaries. Collected data included a non-validated 4-item UI Negativity scale (UIN: 0-100, 0 = no impact). Inter-rater reliability was assessed with Cohen's kappa (>0.60 = substantial). FI was analyzed similarly. Sub-groups were too small for statistical analysis.

RESULTS

Median age of 88 adults was 35 years old (70% female, 53% shunted, 71% community ambulators). Among 81 adults reporting UI in the last month, 79 (98%) had diary-documented UI (UI agreement), 2 (2%) did not (Summary Table). Among 7 adults reporting no UI in the last month, 5 (71%) did not record UI in their diaries (agreement in no UI), 2 (29%) did. Both adults reporting no UI on exit questionnaires, despite contrary diary data, experienced single UI episodes (negativity: 0 and 6). In contrast, the UI agreement group recorded UI on median 18 days (median negativity: 22). Sensitivity of the recall UI question was 0.98 (specificity 0.71, kappa 0.69). Among 66 adults reporting FI in the last month, 65 (98%) had diary-documented FI (FI agreement), 1 (2%) did not. Among 22 adults reporting no FI in the last month, 17 (77%) did not record FI in their diaries (agreement in no FI), 5 (23%) did. Five adults reporting no FI on exit questionnaires, despite contrary diary data, experienced a median single episode (median negativity: 8). In contrast, the FI agreement group recorded FI on median 5 days (median negativity: 31). Sensitivity of the recall FI question was 0.93 (specificity 0.94, kappa 0.81). Results were unchanged when analyzing the first and last 28 days of data.

COMMENT

Sensitivity/specificity of single incontinence questions approach those reported for women with UI but without SB. Diaries may best serve SB adults with bothersome incontinence.

CONCLUSIONS

Self-reported incontinence accurately and reliably captures UI and FI among adults with SB. It may minimize less bothersome incontinence, supporting its use in screening for clinical practice and research.

Experience sampling methodology study of anxiety and depression in adolescents with epilepsy: The role of metacognitive beliefs and perseverative thinking

Emotional distress is common in young people with epilepsy (YPwE). According to the Self-Regulatory Executive Function (S-REF) model, maladaptive metacognitive beliefs and perseverative thinking are fundamental in the development and maintenance of emotional distress. As emotional distress and perseverative thinking can highly fluctuate over short intervals in YPwE, it is important to account for this variability when testing the utility of psychological models. Experience sampling methodology (ESM) was therefore used to explore the momentary relationship between metacognitive beliefs, perseverative thinking, and emotional distress in YPwE. Eighteen participants diagnosed with epilepsy (aged 12-17 years) completed the 10-day ESM period. Participants were prompted to complete the ESM assessment five times daily. The ESM assessment assessed participant's momentary levels of metacognitive beliefs, perseverative thinking (i.e., worry and rumination), and emotional distress (i.e., anxiety and depression). A series of multilevel regression analyses indicated that metacognitive beliefs were significantly positively associated with worry, rumination, anxiety and depression. After controlling for worry and rumination, respectively, metacognitive beliefs did not account for additional variance in anxiety or depression. Findings provide preliminary support for the utility of the S-REF model for emotional distress in YPwE. Metacognitive therapy, which is underpinned by the S-REF model, may be an appropriate intervention for emotional distress in YPwE. Future studies should assess the mediational relationship between metacognitive beliefs, perseverative thinking, and emotional distress using time-lagged models.

SOMAScience: A Novel Platform for Multidimensional, Longitudinal Pain Assessment

Chronic pain is one of the most significant health issues in the United States, affecting more than 20% of the population. Despite its contribution to the increasing health crisis, reliable predictors of disease development, progression, or treatment outcomes are lacking. Self-report remains the most effective way to assess pain, but measures are often acquired in sparse settings over short time windows, limiting their predictive ability. In this paper, we present a new mobile health platform called SOMAScience. SOMAScience serves as an easy-to-use research tool for scientists and clinicians, enabling the collection of large-scale pain datasets in single- and multicenter studies by facilitating the acquisition, transfer, and analysis of longitudinal, multidimensional, self-report pain data. Data acquisition for SOMAScience is done through a user-friendly smartphone app, SOMA, that uses experience sampling methodology to capture momentary and daily assessments of pain intensity, unpleasantness, interference, location, mood, activities, and predictions about the next day that provide personal insights into daily pain dynamics. The visualization of data and its trends over time is meant to empower individual users' self-management of their pain. This paper outlines the scientific, clinical, technological, and user considerations involved in the development of SOMAScience and how it can be used in clinical studies or for pain self-management purposes. Our goal is for SOMAScience to provide a much-needed platform for individual users to gain insight into the multidimensional features of their pain while lowering the barrier for researchers and clinicians to obtain the type of pain data that will ultimately lead to improved prevention, diagnosis, and treatment of chronic pain.

Respondent characteristics associated with adherence in a general population ecological momentary assessment study

OBJECTIVES

Ecological momentary assessment (EMA) has seen an explosion in popularity in recent years; however, an improved understanding of how to minimise (selective) non-adherence is needed.

METHODS

We examined a range of respondent characteristics predictors of adherence (defined as the number of EMA surveys completed) in the D2M EMA study. Participants were a sample of n = 255 individuals drawn from the longitudinal z-proso cohort who completed up to 4 EMA surveys per day for a period of 2 weeks.

RESULTS

In unadjusted analyses, lower moral shame, lower self-control, lower levels of self-injury, and higher levels of aggression, tobacco use, psychopathy, and delinquency were associated with lower adherence. In fully adjusted analyses with predictors selected using lasso, only alcohol use was related to adherence: beer and alcopops to higher adherence and spirits to lower adherence.

CONCLUSIONS

These findings provide potential insights into some of the psychological mechanisms that may underlie adherence in EMA. They also point to respondent characteristics for which additional or tailored efforts may be needed to promote adherence.

The feasibility of using ecological momentary assessment to understand urinary and fecal incontinence experiences in adults with spina bifida: A 30-day study

In this paper, we evaluate the feasibility of using ecological momentary assessment (EMA) to understand urinary (UI) and fecal (FI) incontinence in adults with spina bifida (SB). As part of a larger 30-day prospective study to understand the incontinence in adults with SB (N = 89), participants completed end-of-day EMA diaries assessing the frequency and context of UI and FI. We used these data to assess the method feasibility across six dimensions: (a) compliance, or data entry which is consistent with study protocol and substantially complete; (b) reactivity, or behavior change attributed to study participation; (c) participant acceptability, or convenience and ease of method beneficial to compliance; (d) data capture, or the volume of incontinence behaviors collected; (e) the accuracy of incontinence reports; and f) participant-provided feedback for future studies. Participants were highly compliant with diary entry protocol and schedule: submitting 95.7% (2576/2700) of the expected total daily entries. The average completion time was two minutes. Neither the total number of submissions nor the completion time varied by demographic characteristics or health history. A sufficient volume of incontinence and affective outcomes were captured, with small downtrends in reporting of UI and affect over time. Exit survey recall was highly correlated with diary reports. Participants found the methodology to be acceptable, reported their experiences honestly, enjoyed and felt comfortable participating in the study and would engage in similar study in the future. Accurate information about the daily context of UI and FI is a key factor in the success of intervention or education programs relying on this information. Our findings demonstrate that EMA is a feasible way to describe UI and FI in adults with SB.

Use of the experience sampling method in adolescents with Duchenne muscular dystrophy: a feasibility study

Experience sampling methods (ESM) using mobile health (mHealth) technology with a smartphone application are increasingly used in clinical practice and research. Still, recommendations are limited in young people, and adaptations may be necessary. Patients with Duchenne muscular dystrophy (DMD) are chronically treated with steroids from a young age. However, the impact of intermittent treatment schedules on fluctuations in somatic, cognitive and behavioural symptoms is poorly investigated. Existing studies are often cross-sectional and occur in controlled clinical settings, which do not provide sufficiently detailed insights into possible correlations. ESM might alleviate these problems. ESM innovates data collection with a smartphone application, which repeatedly assesses specific symptoms and contextual factors at random moments in daily life. We aimed to evaluate its feasibility in adolescents with DMD. In three (without/with/without steroids) 4-day periods of ESM, that were nested in 10/10 or 11/9 day on/off-medication periods, we evaluated its user-friendliness and compliance, and explored its ability to objectify fluctuations in somatic, cognitive and behavioural symptom severity and their relationship with contextual factors in seven DMD patients (age range 12-18 years) using intermittent corticosteroid treatment (dosage range 0.3-0.6 mg/kg/day). Patients reported that ESM was convenient and user-friendly. We were able to capture extensive intra-individual symptom fluctuations during intermittent corticosteroid treatment that were not revealed by routine clinical assessment. Implementing ESM to evaluate symptom fluctuation patterns in relation to treatment effects shows promise in adolescents with DMD. Optimization in further research is needed.

Acceptability of Personal Sensing Among People With Alcohol Use Disorder: Observational Study

BACKGROUND

Personal sensing may improve digital therapeutics for mental health care by facilitating early screening, symptom monitoring, risk prediction, and personalized adaptive interventions. However, further development and the use of personal sensing requires a better understanding of its acceptability to people targeted for these applications.

OBJECTIVE

We aimed to assess the acceptability of active and passive personal sensing methods in a sample of people with moderate to severe alcohol use disorder using both behavioral and self-report measures. This sample was recruited as part of a larger grant-funded project to develop a machine learning algorithm to predict lapses.

METHODS

Participants (N=154; n=77, 50% female; mean age 41, SD 11.9 years; n=134, 87% White and n=150, 97% non-Hispanic) in early recovery (1-8 weeks of abstinence) were recruited to participate in a 3-month longitudinal study. Participants were modestly compensated for engaging with active (eg, ecological momentary assessment [EMA], audio check-in, and sleep quality) and passive (eg, geolocation, cellular communication logs, and SMS text message content) sensing methods that were selected to tap into constructs from the Relapse Prevention model by Marlatt. We assessed 3 behavioral indicators of acceptability: participants' choices about their participation in the study at various stages in the procedure, their choice to opt in to provide data for each sensing method, and their adherence to a subset of the active methods (EMA and audio check-in). We also assessed 3 self-report measures of acceptability (interference, dislike, and willingness to use for 1 year) for each method.

RESULTS

Of the 192 eligible individuals screened, 191 consented to personal sensing. Most of these individuals (169/191, 88.5%) also returned 1 week later to formally enroll, and 154 participated through the first month follow-up visit. All participants in our analysis sample opted in to provide data for EMA, sleep quality, geolocation, and cellular communication logs. Out of 154 participants, 1 (0.6%) did not provide SMS text message content and 3 (1.9%) did not provide any audio check-ins. The average adherence rate for the 4 times daily EMA was .80. The adherence rate for the daily audio check-in was .54. Aggregate participant ratings indicated that all personal sensing methods were significantly more acceptable (all P<.001) compared with neutral across subjective measures of interference, dislike, and willingness to use for 1 year. Participants did not significantly differ in their dislike of active methods compared with passive methods (P=.23). However, participants reported a higher willingness to use passive (vs active) methods for 1 year (P=.04).

CONCLUSIONS

These results suggest that active and passive sensing methods are acceptable for people with alcohol use disorder over a longer period than has previously been assessed. Important individual differences were observed across people and methods, indicating opportunities for future improvement.

Acceptability, usability and feasibility of experienced sampling method in chronic secondary pain syndromes

Background

In chronic pain syndromes, symptoms can fluctuate and change over time. Standard questionnaires cannot register these fluctuations. Nonetheless, the experience sampling method (ESM) is developed to collect momentary measurements of everyday complaints, tracing fluctuations in symptoms and disabling factors over time. Although valuable information can be collected in this way, assessment may also be a burden. This study aimed to investigate the acceptability, usability, and feasibility of ESM in chronic secondary pain syndromes, in a single-center study in the Netherlands.

Methods

A prospective observational study with repeated measurements was conducted in patients with chronic secondary neuropathic and musculoskeletal pain syndromes, including small fiber neuropathy, spinal cord injury, and rheumatoid disorder.

Results

Thirty-four participants were included and filled in the ESM, of whom 19 were diagnosed with small fiber neuropathy, 11 with spinal cord injury, and 4 with a rheumatoid disorder. The mean age was 54.7 ± 13.9 years (range: 23-77) of whom 52.9% were female. In total, 19 participants filled in the general and user-friendliness evaluation about the acceptability and usability of the ESM. The general evaluation showed no influence of ESM on participants' social contacts (mean 1.47, SD 1.12), activities (mean 1.74, SD 1.44), and mood (mean 1.89, SD 1.59). The answers options of ESM were a good representation of the experiences of participants (mean 4.58, SD 1.77). Regarding feasibility, the overall response rate for answering the beep signals of ESM was 44.5% in total. The missing rate per person varied from 13% to 97% with a median of 54.1%.

Conclusion

The general evaluation and the user-friendliness revealed sufficient outcomes in favor of the ESM application. ESM seems a promising measurement tool to use in secondary chronic pain syndromes.

Day-to-day fluctuations of fatigue severity in individuals with knee osteoarthritis: an ecological momentary assessment approach

Objective

The variable course of fatigue adds to the disease burden of patients with OA yet it has been poorly understood. This study aimed to describe within-person fluctuations of fatigue severity and explore its associations with pain, positive affect, negative affect, sleep, and perceived exertion of physical activity.

Methods

Individuals with chronic knee pain or a clinical diagnosis of knee OA ≥40 years of age completed daily assessments about fatigue, pain, positive affect, negative affect, sleep, perceived exertion of physical activity (numeric rating scale 0-10), and overwhelming fatigue (yes/no) on a smartphone over 14 days. Within-person fluctuations of fatigue severity were described by the probability of acute changes (PACs) and s.d.s. Associations with pain, positive affect, negative affect, sleep, and perceived exertion of physical activity were explored using multilevel models.

Results

Forty-nine individuals were included (mean age 63.4 years; 82% female). PACs and s.d.s of within-person daily fatigue fluctuations ranged from 0.00 to 0.80 and 0.35 to 2.95, respectively. Within-person associations of fatigue severity were moderate for positive affect [β = -0.57 (95% CI -0.67, -0.47)], weak for pain [β = 0.41 (95% CI 0.29, 0.53)] and negative affect [β = 0.40 (95% CI 0.21, 0.58)], and negligible for sleep [β = -0.13 (95% CI -0.18, -0.08)] and perceived exertion of physical activity [β = 0.18 (95% CI 0.09, 0.26)].

Conclusion

Some individuals showed almost stable day-to-day levels of fatigue severity, whereas others experienced a substantial number of clinically relevant fluctuations. To reduce the burden of daily fatigue fluctuations, our results suggest that pain, positive and negative affect rather than sleep and perceived exertion of physical activity should be considered as potential targets.

Evaluating Declines in Compliance With Ecological Momentary Assessment in Longitudinal Health Behavior Research: Analyses From a Clinical Trial

BACKGROUND

Ecological momentary assessment (EMA) is increasingly used to evaluate behavioral health processes over extended time periods. The validity of EMA for providing representative, real-world data with high temporal precision is threatened to the extent that EMA compliance drops over time.

OBJECTIVE

This research builds on prior short-term studies by evaluating the time course of EMA compliance over 9 weeks and examines predictors of weekly compliance rates among cigarette-using adults.

METHODS

A total of 257 daily cigarette-using adults participating in a randomized controlled trial for smoking cessation completed daily smartphone EMA assessments, including 1 scheduled morning assessment and 4 random assessments per day. Weekly EMA compliance was calculated and multilevel modeling assessed the rate of change in compliance over the 9-week assessment period. Participant and study characteristics were examined as predictors of overall compliance and changes in compliance rates over time.

RESULTS

Compliance was higher for scheduled morning assessments (86%) than for random assessments (58%) at the beginning of the EMA period (P<.001). EMA compliance declined linearly across weeks, and the rate of decline was greater for morning assessments (2% per week) than for random assessments (1% per week; P<.001). Declines in compliance were stronger for younger participants (P<.001), participants who were employed full-time (P=.03), and participants who subsequently dropped out of the study (P<.001). Overall compliance was higher among White participants compared to Black or African American participants (P=.001).

CONCLUSIONS

This study suggests that EMA compliance declines linearly but modestly across lengthy EMA protocols. In general, these data support the validity of EMA for tracking health behavior and hypothesized treatment mechanisms over the course of several months. Future work should target improving compliance among subgroups of participants and investigate the extent to which rapid declines in EMA compliance might prove useful for triggering interventions to prevent study dropout.

TRIAL REGISTRATION

ClinicalTrials.gov NCT03262662; https://clinicaltrials.gov/ct2/show/NCT03262662.

Feasibility and Acceptability of Using Ecological Momentary Assessment to Evaluate Alcohol Use with American Indian Women

BACKGROUND

Ecological momentary assessments (EMA) are one way to collect timely and accurate alcohol use data, as they involve signaling participants via cell phones to report on daily behaviors in real-time and in a participant's natural environment. EMA has never been used with American Indian populations to evaluate alcohol consumption. The purpose of this project was to determine the feasibility and acceptability of EMA for American Indian women.

METHODS

Eligible participants were American Indian women between the ages of 18 and 44 who were not pregnant and had consumed more than one drink within the past month. All participants received a TracFone and weekly automated messages. Self-reported measures of daily quantity and frequency of alcohol consumption, alcohol type, and context were assessed once per week for four weeks. Baseline measurements also included the Drinking Motives Questionnaire-Revised (DMQ-R) and the Interpersonal Support Evaluation List (ISEL).

RESULTS

Fifteen participants were enrolled in the study. All but one participant completed all data collection time points, and drinking patterns were consistent across the study period. A total of 420 records were completed across 86 drinking days and 334 non-drinking days. Participants reported drinking an average of 5.7 days over the 30-day period and typically consumed 3.99 drinks per drinking occasion. Sixty-six percent of participants met gender-specific cut-points for heavy episodic drinking, with an average of 2.46 binge drinking occasions across the four week study period.

CONCLUSIONS

This proof-of-concept project showed that EMA was both feasible and acceptable for collecting alcohol data from American Indian women. Additional studies are necessary to fully implement EMA with American Indian women to better understand the drinking motives, contexts, patterns, and risk factors in this population.

Ecological Momentary Assessment: A Meta-Analysis on Designs, Samples, and Compliance Across Research Fields

Ecological Momentary Assessments (i.e., EMA, repeated assessments in daily life) are widespread in many fields of psychology and related disciplines. Yet, little knowledge exists on how differences in study designs and samples predict study compliance and dropout-two central parameters of data quality in (micro-)longitudinal research. The current meta-analysis included k = 477 articles (496 samples, total N = 677,536). For each article, we coded the design, sample characteristics, compliance, and dropout rate. The results showed that on average EMA studies scheduled six assessments per day, lasted for 7 days, and obtained a compliance of 79%. Studies with more assessments per day scheduled fewer assessment days, yet, the number of assessments did not predict compliance or dropout rates. Compliance was significantly higher in studies providing financial incentives. Otherwise, design or sample characteristics had little effects. We discuss the implications of the findings for planning, reporting, and reviewing EMA studies.

Feasibility and Acceptability of a Preoperative Multimodal Mobile Health Assessment in Spine Surgery Candidates

BACKGROUND

Rapid growth in smartphone use has expanded opportunities to use mobile health (mHealth) technology to collect real-time patient-reported and objective biometric data. These data may have important implication for personalized treatments of degenerative spine disease. However, no large-scale study has examined the feasibility and acceptability of these methods in spine surgery patients.

OBJECTIVE

To evaluate the feasibility and acceptability of a multimodal preoperative mHealth assessment in patients with degenerative spine disease.

METHODS

Adults undergoing elective spine surgery were provided with Fitbit trackers and sent preoperative ecological momentary assessments (EMAs) assessing pain, disability, mood, and catastrophizing 5 times daily for 3 weeks. Objective adherence rates and a subjective acceptability survey were used to evaluate feasibility of these methods.

RESULTS

The 77 included participants completed an average of 82 EMAs each, with an average completion rate of 86%. Younger age and chronic pulmonary disease were significantly associated with lower EMA adherence. Seventy-two (93%) participants completed Fitbit monitoring and wore the Fitbits for an average of 247 hours each. On average, participants wore the Fitbits for at least 12 hours per day for 15 days. Only worse mood scores were independently associated with lower Fitbit adherence. Most participants endorsed positive experiences with the study protocol, including 91% who said they would be willing to complete EMAs to improve their preoperative surgical guidance.

CONCLUSION

Spine fusion candidates successfully completed a preoperative multimodal mHealth assessment with high acceptability. The intensive longitudinal data collected may provide new insights that improve patient selection and treatment guidance.

Developing Early Markers of Cognitive Decline and Dementia Derived From Survey Response Behaviors: Protocol for Analyses of Preexisting Large-scale Longitudinal Data

BACKGROUND

Accumulating evidence shows that subtle alterations in daily functioning are among the earliest and strongest signals that predict cognitive decline and dementia. A survey is a small slice of everyday functioning; nevertheless, completing a survey is a complex and cognitively demanding task that requires attention, working memory, executive functioning, and short- and long-term memory. Examining older people's survey response behaviors, which focus on how respondents complete surveys irrespective of the content being sought by the questions, may represent a valuable but often neglected resource that can be leveraged to develop behavior-based early markers of cognitive decline and dementia that are cost-effective, unobtrusive, and scalable for use in large population samples.

OBJECTIVE

This paper describes the protocol of a multiyear research project funded by the US National Institute on Aging to develop early markers of cognitive decline and dementia derived from survey response behaviors at older ages.

METHODS

Two types of indices summarizing different aspects of older adults' survey response behaviors are created. Indices of subtle reporting mistakes are derived from questionnaire answer patterns in a number of population-based longitudinal aging studies. In parallel, para-data indices are generated from computer use behaviors recorded on the backend server of a large web-based panel study known as the Understanding America Study (UAS). In-depth examinations of the properties of the created questionnaire answer pattern and para-data indices will be conducted for the purpose of evaluating their concurrent validity, sensitivity to change, and predictive validity. We will synthesize the indices using individual participant data meta-analysis and conduct feature selection to identify the optimal combination of indices for predicting cognitive decline and dementia.

RESULTS

As of October 2022, we have identified 15 longitudinal ageing studies as eligible data sources for creating questionnaire answer pattern indices and obtained para-data from 15 UAS surveys that were fielded from mid-2014 to 2015. A total of 20 questionnaire answer pattern indices and 20 para-data indices have also been identified. We have conducted a preliminary investigation to test the utility of the questionnaire answer patterns and para-data indices for the prediction of cognitive decline and dementia. These early results are based on only a subset of indices but are suggestive of the findings that we anticipate will emerge from the planned analyses of multiple behavioral indices derived from many diverse studies.

CONCLUSIONS

Survey response behaviors are a relatively inexpensive data source, but they are seldom used directly for epidemiological research on cognitive impairment at older ages. This study is anticipated to develop an innovative yet unconventional approach that may complement existing approaches aimed at the early detection of cognitive decline and dementia.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/44627.

Prompt-level predictors of compliance in an ecological momentary assessment study of young adults' mental health

BACKGROUND

Ecological momentary assessment (EMA) has become a popular method of gathering information about participants as they go about their daily lives. However, participant non-compliance, especially non-random compliance, in EMA is a concern. Better knowledge of the moment-to-moment factors that predict prompt non-response can inform the design of strategies to mitigate it.

METHOD

We used data from a general population young adult (n = 260) EMA study, 'decades-to-minutes' (D2M) and fitted dynamic structural equation models (DSEMs) to explore a range of candidate momentary predictors of missing the next prompt.

RESULTS

We found that higher levels of stress, overall negative affect, and the specific negative affective state of 'upset' at a given prompt predicted a greater likelihood of missing the next prompt. However, no other specific affective states, alcohol use, experiencing social provocations nor aggressive behaviour predicted missing the next prompt.

LIMITATIONS

The primary limitation of the present study was a lack of information on predictors concurrent with missed prompts.

CONCLUSIONS

Findings point to the potential value of gathering information on momentary negative affect (especially feeling upset) and stress to help inform strategies that intervene to prevent application disengagement at optimal moments and to feed into strategies to mitigate bias due to non-random non-response in EMA studies.

Data Completeness and Concordance in the FeverApp Registry: Comparative Study

BACKGROUND

The FeverApp registry uses ecological momentary assessment (EMA) to collect parental data on pediatric fever for scientific research. The mobile app FeverApp educates parents on safe fever management and serves as a fever diary.

OBJECTIVE

The focus of this study was to evaluate the completeness and concordance of the EMA-based FeverApp registry with regard to its data quality from a multilevel perspective.

METHODS

Structured descriptions of fever episodes by health care professionals from an office were used as reference. The number of children, their sociodemographic data, and agreement of fever episodes, with maximum temperature, intake of antipyretics and antibiotics, and physician visits, were compared with the entries in the corresponding physician's reference records. The data quality indicators for completeness, meaning the extent to which the necessary data for the registry has actually been submitted, and concordance, which is the correspondence of the value of a data element with a reference source, were chosen to analyze whether EMA may be a suitable method for this kind of registry.

RESULTS

In both data sources, 1012 children were available for comparison over 16 months. The completeness of gender (1012/1012, 100%) and date of birth (1004/1012, 99.2%) information was high, and the mismatches were 0.69% (7/1012) and 1.19% (12/1012), respectively, between the sources. Of these 1012 children, 668 (66%) registered fever episodes in FeverApp. They relate to 534 families with 953 fever episodes in the reference records and 1452 episodes in the FeverApp registry. Of the 534 families, 183 (34.3%) refrained from visiting the office during fever episodes but nevertheless documented them in FeverApp. Largest part (766/1452, 52.75%) episodes were recorded exclusively in the FeverApp registry by 371 (371/534, 69.5%) families. The remaining 686 (47.2%) episodes of 391 (58.5%) children from 351 (65.7%) families were comparable with the reference data source in terms of physician visits, medication, and temperature. The completeness ranged, depending on the kind of variable, from 11.5% to 65% in the registry and from 7.6% to 42.6% in the office. The 953 fever episodes reported by the reference office consisted of 681 (71.5%) acute and 272 (28.5%) past episodes. In FeverApp, most past (262/272, 96.3%) but less acute (424/681, 62.3%) episodes have been entered. The concordance rates were varied: 90.2% for antibiotic use, 66.6% for antipyretic use, 61.7% for physician visits, and 16% for the highest temperature during the fever episode.

CONCLUSIONS

Both sources delivered only partial data, and the rates of completeness and concordance depended on the kind of variable. However, the FeverApp registry showed higher documentation and precision rates than professional records for all considered variables. Therefore, EMA may play a unique supplement for research in ambulatory care. FeverApp could support pediatric offices, especially during the pandemic.

A Systematic Study into the Factors that Affect the Predictive Accuracy of Multilevel VAR(1) Models

The use of multilevel VAR(1) models to unravel within-individual process dynamics is gaining momentum in psychological research. These models accommodate the structure of intensive longitudinal datasets in which repeated measurements are nested within individuals. They estimate within-individual auto- and cross-regressive relationships while incorporating and using information about the distributions of these effects across individuals. An important quality feature of the obtained estimates pertains to how well they generalize to unseen data. Bulteel and colleagues (Psychol Methods 23(4):740-756, 2018a) showed that this feature can be assessed through a cross-validation approach, yielding a predictive accuracy measure. In this article, we follow up on their results, by performing three simulation studies that allow to systematically study five factors that likely affect the predictive accuracy of multilevel VAR(1) models: (i) the number of measurement occasions per person, (ii) the number of persons, (iii) the number of variables, (iv) the contemporaneous collinearity between the variables, and (v) the distributional shape of the individual differences in the VAR(1) parameters (i.e., normal versus multimodal distributions). Simulation results show that pooling information across individuals and using multilevel techniques prevent overfitting. Also, we show that when variables are expected to show strong contemporaneous correlations, performing multilevel VAR(1) in a reduced variable space can be useful. Furthermore, results reveal that multilevel VAR(1) models with random effects have a better predictive performance than person-specific VAR(1) models when the sample includes groups of individuals that share similar dynamics.

Using Smartphone Sensor Paradata and Personalized Machine Learning Models to Infer Participants' Well-being: Ecological Momentary Assessment

Background

Sensors embedded in smartphones allow for the passive momentary quantification of people’s states in the context of their daily lives in real time. Such data could be useful for alleviating the burden of ecological momentary assessments and increasing utility in clinical assessments. Despite existing research on using passive sensor data to assess participants’ moment-to-moment states and activity levels, only limited research has investigated temporally linking sensor assessment and self-reported assessment to further integrate the 2 methodologies.

Objective

We investigated whether sparse movement-related sensor data can be used to train machine learning models that are able to infer states of individuals’ work-related rumination, fatigue, mood, arousal, life engagement, and sleep quality. Sensor data were only collected while the participants filled out the questionnaires on their smartphones.

Methods

We trained personalized machine learning models on data from employees (N=158) who participated in a 3-week ecological momentary assessment study.

Results

The results suggested that passive smartphone sensor data paired with personalized machine learning models can be used to infer individuals’ self-reported states at later measurement occasions. The mean R² was approximately 0.31 (SD 0.29), and more than half of the participants (119/158, 75.3%) had an R² of ≥0.18. Accuracy was only slightly attenuated compared with earlier studies and ranged from 38.41% to 51.38%.

Conclusions

Personalized machine learning models and temporally linked passive sensing data have the capability to infer a sizable proportion of variance in individuals’ daily self-reported states. Further research is needed to investigate factors that affect the accuracy and reliability of the inference.

Pain Expectancy and Positive Affect Mediate the day-to-day Association Between Objectively Measured Sleep and Pain Severity Among Women With Temporomandibular Disorder

The majority of individuals with temporomandibular disorders (TMD) experience sleep disturbance, which can maintain and exacerbate chronic pain. However, the factors underlying the sleep-pain link have not been fully elucidated, especially beyond the laboratory. Sleep deprivation can induce threat interpretation bias, as well as impairment in positive affective functioning. Using both actigraphy and daily diaries, we examined whether morning pain expectancy and positive affect mediate the association between previous night's sleep disturbance and next-day overall pain severity. Total sleep time (TST) was selected as the primary measure of sleep. The sample included 144 women (mean age = 36 [SD = 11.1]) with TMD who displayed at least subclinical insomnia. Sleep was assessed for 14 days using actigraphy which was validated by concurrent sleep diaries. Daily diary assessments of pain-related experiences and affective states were conducted twice per day (ie, once upon participants' waking and the other prior to going to sleep) for the same 14-day period. Multilevel structural equation modeling revealed that both morning pain expectancy (95% CI: -.0004, -.00003) and positive affect (95% CI: -.0005, -.000001) mediated the association between previous night's TST and next-day's overall pain severity, such that shorter previous night TST was associated with higher next-morning pain expectancy and lower positive affect, which in turn were associated with a greater level of next-day's overall pain severity while controlling for morning pain severity. Reducing exaggerated daily pain expectancy and up-regulating positive affect may be important intervention targets for disengaging the sleep-pain link among individuals with co-occurring TMD and sleep disturbance. PERSPECTIVE: The daily link between previous night sleep duration and next day pain severity is mediated by morning pain expectancy and positive affect among women with temporomandibular disorder and sleep disturbance. Reducing pain expectancy and increasing positive affect may serve an important role in improving self-management of chronic pain.

A Novel Experience Sampling Method Tool Integrating Momentary Assessments of Cognitive Biases: Two Compliance, Usability, and Measurement Reactivity Studies

BACKGROUND

Experience sampling methods (ESMs) are increasingly being used to study ecological emotion dynamics in daily functioning through repeated assessments taken over several days. However, most of these ESM approaches are only based on self-report assessments, and therefore, studies on the ecological trajectories of their underlying mechanisms are scarce (ie, cognitive biases) and require evaluation through experimental tasks. We developed a novel ESM tool that integrates self-report measures of emotion and emotion regulation with a previously validated app-based cognitive task that allows for the assessment of underlying mechanisms during daily functioning.

OBJECTIVE

The objective of the study is to test this new tool and study its usability and the possible factors related to compliance with it in terms of latency and missing responses. Among the compliance predictors, we considered psychological and time-related variables, as well as usability, measurement reactivity, and participants' satisfaction with the tool.

METHODS

We conducted 2 extensive ESM studies-study 1 (N=84; a total of 3 assessments per day for 5 days) and study 2 (N=135; a total of 3 assessments per day for 10 days).

RESULTS

In both studies, participants found the tool highly usable (average usability score >81). By using mixed regression models, we found both common and specific results for the compliance predictors. In both study 1 and study 2, latency was significantly predicted by the day (P<.001 and P=.003, respectively). Participants showed slower responses to the notification as the days of the study progressed. In study 2 but not in study 1, latency was further predicted by individual differences in overload with the use of the app, and missing responses were accounted for by individual differences in stress reactivity to notifications (P=.04). Thus, by using a more extensive design, participants who experienced higher overload during the study were characterized by slower responses to notifications (P=.01), whereas those who experienced higher stress reactivity to the notification system were characterized by higher missing responses.

CONCLUSIONS

The new tool had high levels of usability. Furthermore, the study of compliance is of enormous importance when implementing novel ESM methods, including app-based cognitive tasks. The main predictors of latency and missing responses found across studies, specifically when using extensive ESM protocols (study 2), are methodology-related variables. Future research that integrates cognitive tasks in ESM designs should take these results into consideration by performing accurate estimations of participants' response rates to facilitate the optimal quality of novel eHealth approaches, as in this study.

Intensive Longitudinal Data Collection Using Microinteraction Ecological Momentary Assessment: Pilot and Preliminary Results

Background

Ecological momentary assessment (EMA) uses mobile technology to enable in situ self-report data collection on behaviors and states. In a typical EMA study, participants are prompted several times a day to answer sets of multiple-choice questions. Although the repeated nature of EMA reduces recall bias, it may induce participation burden. There is a need to explore complementary approaches to collecting in situ self-report data that are less burdensome yet provide comprehensive information on an individual’s behaviors and states. A new approach, microinteraction EMA (μEMA), restricts EMA items to single, cognitively simple questions answered on a smartwatch with single-tap assessments using a quick, glanceable microinteraction. However, the viability of using μEMA to capture behaviors and states in a large-scale longitudinal study has not yet been demonstrated.

Objective

This paper describes the μEMA protocol currently used in the Temporal Influences on Movement & Exercise (TIME) Study conducted with young adults, the interface of the μEMA app used to gather self-report responses on a smartwatch, qualitative feedback from participants after a pilot study of the μEMA app, changes made to the main TIME Study μEMA protocol and app based on the pilot feedback, and preliminary μEMA results from a subset of active participants in the TIME Study.

Methods

The TIME Study involves data collection on behaviors and states from 246 individuals; measurements include passive sensing from a smartwatch and smartphone and intensive smartphone-based hourly EMA, with 4-day EMA bursts every 2 weeks. Every day, participants also answer a nightly EMA survey. On non–EMA burst days, participants answer μEMA questions on the smartwatch, assessing momentary states such as physical activity, sedentary behavior, and affect. At the end of the study, participants describe their experience with EMA and μEMA in a semistructured interview. A pilot study was used to test and refine the μEMA protocol before the main study.

Results

Changes made to the μEMA study protocol based on pilot feedback included adjusting the single-question selection method and smartwatch vibrotactile prompting. We also added sensor-triggered questions for physical activity and sedentary behavior. As of June 2021, a total of 81 participants had completed at least 6 months of data collection in the main study. For 662,397 μEMA questions delivered, the compliance rate was 67.6% (SD 24.4%) and the completion rate was 79% (SD 22.2%).

Conclusions

The TIME Study provides opportunities to explore a novel approach for collecting temporally dense intensive longitudinal self-report data in a sustainable manner. Data suggest that μEMA may be valuable for understanding behaviors and states at the individual level, thus possibly supporting future longitudinal interventions that require within-day, temporally dense self-report data as people go about their lives.

Feasibility, Acceptability, and Design of a Mobile Ecological Momentary Assessment for High-Risk Men Who Have Sex With Men in Hanoi, Vietnam: Qualitative Study

Background

Men who have sex with men (MSM) are at a disproportionate risk for HIV infection and common mental disorders worldwide. In the context of HIV, common mental disorders are important and are frequent drivers of suboptimal prevention and treatment outcomes. Mobile ecological momentary assessments (EMAs), or the repeated sampling of people’s behaviors and psychological states in their daily lives using mobile phones, can clarify the triggers and HIV-related sequelae of depressive-anxious symptoms and contribute toward the design of ecological momentary interventions (EMIs) that cater to the contextually varying needs of individuals to optimize prevention and treatment outcomes.

Objective

This study aims to characterize the feasibility and acceptability of mobile EMA among high-risk MSM in Hanoi, Vietnam. It aims to evaluate the perceived relevance, usability, and concerns of this group with regard to the content and delivery of mobile EMA and the potential of leveraging such platforms in the future to deliver EMIs.

Methods

Between January and April 2018, a total of 46 participants were recruited. The participants completed 6 to 8 mobile EMA surveys daily for 7 days. Surveys occurred once upon waking, 4 to 6 times throughout the day, and once before sleeping. All surveys queried participants’ perceived safety, social interactions, psychological state, and mental health symptoms. The morning survey further queried on sleep and medication use within the past 24 hours, whereas the night survey queried on sexual activity and substance use and allowed participants to share an audio recording of a stressful experience they had that day. At the end of the week, participants were interviewed about their experiences with using the app.

Results

Participants completed an average of 21.7 (SD 12.7) prompts over the 7-day period. Excluding nonresponders, the average compliance rate was 61.8% (SD 26.6%). A thematic analysis of qualitative interviews suggested an overall positive reception of the app and 5 recurring themes, which were centered on the relevance of psychological and behavioral items to daily experiences (eg, mental health symptoms and audio recording), benefits of using the app (eg, increased self-understanding), worries and concerns (eg, privacy), usability (eg, confusion about the interface), and recommendations for future design (eg, integrating more open-ended questions).

Conclusions

Mobile EMA is feasible and acceptable among young MSM in Vietnam; however, more research is needed to adapt EMA protocols to this context and enhance compliance. Most participants eagerly provided information about their mental health status and daily activities. As several participants looked toward the app for further mental health and psychosocial support, EMIs have the potential to reduce HIV and mental health comorbidity among MSM.

Study protocol for a randomised, double-blinded, placebo-controlled phase III trial examining the add-on efficacy, cost-utility and neurobiological effects of low-dose naltrexone (LDN) in patients with fibromyalgia (INNOVA study)

INTRODUCTION

There is evidence that low-dose naltrexone (LDN; <5.0 mg/day) reduces pain and improves the quality of life of people with fibromyalgia syndrome (FMS). However, no randomised controlled trials with long-term follow-ups have been carried out. The INNOVA study will evaluate the add-on efficacy, safety, cost-utility and neurobiological effects of LDN for reducing pain in patients with FMS, with a 1-year follow-up.

METHODS AND ANALYSIS

A single-site, prospective, randomised, double-blinded, placebo-controlled, parallel design phase III trial will be performed. Eligibility criteria include being adult, having a diagnosis of FMS and experiencing pain of 4 or higher on a 10-point numerical rating scale. Participants will be randomised to a LDN intervention group (4.5 mg/day) or to a placebo control group. Clinical assessments will be performed at baseline (T0), 3 months (T1), 6 months (T2) and 12 months (T3). The primary endpoint will be pain intensity. A sample size of 60 patients per study arm (120 in total), as calculated prior to recruitment for sufficient power, will be monitored between January 2022 and August 2024. Assessment will also include daily ecological momentary evaluations of FMS-related symptoms (eg, pain intensity, fatigue and sleep disturbance), and side effects via ecological momentary assessment through the Pain Monitor app during the first 3 months. Costs and quality-adjusted life years will be also calculated. Half of the participants in each arm will be scanned with MRI at T0 and T1 for changes in brain metabolites related to neuroinflammation and central sensitisation. Inflammatory biomarkers in serum will also be measured.

ETHICS AND DISSEMINATION

This study has been approved by the Ethics Committee of the Fundació Sant Joan de Déu. The results will be actively disseminated through peer-reviewed journals, conference presentations, social media and community engagement activities.

TRIAL REGISTRATION NUMBER

NCT04739995.

Patient-Reported Outcome Measure for Real-time Symptom Assessment in Women With Endometriosis: Focus Group Study

BACKGROUND

Symptoms related to endometriosis have a significant impact on the quality of life, and symptoms often recur. The experience sampling method (ESM), a digital questioning method characterized by randomly repeated momentary assessments, has several advantages over traditionally used measurements, including the ability to assess the temporal relationship between variables such as physical, mental, and social factors.

OBJECTIVE

The aim of this study is to develop an ESM tool for patients with endometriosis to accurately measure symptoms and their course over time, allowing for personalized treatment and adequate monitoring of treatment efficacy in individual patients.

METHODS

On the basis of international guidelines, items from validated questionnaires were selected through a literature review and during focus groups and multidisciplinary expert meetings. Data analysis was conducted using ATLAS.ti (ATLAS.ti Scientific Software Development GmbH). The feasibility and usability of the newly developed momentary assessment tool were tested for 28 consecutive days in 5 patients with endometriosis-related pain symptoms.

RESULTS

Momentary assessment items contained questions concerning endometriosis symptoms, general somatic symptoms, psychological symptoms, contextual information, and the use of food and medication. A morning questionnaire on sleep and sexuality was included. In a pilot study, the patients considered the tool easy to use but time consuming. The average compliance rate of momentary assessments was 37.8% (106/280), with the highest completion rate during the first week (39/70, 56%). Therefore, it is advisable to use the ESM for a maximum of 7 days.

CONCLUSIONS

A new digital tool for endometriosis symptom assessment was developed using the ESM, which may help overcome the limitations of current retrospective questionnaires. After validation and testing, future studies will be planned to evaluate the use of this tool in a clinical setting in order to propose a personalized treatment plan for women with endometriosis.

Feasibility and acceptability of using smartphone-based EMA to assess patterns of prescription opioid and medical cannabis use among individuals with chronic pain

BACKGROUND

Intensive longitudinal studies are needed to examine the co-use of prescription opioid medication and medical cannabis and their effects on chronic pain. The current study sought to investigate the feasibility and participant compliance with a smartphone-based Ecological Momentary Assessment (EMA) data collection protocol among individuals who use multiple substances and suffer from chronic pain.

METHODS

A total of 46 participants (mean age = 44.8 years; 78% female; 85% Non-Hispanic White) were recruited online and completed a 30-day EMA phase where they responded to prompted surveys (four random past-hour surveys and one daily diary per day) about opioid medication use, medical cannabis use, and pain symptoms. Qualitative follow-up interviews were conducted with a subset of 10 participants. Linear and logistic regression models were used to examine baseline participant characteristics in relation to EMA compliance. Qualitative indicators of participant study experience were extracted from interviews.

RESULTS

Participants responded to an average of 70% of past-hour surveys and 92% of daily diaries. Female participants were more likely to complete all daily diaries and at least one past-hour survey per day on all 30 days, respectively (OR = 5.60, 95% CI: 1.02-30.77, p < .05; OR = 7.08, 95% CI: 1.28-39.16, p < .05). Female participants were also more likely to complete at least 75% of their prompted past-hour surveys (OR = 4.67, 95% CI: 1.00-21.69, p < .05). Interview participants reported a positive study experience overall, although some mentioned problems related to smartphone notifications, redundant questions, or being prompted when they were not feeling well. Participants also mentioned problems with reporting the amount of medical cannabis used (e.g., milliliters of vaping liquid).

CONCLUSIONS

Study results demonstrate both feasibility and acceptability of using EMA methodology to examine use patterns of medical cannabis and prescription opioid medication among individuals with chronic pain.

Improved User Engagement and Assessment of Treatment Effectiveness in Patients Utilizing a Novel Digital Mobile Health Application During Spinal Cord Stimulation Screening Trials (Preprint)

Background

Patient outcomes and experience during a Spinal Cord Stimulation (SCS) screening trial can have a significant effect on whether to proceed with long-term, permanent implantation of an SCS device for the treatment of chronic pain. Enhancing the ability to track and assess patients during this initial trial evaluation offers the potential for improved understanding regarding the suitability of permanent device implantation as well as identification of the SCS-based neurostimulative modalities and parameters that may provide substantial analgesia in a patient-specific manner.

Objective

In this report, we aimed to describe a preliminary, real-world assessment of a new, real time tracking, smart, device-based digital app used by patients with chronic pain undergoing trial screening for SCS therapy.

Methods

This is a real-world, retrospective evaluation of 13,331 patients diagnosed with chronic pain who used the new “mySCS” mobile app during an SCS screening trial. The app design is health insurance portability and accountability act (HIPAA)-compliant and compatible with most commercially available smartphones (eg, Apple, iPhone, and Android). The app enables tracking of user-inputted health-related responses (ie, pain relief, activity level, and sleep quality) in addition to personal trial goals and a summary of overall experience during the SCS trial. A deidentified, aggregate analysis of user engagement, user-submitted responses, and overall trial success was conducted.

Results

When provided the opportunity, the percentage of users who engaged with the tracking app for ≥50% of the time during their trial was found to be 64.43% (n=8589). Among the 13,331 patients who used the app, 58.24% (n=7764) entered a trial goal. Most patients underwent SCS screening with a trial duration of at least 7 days (n=7739, 58.05%). Of those patients who undertook a 7-day SCS trial, 62.30% (n=3456) engaged the app for 4 days or more. In addition, among all who submitted descriptive responses using the app, health-related improvements were reported by 77.84% (n=10,377) of patients who reached day 3 of the screening phase assessment and by 83.04% (n=11,070) of those who reached trial completion. A trial success rate of 91% was determined for those who used the app (versus 85% success rate for nonusers).

Conclusions

Data from this initial, real-world examination of a mobile, digital-health–based tracking app (“mySCS”), as used during the SCS screening phase, demonstrate that substantial patient engagement can be achieved while also providing for the acquisition of more real time patient-outcome measures that may help facilitate improved SCS trial success.

A randomized community trial to advance digital epidemiological and mHealth citizen scientist compliance: A smart platform study

Background

This study aims to understand how participants’ compliance and response rates to both traditional validated surveys and ecological momentary assessments (EMAs) vary across 4 cohorts who participated in the same mHealth study and received the same surveys and EMAs on their smartphones, however with cohort-specific time-triggers that differed across the 4 cohorts.

Methods

As part of the Smart Platform, adult citizen scientists residing in Regina and Saskatoon, Canada, were randomly assigned to 4 cohorts in 2018. Citizen Scientists provided a complex series of subjective and objective data during 8 consecutive days using a custom-built smartphone application. All citizen scientists responded to both validated surveys and EMAs that captured physical activity. However, using Smart Platform, we varied the burden of responding to validated surveys and EMAs across cohorts by using different time-triggered push notifications. Participants in Cohort 1 (n = 10) received the full baseline 209-item validated survey on day 1 of the study; whereas participants in cohorts 2 (n = 26), 3 (n = 10), and 4 (n = 25) received the same survey in varied multiple sections over a period of 4 days. We used weighted One-way Analysis of Variance (ANOVA) tests and weighted, linear regression models to assess for differences in compliance rate across the cohort groups controlling for age, gender, and household income.

Results

Compliance to EMAs that captured prospective physical activity varied across cohorts 1 to 4: 50.0% (95% Confidence Interval [C.I.] = 31.4, 68.6), 63.0% (95% C.I. = 50.7, 75.2), 37.5% (95% C.I. = 18.9, 56.1), and 61.2% (95% C.I. = 47.4, 75.0), respectively. The highest completion rate of physical activity validated surveys was observed in Cohort 4 (mean = 97.9%, 95% C.I. = 95.5, 100.0). This was also true after controlling for age, gender, and household income. The regression analyses showed that citizen scientists in Cohorts 2, 3, and 4 had significantly higher compliance with completing the physical activity validated surveys relative to citizen scientists in cohort group 1 who completed the full survey on the first day.

Conclusions & significances

The findings show that maximizing the compliance rates of research participants for digital epidemiological and mHealth studies requires a balance between rigour of data collection, minimization of survey burden, and adjustment of time- and user-triggered notifications based on citizen or patient input.

The effects of assessment intensity on participant burden, compliance, within-person variance, and within-person relationships in ambulatory assessment

Considering the very large number of studies that have applied ambulatory assessment (AA) in the last decade across diverse fields of research, knowledge about the effects that these design choices have on participants’ perceived burden, data quantity (i.e., compliance with the AA protocol), and data quality (e.g., within-person relationships between time-varying variables) is surprisingly restricted. The aim of the current research was to experimentally manipulate aspects of an AA study’s assessment intensity—sampling frequency (Study 1) and questionnaire length (Study 2)—and to investigate their impact on perceived burden, compliance, within-person variability, and within-person relationships between time-varying variables. In Study 1, students (n = 313) received either 3 or 9 questionnaires per day for the first 7 days of the study. In Study 2, students (n = 282) received either a 33- or 82-item questionnaire three times a day for 14 days. Within-person variability and within-person relationships were investigated with respect to momentary pleasant-unpleasant mood and state extraversion. The results of Study 1 showed that a higher sampling frequency increased perceived burden but did not affect the other aspects we investigated. In Study 2, longer questionnaire length did not affect perceived burden or compliance but yielded a smaller degree of within-person variability in momentary mood (but not in state extraversion) and a smaller within-person relationship between state extraversion and mood. Differences between Studies 1 and 2 with respect to the type of manipulation of assessment intensity are discussed.

mHealth for the Monitoring of Brace Compliance and Wellbeing in Adolescents with Idiopathic Scoliosis: Study Protocol for a Feasibility Study

Attempts to optimize monitoring of brace adherence prescribed to adolescents with idiopathic scoliosis (IS) have generally relied on sensors. Sensors, however, are intrusive and do not allow the assessment of psychological and physical consequences of brace use that might underlie poor adherence. Mobile applications have emerged as alternatives to monitor brace compliance. However, the feasibility and utility of these app-based systems to assess key psychological and physical domains associated with non-adherence remain unexplored. This feasibility study aims to test the usability, acceptability, and clinical utility of an app-based system that monitors brace use and related psychological and physical factors. Forty adolescents with IS daily respond to the app for 90 days. The patient responses may generate clinical alarms (e.g., brace non-adherence, discomfort, or distress) that will be sent daily to the medical team. Primary outcomes will be app usability, acceptability, and response rates. Secondary outcomes will include brace adherence, the number of side effects reported, number and type of clinical alarms, stress, quality of life, perceived health status, and mood. If accepted by patients and clinicians, apps may allow rapid detection and response to undesired events in adolescents undergoing brace treatment.

Mobile Ecological Momentary Assessment and Intervention and Health Behavior Change Among Adults in Rakai, Uganda: Pilot Randomized Controlled Trial

BACKGROUND

An extraordinary increase in mobile phone ownership has revolutionized the opportunities to use mobile health approaches in lower- and middle-income countries (LMICs). Ecological momentary assessment and intervention (EMAI) uses mobile technology to gather data and deliver timely, personalized behavior change interventions in an individual's natural setting. To our knowledge, there have been no previous trials of EMAI in sub-Saharan Africa.

OBJECTIVE

To advance the evidence base for mobile health (mHealth) interventions in LMICs, we conduct a pilot randomized trial to assess the feasibility of EMAI and establish estimates of the potential effect of EMAI on a range of health-related behaviors in Rakai, Uganda.

METHODS

This prospective, parallel-group, randomized pilot trial compared health behaviors between adult participants submitting ecological momentary assessment (EMA) data and receiving behaviorally responsive interventional health messaging (EMAI) with those submitting EMA data alone. Using a fully automated mobile phone app, participants submitted daily reports on 5 different health behaviors (fruit consumption, vegetable consumption, alcohol intake, cigarette smoking, and condomless sex with a non-long-term partner) during a 30-day period before randomization (P1). Participants were then block randomized to the control arm, continuing EMA reporting through exit, or the intervention arm, EMA reporting and behavioral health messaging receipt. Participants exited after 90 days of follow-up, divided into study periods 2 (P2: randomization + 29 days) and 3 (P3: 30 days postrandomization to exit). We used descriptive statistics to assess the feasibility of EMAI through the completeness of data and differences in reported behaviors between periods and study arms.

RESULTS

The study included 48 participants (24 per arm; 23/48, 48% women; median age 31 years). EMA data collection was feasible, with 85.5% (3777/4418) of the combined days reporting behavioral data. There was a decrease in the mean proportion of days when alcohol was consumed in both arms over time (control: P1, 9.6% of days to P2, 4.3% of days; intervention: P1, 7.2% of days to P3, 2.4% of days). Decreases in sex with a non-long-term partner without a condom were also reported in both arms (P1 to P3 control: 1.9% of days to 1% of days; intervention: 6.6% of days to 1.3% of days). An increase in vegetable consumption was found in the intervention (vegetable: 65.6% of days to 76.6% of days) but not in the control arm. Between arms, there was a significant difference in the change in reported vegetable consumption between P1 and P3 (control: 8% decrease in the mean proportion of days vegetables consumed; intervention: 11.1% increase; P=.01).

CONCLUSIONS

Preliminary estimates suggest that EMAI may be a promising strategy for promoting behavior change across a range of behaviors. Larger trials examining the effectiveness of EMAI in LMICs are warranted.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04375423; https://www.clinicaltrials.gov/ct2/show/NCT04375423.

Feasibility and performance of smartphone-based daily micro-surveys among patients recovering from cancer surgery

AIMS

Daily micro-surveys, or the high-frequency administration of patient-reported outcome measures (PROMs), may provide real-time, unbiased assessments of health-related quality of life (HRQoL). We evaluated the feasibility and accuracy of daily micro-surveys using a smartphone platform among patients recovering from cancer surgery.

METHODS

In a prospective study (2017-2019), patients undergoing cancer surgery downloaded a smartphone application that administered daily micro-surveys comprising five randomly selected items from the Short Form-36 (SF-36). Micro-surveys were administered without replacement until the entire SF-36 was administered weekly. The full-length SF-36 was also administered preoperatively and 4, 12, and 24 weeks postoperatively. We assessed response and completion rates between the micro-surveys and full-length SF-36, as well as agreement of responses using Bland-Altman (B&A) analyses.

RESULTS

Ninety-five patients downloaded the application and were followed for a mean of 131 days [SD ± 85]. Response rates for the full-length SF-36 and micro-surveys was 76% [95%CI 69, 83], and 34% [95%CI 26, 39]. Despite lower response rates, more SF-36 surveys were collected using the daily micro-surveys compared to the intermittent full-length SF-36 (9.9 [95%CI 8.4, 12.6] vs. 3.0 [95%CI 2.8, 3.3], respectively). B&A analyses demonstrated lack of agreement between micro-surveys and SF-36. However, agreement improved with higher micro-survey completion rate. Eighty-five percent of participants reported that daily micro-surveys were not burdensome.

CONCLUSION

This study suggests that collection of daily micro-surveys among patients recovering from cancer surgery is feasible using smartphones in the early postoperative period. Future implementation of daily micro-surveys may more granularly describe momentary HRQoL changes through a greater volume of self-reported survey data.

Satisfaction, Usability, and Compliance With the Use of Smartwatches for Ecological Momentary Assessment of Knee Osteoarthritis Symptoms in Older Adults: Usability Study

Background

Smartwatches enable physicians to monitor symptoms in patients with knee osteoarthritis, their behavior, and their environment. Older adults experience fluctuations in their pain and related symptoms (mood, fatigue, and sleep quality) that smartwatches are ideally suited to capture remotely in a convenient manner.

Objective

The aim of this study was to evaluate satisfaction, usability, and compliance using the real-time, online assessment and mobility monitoring (ROAMM) mobile app designed for smartwatches for individuals with knee osteoarthritis.

Methods

Participants (N=28; mean age 73.2, SD 5.5 years; 70% female) with reported knee osteoarthritis were asked to wear a smartwatch with the ROAMM app installed. They were prompted to report their prior night’s sleep quality in the morning, followed by ecological momentary assessments (EMAs) of their pain, fatigue, mood, and activity in the morning, afternoon, and evening. Satisfaction, comfort, and usability were evaluated using a standardized questionnaire. Compliance with regard to answering EMAs was calculated after excluding time when the watch was not being worn for technical reasons (eg, while charging).

Results

A majority of participants reported that the text displayed was large enough to read (22/26, 85%), and all participants found it easy to enter ratings using the smartwatch. Approximately half of the participants found the smartwatch to be comfortable (14/26, 54%) and would consider wearing it as their personal watch (11/24, 46%). Most participants were satisfied with its battery charging system (20/26, 77%). A majority of participants (19/26, 73%) expressed their willingness to use the ROAMM app for a 1-year research study. The overall EMA compliance rate was 83% (2505/3036 responses). The compliance rate was lower among those not regularly wearing a wristwatch (10/26, 88% vs 16/26, 71%) and among those who found the text too small to read (4/26, 86% vs 22/26, 60%).

Conclusions

Older adults with knee osteoarthritis positively rated the ROAMM smartwatch app and were generally satisfied with the device. The high compliance rates coupled with the willingness to participate in a long-term study suggest that the ROAMM app is a viable approach to remotely collecting health symptoms and behaviors for both research and clinical endeavors.

Compliance With Mobile Ecological Momentary Assessment of Self-Reported Health-Related Behaviors and Psychological Constructs in Adults: Systematic Review and Meta-analysis

Background

Mobile ecological momentary assessment (mEMA) permits real-time capture of self-reported participant behaviors and perceptual experiences. Reporting of mEMA protocols and compliance has been identified as problematic within systematic reviews of children, youth, and specific clinical populations of adults.

Objective

This study aimed to describe the use of mEMA for self-reported behaviors and psychological constructs, mEMA protocol and compliance reporting, and associations between key components of mEMA protocols and compliance in studies of nonclinical and clinical samples of adults.

Methods

In total, 9 electronic databases were searched (2006-2016) for observational studies reporting compliance to mEMA for health-related data from adults (>18 years) in nonclinical and clinical settings. Screening and data extraction were undertaken by independent reviewers, with discrepancies resolved by consensus. Narrative synthesis described participants, mEMA target, protocol, and compliance. Random effects meta-analysis explored factors associated with cohort compliance (monitoring duration, daily prompt frequency or schedule, device type, training, incentives, and burden score). Random effects analysis of variance (P≤.05) assessed differences between nonclinical and clinical data sets.

Results

Of the 168 eligible studies, 97/105 (57.7%) reported compliance in unique data sets (nonclinical=64/105 [61%], clinical=41/105 [39%]). The most common self-reported mEMA target was affect (primary target: 31/105, 29.5% data sets; secondary target: 50/105, 47.6% data sets). The median duration of the mEMA protocol was 7 days (nonclinical=7, clinical=12). Most protocols used a single time-based (random or interval) prompt type (69/105, 65.7%); median prompt frequency was 5 per day. The median number of items per prompt was similar for nonclinical (8) and clinical data sets (10). More than half of the data sets reported mEMA training (84/105, 80%) and provision of participant incentives (66/105, 62.9%). Less than half of the data sets reported number of prompts delivered (22/105, 21%), answered (43/105, 41%), criterion for valid mEMA data (37/105, 35.2%), or response latency (38/105, 36.2%). Meta-analysis (nonclinical=41, clinical=27) estimated an overall compliance of 81.9% (95% CI 79.1-84.4), with no significant difference between nonclinical and clinical data sets or estimates before or after data exclusions. Compliance was associated with prompts per day and items per prompt for nonclinical data sets. Although widespread heterogeneity existed across analysis (I²>90%), no compelling relationship was identified between key features of mEMA protocols representing burden and mEMA compliance.

Conclusions

In this 10-year sample of studies using the mEMA of self-reported health-related behaviors and psychological constructs in adult nonclinical and clinical populations, mEMA was applied across contexts and health conditions and to collect a range of health-related data. There was inconsistent reporting of compliance and key features within protocols, which limited the ability to confidently identify components of mEMA schedules likely to have a specific impact on compliance.

Ecological Momentary Assessment of Non-Menstrual Pelvic Pain: Potential Pathways of Central Sensitization in Adolescents and Young Adults with and without Primary Dysmenorrhea

Purpose

Primary dysmenorrhea (PD; menstrual pain without an identified organic cause) has been proposed as a possible risk factor for the development of chronic pelvic pain, but the mechanism through which this process occurs is unknown. One possible mechanism is central sensitization – alterations in the central nervous system that increase responsiveness to pain leading to hypersensitivity. Repeated episodes of pain, such as those experienced over time with PD, may alter how the brain processes pain. Ecological momentary assessment (EMA; collection of data in real time in participants’ natural environments) is a novel data collection method that may help elucidate pain occurring during non-menstrual cycle phases.

Patients and Methods

The current observational study assessed the feasibility and acceptability of using EMA via text messages to collect pelvic pain data during menstrual and non-menstrual cycle phases in a community sample of adolescents and young adults (AYA) aged 16–24 years with and without PD and explored occurrence rates and intensity of non-menstrual pelvic pain (NMPP) in each of these groups.

Results

Thirty-nine AYA with PD and 53 healthy controls reported pelvic pain level via nightly text message. Global response rate was 98.5%, and all participants reported that the EMA protocol was acceptable. AYA with PD reported higher intensity (2.0 vs 1.6 on 0–10 numeric rating scale; p=0.003) and frequency (8.7% vs 3.1% of days; p=0.004) of NMPP compared to healthy controls.

Conclusion

The EMA protocol was feasible and acceptable. Though both the intensity and frequency of NMPP were low and at levels that would not typically warrant clinical assessment or intervention, these repeated nociceptive events may represent a potential mechanism contributing to the transition from cyclical to chronic pelvic pain in some individuals.

II. Indices of Pain Intensity Derived From Ecological Momentary Assessments and Their Relationships With Patient Functioning: An Individual Patient Data Meta-analysis

Pain intensity is a complex and dynamic experience. A focus on assessing patients' average pain levels may miss important aspects of pain that impact functioning in daily life. In this second of 3 articles investigating alternative indices of pain intensity derived from Ecological Momentary Assessments (EMA), we examine the indices' associations with physical and psychosocial functioning. EMA data from 10 studies (2,660 patients) were reanalyzed to construct indices of Average Pain, Maximum Pain, Minimum Pain, Pain Variability, Time in High Pain, Time in Low Pain, Pain after Wake-up. Three sets of individual patient data meta-analyses examined 1) the test-retest reliability of the pain indices, 2) their convergent validity in relation to physical functioning, fatigue, depression, mental health, and social functioning, and 3) the incremental validity of alternative indices above Average Pain. Reliabilities approaching or exceeding a level of .7 were observed for all indices, and most correlated significantly with all functioning domains, with small to medium effect sizes. Controlling for Average Pain, Maximum Pain and Pain Variability uniquely predicted all functioning measures, and Time in High Pain predicted physical and social functioning. We suggest that alternative pain indices can provide new perspectives for understanding functioning in chronic pain. PERSPECTIVE: Alternative summary measures of pain intensity derived from EMA have the potential to help better understand patients' pain experience. Utilizing EMA for the assessment of Maximum Pain, Pain Variability, and Time in High Pain may provide an enhanced window into the relationships between pain and patients' physical and psychosocial functioning.

III. Detecting Treatment Effects in Clinical Trials With Different Indices of Pain Intensity Derived From Ecological Momentary Assessment

Pain intensity represents the primary outcome in most pain clinical trials. Identifying methods to measure aspects of pain that are most sensitive to treatment may facilitate discovery of effective interventions. In this third of 3 articles examining alternative indices of pain intensity derived from ecological momentary assessments (EMA), we compare treatment effects based on Average Pain, Maximum Pain, Minimum Pain, Pain Variability, Time in High Pain, Time in Low Pain, and Pain After Wake-Up. We also examine which indices contribute to Patient Global Impressions of Change (PGIC). Data came from 2 randomized, double-blind, placebo-controlled trials examining the efficacy of milnacipran for fibromyalgia treatment; 2,084 patients provided >1 million EMA pain intensity ratings over 24 (Study 1) or 26 (Study 2) treatment weeks. Pain Variability and Time in High Pain produced significantly smaller treatment effects than Average Pain; other pain indices showed effects that were numerically smaller, but not significantly different from Average Pain. Changes in all pain indices were significantly associated with PGIC, with improvements in Maximum Pain and in Pain Variability offering small incremental contributions to understanding PGIC over Average Pain. Results suggest that different pain indices could be used to detect treatment effects in pain clinical trials. PERSPECTIVE: Alternative summary measures of pain intensity derived from EMA may broaden the scope of outcomes useful in pain clinical trials. In this analysis of a pharmacological treatment for fibromyalgia, most pain summary measures indicated similar effects; improvements in Maximum Pain and Pain Variability contributed to understanding PGIC over Average Pain.

Smart Data Collection for the Assessment of Treatment Effects in Irritable Bowel Syndrome: Observational Study

BACKGROUND

End-of-day symptom diaries are recommended by drug regulatory authorities to assess treatment response in patients with irritable bowel syndrome. We developed a smartphone app to measure treatment response.

OBJECTIVE

Because the employment of an app to measure treatment response in irritable bowel syndrome is relatively new, we aimed to explore patients' adherence to diary use and characteristics associated with adherence.

METHODS

A smartphone app was developed to serve as a symptom diary. Patients with irritable bowel syndrome (based on Rome IV criteria) were instructed to fill out end-of-day diary questionnaires during an 8-week treatment. Additional online questionnaires assessed demographics, irritable bowel syndrome symptom severity, and psychosocial comorbidities. Adherence rate to the diary was defined as the percentage of days completed out of total days. Adherence to the additional web-based questionnaires was also assessed.

RESULTS

Overall, 189 patients were included (age: mean 34.0 years, SD 13.3 years; female: 147/189, 77.8%; male: 42/189, 22.2%). The mean adherence rate was 87.9% (SD 9.4%). However, adherence to the diary decreased over time (P<.001). No significant association was found between adherence and gender (P=.84), age (P=.22), or education level (lower education level: P=.58, middle education level: P=.46, versus high education level), while higher anxiety scores were associated with lower adherence (P=.03). Adherence to the online questionnaires was also high (>99%). Missing data due to technical issues were limited.

CONCLUSIONS

The use of a smartphone app as a symptom diary to assess treatment response resulted in high patient adherence. The data-collection framework described led to standardized data collection with excellent completeness and can be used for future randomized controlled trials. Due to the slight decrease in adherence to diary use throughout the study, this method might be less suitable for longer trials.

Digital Pain Mapping and Tracking in Patients With Chronic Pain: Longitudinal Study

Background

Digital pain mapping allows for remote and ecological momentary assessment in patients over multiple time points spanning days to months. Frequent ecological assessments may reveal tendencies and fluctuations more clearly and provide insights into the trajectory of a patient’s pain.

Objective

The primary aim of this study is to remotely map and track the intensity and distribution of pain and discomfort (eg, burning, aching, and tingling) in patients with nonmalignant spinal referred pain over 12 weeks using a web-based app for digital pain mapping. The secondary aim is to explore the barriers of use by determining the differences in clinical and user characteristics between patients with good (regular users) and poor (nonregular users) reporting compliance.

Methods

Patients (N=91; n=53 women) with spinal referred pain were recruited using web-based and traditional in-house strategies. Patients were asked to submit weekly digital pain reports for 12 weeks. Each pain report consisted of digital pain drawings on a pseudo–three-dimensional body chart and pain intensity ratings. The pain drawings captured the distribution of pain and discomfort (pain quality descriptors) expressed as the total extent and location. Differences in weekly pain reports were explored using the total extent (pixels), current and usual pain intensity ratings, frequency of quality descriptor selection, and Jaccard similarity index. Validated e-questionnaires were completed at baseline to determine the patients’ characteristics (adapted Danish National Spine Register), disability (Oswestry Disability Index and Neck Disability Index), and pain catastrophizing (Pain Catastrophizing Scale) profiles. Barriers of use were assessed at 6 weeks using a health care–related usability and acceptance e-questionnaire and a self-developed technology-specific e-questionnaire to assess the accessibility and ease of access of the pain mapping app. Associations between total extent, pain intensity, disability, and catastrophizing were explored to further understand pain. Differences between regular and nonregular users were assessed to understand the pain mapping app reporting compliance.

Results

Fluctuations were identified in pain reports for total extent and pain intensity ratings (P<.001). However, quality descriptor selection (P=.99) and pain drawing (P=.49), compared using the Jaccard index, were similar over time. Interestingly, current pain intensity was greater than usual pain intensity (P<.001), suggesting that the timing of pain reporting coincided with a more intense pain experience than usual. Usability and acceptance were similar between regular and nonregular users. Regular users were younger (P<.001) and reported a larger total extent of pain than nonregular users (P<.001).

Conclusions

This is the first study to examine digital reports of pain intensity and distribution in patients with nonmalignant spinal referred pain remotely for a sustained period and barriers of use and compliance using a digital pain mapping app. Differences in age, pain distribution, and current pain intensity may influence reporting behavior and compliance.

Occurrence of and Reasons for "Missing Events" in Mobile Dietary Assessments: Results From Three Event-Based Ecological Momentary Assessment Studies

Background

Establishing a methodology for assessing nutritional behavior comprehensively and accurately poses a great challenge. Mobile technologies such as mobile image-based food recording apps enable eating events to be assessed in the moment in real time, thereby reducing memory biases inherent in retrospective food records. However, users might find it challenging to take images of the food they consume at every eating event over an extended period, which might lead to incomplete records of eating events (missing events).

Objective

Analyzing data from 3 studies that used mobile image-based food recording apps and varied in their technical enrichment, this study aims to assess how often eating events (meals and snacks) were missed over a period of 8 days in a naturalistic setting by comparing the number of recorded events with the number of normative expected events, over time, and with recollections of missing events.

Methods

Participants in 3 event-based Ecological Momentary Assessment (EMA) studies using mobile image-based dietary assessments were asked to record all eating events (study 1, N=38, 1070 eating events; study 2, N=35, 934 eating events; study 3, N=110, 3469 eating events). Study 1 used a basic app; study 2 included 1 fixed reminder and the possibility to add meals after the actual eating events occurred instead of in the moment (addendum); and study 3 included 2 fixed reminders, an addendum feature, and the option to record skipped meals. The number of recalled missed events and their reasons were assessed by semistructured interviews after the EMA period (studies 1 and 2) and daily questionnaires (study 3).

Results

Overall, 183 participants reported 5473 eating events. Although the momentary adherence rate as indexed by a comparison with normative expected events was generally high across all 3 studies, a differential pattern of results emerged with a higher rate of logged meals in the more technically intensive study 3. Multilevel models for the logging trajectories of reported meals in all 3 studies showed a significant, albeit small, decline over time (b=−.11 to −.14, Ps<.001, pseudo-R²=0.04-0.06), mainly because of a drop in reported snacks between days 1 and 2. Intraclass coefficients indicated that 38% or less of the observed variance was because of individual differences. The most common reasons for missing events were competing activities and technical issues, whereas situational barriers were less important.

Conclusions

Three different indicators (normative, time stability, and recalled missing events) consistently indicated missing events. However, given the intensive nature of diet EMA protocols, the effect sizes were rather small and the logging trajectories over time were remarkably stable. Moreover, the individual’s actual state and context seemed to exert a greater influence on adherence rates than stable individual differences, which emphasizes the need for a more nuanced understanding of the factors that affect momentary adherence.

Comparability of Emotion Dynamics Derived From Ecological Momentary Assessments, Daily Diaries, and the Day Reconstruction Method: Observational Study

Background

Interest in the measurement of the temporal dynamics of people’s emotional lives has risen substantially in psychological and medical research. Emotions fluctuate and change over time, and measuring the ebb and flow of people’s affective experiences promises enhanced insights into people’s health and functioning. Researchers have used a variety of intensive longitudinal assessment (ILA) methods to create measures of emotion dynamics, including ecological momentary assessments (EMAs), end-of-day (EOD) diaries, and the day reconstruction method (DRM). To date, it is unclear whether they can be used interchangeably or whether ostensibly similar emotion dynamics captured by the methods differ in meaningful ways.

Objective

This study aims to examine the extent to which different ILA methods yield comparable measures of intraindividual emotion dynamics.

Methods

Data from 90 participants aged 50 years or older were collected in a probability-based internet panel, the Understanding America Study, and analyzed. Participants provided positive and negative affect ratings using 3 ILA methods: (1) smartphone-based EMA, administered 6 times per day over 1 week, (2) web-based EOD diaries, administered daily over the same week, and (3) web-based DRM, administered once during that week. We calculated 11 measures of emotion dynamics (addressing mean levels, variability, instability, and inertia separately for positive and negative affect, as well as emotion network density, mixed emotions, and emotional dialecticism) from each ILA method. The analyses examined mean differences and correlations of scores addressing the same emotion dynamic across the ILA methods. We also compared the patterns of intercorrelations among the emotion dynamics and their relationships with health outcomes (general health, pain, and fatigue) across ILA methods.

Results

Emotion dynamics derived from EMAs and EOD diaries demonstrated moderate-to-high correspondence for measures of mean emotion levels (ρ≥0.95), variability (ρ≥0.68), instability (ρ≥0.51), mixed emotions (ρ=0.92), and emotional dialecticism (ρ=0.57), and low correspondence for measures of inertia (ρ≥0.17) and emotion network density (ρ=0.36). DRM-derived measures showed correlations with EMAs and EOD diaries that were high for mean emotion levels and mixed emotions (ρ≥0.74), moderate for variability (ρ=0.38-.054), and low to moderate for other measures (ρ=0.03-0.41). Intercorrelations among the emotion dynamics showed high convergence across EMAs and EOD diaries, and moderate convergence between the DRM and EMAs as well as EOD diaries. Emotion dynamics from all 3 ILA methods produced very similar patterns of relationships with health outcomes.

Conclusions

EMAs and EOD diaries provide corresponding information about individual differences in various emotion dynamics, whereas the DRM provides corresponding information about emotion levels and (to a lesser extent) variability, but not about more complex emotion dynamics. Our results caution researchers against viewing these ILA methods as universally interchangeable.

The Effects of Sampling Frequency and Questionnaire Length on Perceived Burden, Compliance, and Careless Responding in Experience Sampling Data in a Student Population

Currently, little is known about the association between assessment intensity, burden, data quantity, and data quality in experience sampling method (ESM) studies. Researchers therefore have insufficient information to make informed decisions about the design of their ESM study. Our aim was to investigate the effects of different sampling frequencies and questionnaire lengths on burden, compliance, and careless responding. Students ( n = 163) received either a 30- or 60-item questionnaire three, six, or nine times per day for 14 days. Preregistered multilevel regression analyses and analyses of variance were used to analyze the effect of design condition on momentary outcomes, changes in those outcomes over time, and retrospective outcomes. Our findings offer support for increased burden and compromised data quantity and quality with longer questionnaires, but not with increased sampling frequency. We therefore advise against the use of long ESM questionnaires, while high-sampling frequencies do not seem to be associated with negative consequences.

Momentary predictors of compliance in studies using the experience sampling method

The influence of momentary experiences on compliance has not yet been studied extensively in diary methods such as the experience sampling method (ESM). This study investigated to what extent momentary experiences at the moment of responding (hereafter 'beep') can predict compliance in high frequency ESM protocols. Lagged-analyses were conducted using a pooled dataset of seven studies including 1,318 healthy volunteers and individuals with different mental health conditions. All studies used an ESM design of 10 beeps per day over 4 to 6 days. Overall compliance was 86% (to beeps where a subject was compliant at the previous beep). Results indicated that participants who reported higher positive affect overall were more compliant. Feeling disturbed by a beep, being outside the home, medication use, or longer inter-prompt interval decreased the chances of compliance to the subsequent beep. While participants with depression tended to be more compliant, chances to be compliant decreased in the evenings and over the course of the study days. When more beeps were missed consecutively, the chances to miss the subsequent beep increased. Findings suggest that disturbance of the beep, being outside the home, medication use, and inter-prompt interval might decrease the chances of compliance to the subsequent beep.