Intervening on high-risk responses during ecological momentary assessment of suicidal thoughts: Is there an effect on study data?

Readdressing the Ongoing Challenge of Missing Data in Youth Ecological Momentary Assessment Studies: Meta-Analysis Update

BACKGROUND

Ecological momentary assessment (EMA) is pivotal in longitudinal health research in youth, but potential bias associated with nonparticipation, omitted reports, or dropout threatens its clinical validity. Previous meta-analytic evidence is inconsistent regarding specific determinants of missing data.

OBJECTIVE

This meta-analysis aimed to update and expand upon previous research by examining key participation metrics-acceptance, compliance, and retention-in youth EMA studies. In addition, it sought to identify potential moderators among sample and design characteristics, with the goal of better understanding and mitigating the impact of missing data.

METHODS

We used a bibliographic database search to identify EMA studies involving children and adolescents published from 2001 to November 2023. Eligible studies used mobile-delivered EMA protocols in samples with an average age up to 18 years. We conducted separate meta-analyses for acceptance, compliance, and retention rates, and performed meta-regressions to address sample and design characteristics. Furthermore, we extracted and pooled sample-level effect sizes related to correlates of response compliance. Risk of publication bias was assessed using funnel plots, regression tests, and sensitivity analyses targeting inflated compliance rates.

RESULTS

We identified 285 samples, including 17,441 participants aged 5 to 17.96 years (mean age 14.22, SD 2.24 years; mean percentage of female participants 55.7%). Pooled estimates were 67.27% (k=88, 95% CI 62.39-71.96) for acceptance, 71.97% (k=216, 95% CI 69.83-74.11) for compliance, and 96.57% (k=169, 95% CI 95.42-97.56) for retention. Despite overall poor moderation of participation metrics, acceptance rates decreased as the number of EMA items increased (log-transformed b=-0.115, SE 0.036; 95% CI -0.185 to -0.045; P=.001; R2=19.98), compliance rates declined by 0.8% per year of publication (SE 0.25, 95% CI -1.3 to -0.3; P=.002; R2=4.17), and retention rates dropped with increasing study duration (log-transformed b=-0.061, SE 0.015; 95% CI -0.091 to 0.032; P<.001; R2=10.06). The benefits of monetary incentives on response compliance diminished as the proportion of female participants increased (b=-0.002, SE 0.001; 95% CI -0.003 to -0.001; P=.003; R2=9.47). Within-sample analyses showed a small but significant effect indicating higher compliance in girls compared to boys (k=25; g=0.18; 95% CI 0.06-0.31; P=.003), but no significant age-related effects were found (k=14; z score=0.05; 95% CI -0.01 to 0.16).

CONCLUSIONS

Despite a 5-fold increase in included effect sizes compared to the initial review, the variability in rates of missing data that one can expect based on specific sample and design characteristics remains substantial. The inconsistency in identifying robust moderators highlights the need for greater attention to missing data and its impact on study results. To eradicate any health-related bias in EMA studies, researchers should collectively increase transparent reporting practices, intensify primary methodological research, and involve participants' perspectives on missing data.

TRIAL REGISTRATION

PROSPERO CRD42022376948; https://www.crd.york.ac.uk/PROSPERO/view/CRD42022376948.

Automated Real-Time Tool for Promoting Crisis Resource Use for Suicide Risk (ResourceBot): Development and Usability Study

BACKGROUND

Real-time monitoring captures information about suicidal thoughts and behaviors (STBs) as they occur and offers great promise to learn about STBs. However, this approach also introduces questions about how to monitor and respond to real-time information about STBs. Given the increasing use of real-time monitoring, there is a need for novel, effective, and scalable tools for responding to suicide risk in real time.

OBJECTIVE

The goal of this study was to develop and test an automated tool (ResourceBot) that promotes the use of crisis services (eg, 988) in real time through a rule-based (ie, if-then) brief barrier reduction intervention.

METHODS

ResourceBot was tested in a 2-week real-time monitoring study of 74 adults with recent suicidal thoughts.

RESULTS

ResourceBot was deployed 221 times to 36 participants. There was high engagement with ResourceBot (ie, 87% of the time ResourceBot was deployed, a participant opened the tool and submitted a response to it), but zero participants reported using crisis services after engaging with ResourceBot. The most reported reasons for not using crisis services were beliefs that the resources would not help, wanting to handle things on one's own, and the resources requiring too much time or effort. At the end of the study, participants rated ResourceBot with good usability (mean of 75.6 out of 100) and satisfaction (mean of 20.8 out of 32).

CONCLUSIONS

This study highlights both the possibilities and challenges of developing effective real-time interventions for suicide risk and areas for refinement in future work.

An analysis of real-time suicidal ideation and its relationship with retrospective reports among young people with borderline personality disorder

INTRODUCTION

This study aimed to analyze the real-time variability of suicidal ideation intensity and the relationship between real-time and retrospective reports of suicidal ideation made on the Beck Scale for Suicidal Ideation (BSS), among young people with borderline personality disorder (BPD).

METHODS

Young people (15-25-year olds) with BPD (N = 46), recruited from two government-funded mental health services, rated the intensity of their suicidal ideation six times per day for 7 days before completing the BSS.

RESULTS

For 70% of participants, suicidal ideation changed in intensity approximately five times across the week, both within and between days. BSS ratings were most highly correlated with the highest real-time ratings of suicidal ideation. However, this was not significantly different from the relationship between the BSS and both the average and most recent ratings. Median ratings of suicidal ideation intensity were higher on the BSS compared with an equivalent question asked in real time.

CONCLUSION

Findings suggest that young people with BPD experience high levels of fluctuation in their intensity of suicidal ideation across a week and that retrospective reports of suicidal ideation might be more reflective of the most intense experience of suicidal ideation across the week.

Effects of frequent assessments on the severity of suicidal thoughts: an ecological momentary assessment study

Objective

In recent years, there has been a significant increase in research using ecological momentary assessment (EMA) to explore suicidal thoughts and behaviors (STBs). Meanwhile, concerns have been raised regarding the potential impacts of frequent and intense STBs assessments on the study participants.

Methods

From November 2021 to June 2023, a total of 83 adolescent and young adult outpatients (Mage = 21.0, SDage = 6.3, 71.1% female), who were diagnosed with mood disorders, were recruited from three psychiatric clinics in China. Smartphone-based EMA was used to measure suicidal thoughts three times per day at randomly selected times. We examined the change of suicidal thoughts in each measurement and within 1 day to evaluate potential adverse effects using Bayesian multilevel models.

Results

The 3,105 effective surveys were nested in 83 participants (median follow-up days: 14 days). The results of two-level models indicated that suicidal thoughts decreased during the monitoring period. However, this effect varied among different individuals in the two-level model.

Conclusion

Our findings did not support the notion that repeated assessment of suicidal thoughts is iatrogenic, but future research should continue to investigate the impact of frequent assessment on suicidal thoughts, taking into account individual differences and utilizing larger sample sizes.