The Common Elements of treatment engagement for clinically high-risk youth and youth with first-episode psychosis

Toward Efficient, Sustainable, and Scalable Methods of Treatment Characterization: An Investigation of Coding Clinical Practice from Chart Notes

PURPOSE

Chart notes provide a low-cost data source that could help characterize what occurs in treatment with sufficient precision to improve management of care. This study assessed the interrater reliability of treatment content coded from chart notes and evaluated its concordance with content coded from transcribed treatment sessions.

METHOD

Fifty randomly selected and digitally recorded treatment events were transcribed and coded for practice content. Independent coders then applied the same code system to chart notes for these same treatment events.

ANALYSIS

We measured reliability and concordance of practice occurrence and extensiveness at two levels of specificity: practices (full procedures) and steps (subcomponents of those procedures).

RESULTS

For chart notes, practices had moderate interrater reliability (M k = 0.50, M ICC = 0.56) and steps had moderate (M ICC = 0.74) to substantial interrater reliability (M k = 0.78). On average, 2.54 practices and 5.64 steps were coded per chart note and 4.53 practices and 13.10 steps per transcript. Across sources, ratings for 64% of practices and 41% of steps correlated significantly, with those with significant correlations generally demonstrating moderate concordance (practice M r = 0.48; step M r = 0.47). Forty one percent of practices and 34% of steps from transcripts were also identified in the corresponding chart notes.

CONCLUSION

Chart notes provide an accessible data source for evaluating treatment content, with different levels of specificity posing tradeoffs for validity and reliability, which in turn may have implications for chart note interfaces, training, and new metrics to support accurate, reliable, and efficient measurement of clinical practice.

Digital health innovation to prevent relapse and support recovery in young people with first-episode psychosis: A pilot study of Horyzons-Canada

Digital health innovations may help to improve access to psychosocial therapy and peer support; however, the existence of evidence-based digital health interventions for individuals recovering from a first-episode psychosis (FEP) remains limited. This study aims to investigate the feasibility, acceptability, safety, and pre-post outcomes of Horyzons-Canada (HoryzonsCa), a Canadian adaptation of a digital mental health intervention consisting of psychosocial interventions, online social networking, and clinical and peer support moderation. Using a convergent mixed-methods research design, we recruited participants from a specialized early intervention clinic for FEP in Montreal, Canada. Twenty-three participants (mean age = 26.8) completed baseline assessments, and 20 completed follow-up assessments after 8 weeks of intervention access. Most participants provided positive feedback on general experience (85%, 17/20) and the utility of Horyzons for identifying their strengths (70%, 14/20). Almost all perceived the platform as easy to use (95%, 19/20) and felt safe using it (90%, 18/20). There were no adverse events related to the intervention. Participants used HoryzonsCa to learn about their illness and how to get better (65%, 13/20), receive support (60%, 12/20), and access social networking (35%, 7/20) and peer support (30%, 6/20). Regarding adoption, 65% (13/20) logged in at least 4 times over 8 weeks. There was a nonsignificant increase in social functioning and no deterioration on the Clinical Global Impression Scale. Overall, HoryzonsCa was feasible to implement and perceived as safe and acceptable. More research is needed with larger sample sizes and using in-depth qualitative methods to better understand the implementation and impact of HoryzonsCa.

The impact of familial involvement on dropout in a culturally informed group therapy for people diagnosed with 'schizophrenia'

Background

Individuals with schizophrenia diagnoses are high-risk for dropout from mental health treatments, yet few studies have examined whether familial involvement in therapy impacts dropout.

Methods

We examined whether familial involvement and other demographic variables predicted dropout among 101 patients enrolled in culturally informed group therapy for schizophrenia (CIGT-S), which incorporates collectivistic principles and spiritual coping into treatment. We reviewed records and conducted follow-up calls to identify reasons for dropout, and performed survival analyses to identify when dropout was likely.

Results

Familial involvement was linked to greater engagement with treatment and lower dropout, signifying a mechanism for improving treatment attendance in this group. Ethnic minorities and patients with higher symptom severity demonstrated higher rates of dropout. Most patients dropped out of CIGT-S before treatment began. However, significantly lower levels of dropout were observed among those who made it to session 9 (end of the spirituality module). An inability to maintain contact with participants was the most cited reason for dropout within records, and structural reasons (e.g., moving away) were commonly cited among participants who were successfully followed-up with.

Discussion

Future work may identify whether family functioning or the quality of familial relationships may predict familial involvement and, consequently, treatment attendance.

Development of the Brief Educational Guide for Individuals in Need (BEGIN): A psychoeducation intervention for individuals at risk for psychosis

AIM

Identification of individuals with psychosis risk (PR) through screening and specialized assessment is becoming more widespread in an effort to promote early intervention and improve recovery outcomes. PR individuals report interest in psychoeducation, though such interventions are currently lacking. Our goal was to develop a structured PR psychoeducation intervention grounded in theory and stakeholder feedback.

METHODS

By following a step-by-step intervention development model, we identified relevant conceptual frameworks, developed the content and format, and obtained stakeholder feedback. This process resulted in a 5-session PR psychoeducation intervention, Brief Educational Guide for Individuals in Need (BEGIN), with content conveyed visually via a slideshow presentation. PR individuals (n = 5) and parents of PR individuals (n = 5) reviewed BEGIN's content and format, and provided feedback through semi-structured qualitative interviews. Major themes were identified through iterative thematic analysis.

RESULTS

PR individuals and parents had a positive impression of BEGIN's materials and step-by-step format and psychoeducation about the PR condition. They indicated that the intervention was likely to encourage agency. PR participants emphasized the importance of a patient's decision regarding whether their family member(s) should participate in BEGIN. Parents reported that BEGIN is an important first step in treatment and offers a safe therapeutic environment. Feedback was then utilized to modify the intervention.

CONCLUSIONS

BEGIN is desired by consumers and may lay the foundation for future engagement with treatment by facilitating agency. A feasibility trial is underway and future studies are needed to measure outcomes (e.g., treatment engagement) and evaluate BEGIN as an evidence-based PR psychoeducation model.

Predictors of study drop-out and service disengagement in patients at clinical high risk for psychosis

PURPOSE

Study drop-out during follow-up and service disengagement frequently occur in patients at clinical high risk for psychosis (CHR-P). However, little is known about their predictors. Therefore, we aimed to analyze the rate and reasons for drop-out and service disengagement in CHR-P patients and investigate their sociodemographic and clinical predictors.

METHODS

Data from 200 patients of the prospective Früherkennung von Psychosen (FePsy) study were analyzed with competing risks survival models, considering drop-out and transition to psychosis as competing events. To investigate whether symptoms changed immediately before drop-out, t tests were applied.

RESULTS

Thirty-six percent of patients dropped out within 5 years. Almost all drop-outs also disengaged from our service. Hence, study drop-out was used as a proxy for service disengagement. Patients with more severe baseline disorganized symptoms and a late inclusion into the study were significantly more likely to disengage. Immediately before disengagement, there was significant improvement in negative symptoms only.

CONCLUSION

A considerable proportion of CHR-P patients disengaged from our clinical study and service. Patients who were included during a later study period with more assessments disengaged more often, which might have been due to more frequent invitations to follow-up assessments and thereby increasing participation burden. Hence, our study provides a cautionary note on high-frequency follow-up assessments. Larger-scale studies evaluating predictors on multiple domains would help to further elucidate drop-out and disengagement.

The Use of Text Messaging to Improve Clinical Engagement for Individuals With Psychosis: Systematic Review

BACKGROUND

Individuals experiencing psychosis are at a disproportionate risk for premature disengagement from clinical treatment. Barriers to clinical engagement typically result from funding constraints causing limited access to and flexibility in services. Digital strategies, such as SMS text messaging, offer a low-cost alternative to potentially improve engagement. However, little is known about the efficacy of SMS text messaging in psychosis.

OBJECTIVE

This review aimed to address this gap, providing insights into the relationship between SMS text messaging and clinical engagement in the treatment of psychosis.

METHODS

Studies examining SMS text messaging as an engagement strategy in the treatment of psychosis were reviewed. Included studies were published from the year 2000 onward in the English language, with no methodological restrictions, and were identified using 3 core databases and gray literature sources.

RESULTS

Of the 233 studies extracted, 15 were eligible for inclusion. Most studies demonstrated the positive effects of SMS text messaging on dimensions of engagement such as medication adherence, clinic attendance, and therapeutic alliance. Studies examining the feasibility of SMS text messaging interventions found that they are safe, easy to use, and positively received.

CONCLUSIONS

Overall, SMS text messaging is a low-cost, practical method of improving engagement in the treatment of psychosis, although efficacy may vary by symptomology and personal characteristics. Cost-effectiveness and safety considerations were not adequately examined in the studies included. Future studies should consider personalizing SMS text messaging interventions and include cost and safety analyses to appraise readiness for implementation.

A systematic review of prevention programs targeting depression, anxiety, and stress in university students

BACKGROUND

Given the prevalence of anxiety, depression, and stress among university students, it is important to assess the effectiveness of prevention programs for these problems. Beyond examining effect sizes, applying a common elements approach can enhance our understanding of which practice elements are most frequently included in symptom-reducing programs.

METHOD

This review examined effective (i.e., outcome-producing) prevention programs targeting depression, anxiety, and/or stress in university students. Programs could be delivered in a group-based, online/computer-delivered, or self-administered format and at the universal, selective, or indicated prevention level.

RESULTS

The resulting sample of 62 articles covered 68 prevention programs for college, graduate, or professional students across 15 countries. Average effect sizes for programs were moderate (overall g = 0.65), regardless of delivery format or prevention level. The most common practice elements (overall and for programs producing large effects) were: psychoeducation (72%), relaxation (69%), and cognitive monitoring/restructuring (47%). Many programs were limited by: (a) symptom target-outcome mismatches, (b) disproportionately female samples, and (c) inconsistently reported adherence data.

LIMITATIONS

Commonness of practice elements across outcome-producing interventions does not imply their extensiveness nor unique contribution to effectiveness. Coding was based on information in articles rather than manuals, and inter-rater reliability was moderate for some practice elements.

CONCLUSION

The outcome-producing prevention programs in our sample had common practice elements and produced moderate reduction in symptoms overall. Future research of depression, anxiety, and stress prevention programs for university students can investigate practice elements' unique and combined impact on outcomes, further explore under-tested practice elements, and use findings to inform intervention design.

Development and validation of the client engagement and service use scale: A pilot study

Specialized treatment for first episode psychosis offers clients a menu of services coordinated within a specialized treatment team. To enhance the impact of these services, promoting engagement and preventing early treatment drop-out is critical. However, engagement is poorly tracked and typically quantified through proxy variables such as session attendance, medication adherence, or working alliance. The aim of this study is to introduce and pilot a new measure of engagement for first episode psychosis coordinated specialty care, the Client Engagement and Service Use Scale (CENSUS). The CENSUS was evaluated for reliability and validated against the Service Engagement Scale and an appointment count for a small sample (N = 10) of first episode clients. The measure was also evaluated for acceptability by a consumer advocacy group. Clinicians achieved high inter-rater reliability after minimal training. CENSUS items demonstrated medium to large correlations with other measures of engagement. Feedback from the consumer group emphasized that clinicians should ask questions in a way that is nonjudgmental and successfully elicits authentic client feedback about their service preferences. This pilot study yielded preliminary evidence of reliability and validity, suggesting that the CENSUS is a useful and novel tool for tracking and differentiating degrees of client engagement across multiple intervention components and for facilitating structured discussions regarding clients' service utilization and preferences.

Cultural factors in first episode psychosis treatment engagement

Specialized First Episode Psychosis (FEP) services have been conceptualized in part around the issue of engagement. Creating treatment that is easier to access, with more frequent contacts, assertive outreach to clients between appointments, and an explicit youth-oriented culture could make services more attractive to those most in need of care. However, engagement has remained a mostly fuzzy, peripheral construct rather than the object of study in itself. As we recognize the importance of treatment engagement, we must prepare to address it more rigorously within psychosis and schizophrenia research. At the same time, factors enhancing or obstructing treatment engagement are inevitably local, rather than universal. The availability of care, its associated costs and stigmas, individuals' motivations for seeking treatment, and their beliefs and expectations about providers' roles are determined by local and cultural features. There can be no singular "best practice" for engagement - but curiosity about how culture and locale influence clients' willingness to participate in care, and creativity in how we account for and incorporate these variables into study designs, will help to shed light on the critical issue of engagement in FEP treatment.