Comparative effectiveness of external vs blended facilitation on collaborative care model implementation in slow-implementer community practices

Enablers and Barriers to an Experience-Based Co-Design Process to Develop Service Improvements in Enhanced Community Care in Ireland: A Qualitative Study

BACKGROUND

Experience-Based Co-Design (EBCD) is a popular collaborative process where service users and healthcare providers share their experiences of using and delivering services to identify ways to adapt services to enhance those experiences.

OBJECTIVE

This study aimed to identify enablers and barriers to the successful implementation of EBCD as part of Ireland's recently adopted Enhanced Community Care (ECC) programme.

DESIGN

Service users and staff at two sites (N = 17) participated in an accelerated EBCD process designed to enhance service provision for older people and those living with chronic conditions. This included four co-design working group sessions per site.

METHODS

Transcripts from the co-design working groups and from brief follow-up interviews with individual participants were analysed. Thematic analysis was used to identify enablers and barriers to the EBCD process.

RESULTS

We generated six key themes reflecting barriers and enablers; enablers were the fundamental role of the facilitator (Theme 1), a flexible approach that met group members' needs (Theme 2) and active and interactive activities to support participant engagement (Theme 3). The fundamental role of the facilitator was also identified as a barrier (Theme 4); additional barriers included balancing experience-sharing and decompressing (Theme 5) and the scope of the group as an invisible barrier (Theme 6), which reflected challenges in facilitating dialogue about change when participants were aware of system-level constraints on the potential for change.

CONCLUSIONS

The facilitator is critical in ensuring the successful implementation of the EBCD process. Considering how best to draw on the facilitator strengths while also ensuring that the service user perspectives are equally weighted with staff perspectives is important for effective communication within EBCD projects.

PATIENT OR PUBLIC CONTRIBUTION

Service users (also including carers) at two sites participated in EBCD projects alongside health and social care professionals, ultimately generating two service improvements for the ECC programme. The participation of these service users was celebrated at an academic conference, which was attended by a number of service users, and where the outcomes of the EBCD project were presented.

Student mental health outcomes of a clustered SMART for developing an adaptive implementation strategy to support school-based CBT delivery

PURPOSE

Most youth experiencing anxiety/depression lack access to evidence-based mental health practices (EBPs). School-delivered care improves access, and various support can help school professionals (SPs; school social workers, counselors) deliver EBPs, like Cognitive Behavioral Therapy (CBT). Understanding implementation strategies' impact on downstream mental health outcomes is crucial to scaling up EBPs to address the treatment gap, but it has rarely been assessed.

METHODS

This paper compares implementation strategies' impact on change in student outcomes, collected as exploratory outcomes from a type III hybrid implementation-effectiveness trial. A clustered, sequential, multiple-assignment randomized trial design was used, which embedded four implementation supports that differentially sequence three implementation strategies, Replicating Effective Programs (REP), Coaching, and Facilitation. Prior to the first randomization, N = 169 SPs from 94 Michigan high schools each identified up to 10 students whom they believed could benefit from CBT and facilitated student survey completion. Changes in students' depression (Patient Health Questionnaire-9, modified for teens) and anxiety symptoms (Generalized Anxiety Disorder-7) over 10 months were compared across the four sequences of implementation support using a generalization of a marginal, weighted least squares approach developed for a clustered SMARTs.

RESULTS

Small, non-clinically significant reductions in symptoms over the study period were found. Pairwise comparisons found no significant differences in symptom change across the four implementation strategies. The difference in the estimated mean PHQ-9T/GAD-7 scores between the least and the most intensive strategies (REP vs. REP+Coaching+Facilitation) was 1.04 (95%CI = -0.95, 3.04) for depression and 0.82 (95%CI = -0.89, 2.52) for anxiety.

DISCUSSION

No difference in symptom change was found across the four implementation strategies. Multiple forms of implementation support may be useful for improving student mental health outcomes.

TRIAL REGISTRATION

NCT03541317-Registered on 29 May 2018 on ClinicalTrials.gov PRS.

A novel rural hospital/clinic-system practice-based research network: the Rural Addiction Implementation Network (RAIN) initiative and its goals, implementation, and early results

Background: Rural and frontier communities face high rates of opioid use disorders (OUDs). In 2021, the Rural Addiction Implementation Network (RAIN) sought to establish a rural hospital/clinic-system practice-based research network (RH-PBRN) to facilitate implementation of evidence-based addiction-related prevention, treatment, and recovery (PTR) services to reduce the morbidity of OUD and substance use disorder (SUD) in rural communities.Objective: To describe the goals and implementation of PTR activities of RAIN, a novel RH-PBRN.Methods: RAIN identified teams of external/internal facilitators at four rural hospitals/clinic-networks to achieve at least 15 PTR activities involving OUD and other SUDs. RAIN utilized an implementation-facilitation approach: facilitators assessed the implementation environment and promoted interventions to overcome barriers to PTR implementation. Other interventions included site visits, community of learning calls, and e-communication. RAIN assessed and recorded facilitators and barriers to implementation, milestone attainment, and outcomes of PTR activities. At 18 months, we queried facilitators about the fidelity and implementation of RAIN activities.Results: RAIN established an HP-PBRN in four sites (Idaho, Montana, Utah, and Wyoming). Within the HP-PBRN, 20 PTR activities were established (p = 7, T = 10, R = 3; range 3-7 per site). Barriers to implementation of PTR activities included competing clinical demands, especially due to COVID-19, lack of dedicated effort for staff at sites, and stigma of addiction and its treatment. Facilitators of implementation included the use of trained expert facilitators and communication between the sites.Conclusions: RAIN implemented 20 addiction-related PTR activities in four rural hospitals/clinic-networks. RAIN's intervention model could be replicated to address addiction-related harms in other rural communities.

Scaling up a brief alcohol intervention to prevent HIV infection in Vietnam: a cluster randomized, implementation trial

BACKGROUND

Evidence-based interventions (EBIs) often address normative behaviors. If a behavior is also common among clinicians, they may be skeptical about the necessity or effectiveness of an EBI. Alternatively, clinicians' attitudes and behaviors may be misaligned, or they may lack the knowledge and self-efficacy to deliver the EBI. Several EBIs address unhealthy alcohol use, a common and often culturally acceptable behavior. But unhealthy alcohol use may be particularly harmful to people with HIV (PWH). Here, we present an implementation trial using an experiential implementation strategy to address clinicians' knowledge, attitudes, and behaviors. Clinicians receive the experiential intervention before they begin delivering an evidence-based brief alcohol intervention (BAI) to PWH with unhealthy alcohol use.

METHODS

Design: In this hybrid type 3 implementation-effectiveness cluster randomized controlled trial, ART clinics (n = 30) will be randomized 1:1 to facilitation, a flexible strategy to address implementation barriers, or facilitation plus the experiential brief alcohol intervention (EBAI). In the EBAI arm, clinicians, irrespective of their alcohol use, will be offered the BAI as experiential learning. EBAI will address clinicians' alcohol-related attitudes and behaviors and increase their knowledge and confidence to deliver the BAI.

PARTICIPANTS

ART clinic staff will be enrolled and assessed at pre-BAI training, post-BAI training, 3, 12, and 24 months. All PWH at the ART clinics who screen positive for unhealthy alcohol use will be offered the BAI. A subset of PWH (n = 810) will be enrolled and assessed at baseline, 3, and 12 months.

OUTCOMES

We will compare implementation outcomes (acceptability, fidelity, penetration, costs, and sustainability) and effectiveness outcomes (viral suppression and alcohol use) between the two arms. We will assess the impact of site-level characteristics on scaling-up the BAI. We will also evaluate how experiencing the BAI affected clinical staff's alcohol use and clinic-level alcohol expectations in the EBAI arm.

DISCUSSION

This trial contributes to implementation science by testing a novel strategy to implement a behavior change intervention in a setting in which clinicians themselves may engage in the behavior. Experiential learning may be useful to address normative and difficult to change lifestyle behaviors that contribute to chronic diseases.

TRIAL REGISTRATION

NCT06358885 (04/10/2024), https://clinicaltrials.gov/study/NCT06358885 .

Adaptive Designs in Implementation Science and Practice: Their Promise and the Need for Greater Understanding and Improved Communication

The promise of adaptation and adaptive designs in implementation science has been hindered by the lack of clarity and precision in defining what it means to adapt, especially regarding the distinction between adaptive study designs and adaptive implementation strategies. To ensure a common language for science and practice, authors reviewed the implementation science literature and found that the term adaptive was used to describe interventions, implementation strategies, and trial designs. To provide clarity and offer recommendations for reporting and strengthening study design, we propose a taxonomy that describes fixed versus adaptive implementation strategies and implementation trial designs. To improve impact, (a) futureimplementation studies should prespecify implementation strategy core functions that in turn can be taught to and replicated by health system/community partners, (b) funders should support exploratory studies that refine and specify implementation strategies, and (c) investigators should systematically address design requirements and ethical considerations (e.g., randomization, blinding/masking) with health system/community partners.

Stakeholder and Equity Data-Driven Implementation: a Mixed Methods Pilot Feasibility Study

We conducted a mixed methods pilot feasibility study of a Stakeholder and Equity Data-Driven Implementation (SEDDI) process to facilitate using healthcare data to identify patient groups experiencing gaps in the use of evidence-based interventions (EBIs) and rapidly adapt EBIs to achieve greater access and equitable outcomes. We evaluated the feasibility and acceptability of SEDDI in a pilot hybrid type 2 effectiveness-implementation trial of a paired colorectal cancer (CRC) and social needs screening intervention at four federally qualified community health centers (CHCs). An external facilitator partnered with CHC teams to support initial implementation, followed by the SEDDI phase focused on advancing health equity. Facilitation sessions were delivered over 8 months. Preliminary evaluation of SEDDI involved convergent mixed methods with quantitative survey and focus group data. CHCs used data to identify gaps in outreach and completion of CRC screening with respect to race/ethnicity, gender, age, and language. Adaptations to improve access and use of the intervention included cultural, linguistic, and health literacy tailoring. CHC teams reported that facilitation and systematic review of data were helpful in identifying and prioritizing gaps. None of the four CHCs completed rapid cycle testing of adaptations largely due to competing priorities during the COVID-19 response. SEDDI has the potential for advancing chronic disease prevention and management by providing a stakeholder and data-driven approach to identify and prioritize health equity targets and guide adaptations to improve health equity. ClinicalTrials.gov Identifier: NCT04585919.

Calculating power for multilevel implementation trials in mental health: Meaningful effect sizes, intraclass correlation coefficients, and proportions of variance explained by covariates

Background

Despite the ubiquity of multilevel sampling, design, and analysis in mental health implementation trials, few resources are available that provide reference values of design parameters (e.g., effect size, intraclass correlation coefficient [ICC], and proportion of variance explained by covariates [covariate R 2]) needed to accurately determine sample size. The aim of this study was to provide empirical reference values for these parameters by aggregating data on implementation and clinical outcomes from multilevel implementation trials, including cluster randomized trials and individually randomized repeated measures trials, in mental health. The compendium of design parameters presented here represents plausible values that implementation scientists can use to guide sample size calculations for future trials.

Method

We searched NIH RePORTER for all federally funded, multilevel implementation trials addressing mental health populations and settings from 2010 to 2020. For all continuous and binary implementation and clinical outcomes included in eligible trials, we generated values of effect size, ICC, and covariate R2 at each level via secondary analysis of trial data or via extraction of estimates from analyses in published research reports. Effect sizes were calculated as Cohen d; ICCs were generated via one-way random effects ANOVAs; covariate R2 estimates were calculated using the reduction in variance approach.

Results

Seventeen trials were eligible, reporting on 53 implementation and clinical outcomes and 81 contrasts between implementation conditions. Tables of effect size, ICC, and covariate R2 are provided to guide implementation researchers in power analyses for designing multilevel implementation trials in mental health settings, including two- and three-level cluster randomized designs and unit-randomized repeated-measures designs.

Conclusions

Researchers can use the empirical reference values reported in this study to develop meaningful sample size determinations for multilevel implementation trials in mental health. Discussion focuses on the application of the reference values reported in this study.

Using the Matrixed Multiple Case Study approach to identify factors affecting the uptake of IPV screening programs following the use of implementation facilitation

BACKGROUND

Intimate partner violence (IPV) is a prevalent social determinant of health. The US Preventive Services Task Force recommends routine IPV screening of women, but uptake remains variable. The Veterans Health Administration (VHA) initiated implementation facilitation (IF) to support integration of IPV screening programs into primary care clinics. An evaluation of IF efforts showed variability in IPV screening rates across sites. The follow-up study presented here used a Matrixed Multiple Case Study (MMCS) approach to examine the multilevel factors impacting IPV screening program implementation across sites with varying levels of implementation success.

METHODS

This mixed methods study is part of a larger cluster randomized stepped wedge Hybrid-II program evaluation. In the larger trial, participating sites received 6 months of IF consisting of an external facilitator from VHA's Office of Women's Health working closely with an internal facilitator and key site personnel. Recognizing the heterogeneity in implementation outcomes across sites, the MMCS approach was used to enable interpretation of qualitative and quantitative data within and across sites to help contextualize the primary findings from the larger study. Qualitative data collection was guided by the integrated Promoting Action on Research Implementation in Health Services (i-PARIHS) framework and included interviews with key informants involved in IPV screening implementation at eight sites. Quantitative data on IPV screening uptake was derived from medical records and surveys completed by key personnel at the same eight sites to understand implementation facilitation activities.

RESULTS

Fifteen factors influencing IPV screening implementation spanning all four i-PARIHS domains were identified and categorized into three distinct categories: (1) factors with enabling influence across all sites, (2) factors deemed important to implementation success, and (3) factors differentiating sites with high/medium versus low implementation success.

CONCLUSIONS

Understanding the influencing factors across multi-level domains contributing to variable success of IPV screening implementation can inform the tailoring of IF efforts to promote spread and quality of screening. Implementation of IPV screening programs in primary care with IF should consider consistent engagement of internal facilitators with clinic staff involved in implementation, the resourcefulness of external facilitators, and appending resources to IPV screening tools to help key personnel address positive screens.

TRIAL REGISTRATION

ClinicalTrials.gov NCT04106193. Registered on September 26, 2019.

How does facilitation in healthcare work? Using mechanism mapping to illuminate the black box of a meta-implementation strategy

BACKGROUND

Healthcare facilitation, an implementation strategy designed to improve the uptake of effective clinical innovations in routine practice, has produced promising yet mixed results in randomized implementation trials and has not been fully researched across different contexts.

OBJECTIVE

Using mechanism mapping, which applies directed acyclic graphs that decompose an effect of interest into hypothesized causal steps and mechanisms, we propose a more concrete description of how healthcare facilitation works to inform its further study as a meta-implementation strategy.

METHODS

Using a modified Delphi consensus process, co-authors developed the mechanistic map based on a three-step process. First, they developed an initial logic model by collectively reviewing the literature and identifying the most relevant studies of healthcare facilitation components and mechanisms to date. Second, they applied the logic model to write vignettes describing how facilitation worked (or did not) based on recent empirical trials that were selected via consensus for inclusion and diversity in contextual settings (US, international sites). Finally, the mechanistic map was created based on the collective findings from the vignettes.

FINDINGS

Theory-based healthcare facilitation components informing the mechanistic map included staff engagement, role clarification, coalition-building through peer experiences and identifying champions, capacity-building through problem solving barriers, and organizational ownership of the implementation process. Across the vignettes, engagement of leaders and practitioners led to increased socialization of the facilitator's role in the organization. This in turn led to clarifying of roles and responsibilities among practitioners and identifying peer experiences led to increased coherence and sense-making of the value of adopting effective innovations. Increased trust develops across leadership and practitioners through expanded capacity in adoption of the effective innovation by identifying opportunities that mitigated barriers to practice change. Finally, these mechanisms led to eventual normalization and ownership of the effective innovation and healthcare facilitation process.

IMPACT

Mapping methodology provides a novel perspective of mechanisms of healthcare facilitation, notably how sensemaking, trust, and normalization contribute to quality improvement. This method may also enable more efficient and impactful hypothesis-testing and application of complex implementation strategies, with high relevance for lower-resourced settings, to inform effective innovation uptake.

Facilitation as a component of evidence implementation: a multinational perspective

BACKGROUND

Facilitation is a key component of JBI's approach to evidence implementation along with context analysis and evaluation of process and outcomes. Although the role of facilitation is recognized as a critical component of evidence implementation, what constitutes effective facilitation is poorly understood.

AIM

This article presents a descriptive exploration of facilitation as it occurs in evidence implementation initiatives conducted in various healthcare and geographical contexts. All projects used the JBI approach to evidence implementation.

METHODS

To provide a multinational perspective on how facilitation was operationalized to promote positive changes in clinical practice and health outcomes, five case studies of evidence implementation projects are presented.

RESULTS

The cases highlighted that facilitation is a multifaceted process that can be met through a variety of roles that address aspects of education and capacity building, partnerships, action planning, problem solving and evaluation. Facilitation in all cases appeared to be collaborative, with multiple 'players' within and outside of the health organization being involved in the process. Although there are similarities in activities, facilitation involved some level of local contextualization where there were unique or additional activities performed to accommodate the local needs and requirements of the health organization involved in each case. Numerous contextual factors influenced the success of the implementation initiative.

CONCLUSION

The cases emphasized the complex nature of facilitation as a strategy for evidence implementation, indicating that contextual attributes and features define the range of knowledge, skills, and activities that should take place in order for facilitation to be effective. Although there appears to be some core components, tailoring and adaptation of the facilitation process (or roles) is required.

Primary aim results of a clustered SMART for developing a school-level, adaptive implementation strategy to support CBT delivery at high schools in Michigan

BACKGROUND

Schools increasingly provide mental health services to students, but often lack access to implementation strategies to support school-based (and school professional [SP]) delivery of evidence-based practices. Given substantial heterogeneity in implementation barriers across schools, development of adaptive implementation strategies that guide which implementation strategies to provide to which schools and when may be necessary to support scale-up.

METHODS

A clustered, sequential, multiple-assignment randomized trial (SMART) of high schools across Michigan was used to inform the development of a school-level adaptive implementation strategy for supporting SP-delivered cognitive behavioral therapy (CBT). All schools were first provided with implementation support informed by Replicating Effective Programs (REP) and then were randomized to add in-person Coaching or not (phase 1). After 8 weeks, schools were assessed for response based on SP-reported frequency of CBT delivered to students and/or barriers reported. Responder schools continued with phase 1 implementation strategies. Slower-responder schools (not providing ≥ 3 CBT components to ≥10 students or >2 organizational barriers identified) were re-randomized to add Facilitation to current support or not (phase 2). The primary aim hypothesis was that SPs at schools receiving the REP + Coaching + Facilitation adaptive implementation strategy would deliver more CBT sessions than SPs at schools receiving REP alone. Secondary aims compared four implementation strategies (Coaching vs no Coaching × Facilitation vs no Facilitation) on CBT sessions delivered, including by type (group, brief and full individual). Analyses used a marginal, weighted least squares approach developed for clustered SMARTs.

RESULTS

SPs (n = 169) at 94 high schools entered the study. N = 83 schools (88%) were slower-responders after phase 1. Contrary to the primary aim hypothesis, there was no evidence of a significant difference in CBT sessions delivered between REP + Coaching + Facilitation and REP alone (111.4 vs. 121.1 average total CBT sessions; p = 0.63). In secondary analyses, the adaptive strategy that offered REP + Facilitation resulted in the highest average CBT delivery (154.1 sessions) and the non-adaptive strategy offering REP + Coaching the lowest (94.5 sessions).

CONCLUSIONS

The most effective strategy in terms of average SP-reported CBT delivery is the adaptive implementation strategy that (i) begins with REP, (ii) augments with Facilitation for slower-responder schools (schools where SPs identified organizational barriers or struggled to deliver CBT), and (iii) stays the course with REP for responder schools.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT03541317 , May 30, 2018.

Care managers' experiences in a collaborative care program for the treatment of bipolar disorder and PTSD in underserved communities

OBJECTIVES

To understand care managers' experiences treating primary care patients with bipolar disorder and PTSD in a telepsychiatry collaborative care (TCC) program, as part of a large pragmatic trial.

METHODS

We conducted individual qualitative interviews with 12 care managers to evaluate barriers and facilitators to implementation of a previously completed TCC intervention for patients with bipolar disorder and/or PTSD. We used directed and conventional content analysis and Consolidated Framework for Implementation Research (CFIR) constructs to organize care manager experiences.

RESULTS

Participants described clinical and medication management support from telepsychiatrists and satisfaction with the TCC model as facilitators of success for patients with bipolar disorder and PTSD in underserved communities. Participants also described onboarding of primary care providers and clinic leadership as keys to successful team-care and credited satisfaction with providing Behavioral Activation as essential to sustained delivery of the psychotherapy component of TCC.

CONCLUSIONS

Participants described high satisfaction with TCC for patients with bipolar disorder and PTSD. Challenges included lack of clinic leadership and PCP engagement. Early and ongoing promotion of integrated care and prioritizing telepsychiatry consultation with patients, behavioral health professionals and PCPs, may improve patient care, provide ongoing training and improve workforce satisfaction.

Care team and practice-level implementation strategies to optimize pediatric collaborative care: study protocol for a cluster-randomized hybrid type III trial

BACKGROUND

Implementation facilitation is an effective strategy to support the implementation of evidence-based practices (EBPs), but our understanding of multilevel strategies and the mechanisms of change within the "black box" of implementation facilitation is limited. This implementation trial seeks to disentangle and evaluate the effects of facilitation strategies that separately target the care team and leadership levels on implementation of a collaborative care model in pediatric primary care. Strategies targeting the provider care team (TEAM) should engage team-level mechanisms, and strategies targeting leaders (LEAD) should engage organizational mechanisms.

METHODS

We will conduct a hybrid type 3 effectiveness-implementation trial in a 2 × 2 factorial design to evaluate the main and interactive effects of TEAM and LEAD and test for mediation and moderation of effects. Twenty-four pediatric primary care practices will receive standard REP training to implement Doctor-Office Collaborative Care (DOCC) and then be randomized to (1) Standard REP only, (2) TEAM, (3) LEAD, or (4) TEAM + LEAD. Implementation outcomes are DOCC service delivery and change in practice-level care management competencies. Clinical outcomes are child symptom severity and quality of life.

DISCUSSION

This statewide trial is one of the first to test the unique and synergistic effects of implementation strategies targeting care teams and practice leadership. It will advance our knowledge of effective care team and practice-level implementation strategies and mechanisms of change. Findings will support efforts to improve common child behavioral health conditions by optimizing scale-up and sustainment of CCMs in a pediatric patient-centered medical home.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT04946253 . Registered June 30, 2021.

A peek behind the curtain: exploring coaching styles within the implementation and sustainment facilitation (ISF) strategy in the substance abuse treatment to HIV care study

BACKGROUND

The Grasha-Riechmann teaching styles, which includes three didactic and two prescriptive styles, have been shown to help enhance learning within educational settings. Although an adaption of the Grasha-Riechmann style classification has enabled coaching styles to be identified for use as part of quality improvement (QI) initiatives, research has not examined the styles actually utilized by coaches within a QI initiative or how the styles change overtime when the coach is guiding an organization through change implementation. Interactions between coaches and HIV service organization (HSO) staff participating in a large implementation research experiment called the Substance Abuse Treatment to HIV care (SAT2HIV) Project were evaluated to begin building an evidence base to address this gap in implementation research.

METHODS

Implementation & Sustainment Facilitation (ISF) Strategy meetings (n = 137) between coaches and HSO staff were recorded and professionally transcribed. Thematic coding classifications were developed from the Grasha-Riechmann framework and applied to a purposively selected sample of transcripts (n = 66). Four coders independently coded transcripts using NVivo to facilitate text identification, organization, and retrieval for analysis. Coaching style use and changes across the three ISF phases were explored.

RESULTS

Facilitator and formal authority were the two coaching styles predominately used. Facilitator sub-themes shifted from asking questions and providing support to supporting independent action over time. Coaches' use of formal authority sub-styles shifted notably across time from setting expectations or ensuring preparation to offering affirmation or feedback about changes that the HSO's were implementing. The use of the delegator or personal model coaching styles occurred infrequently.

CONCLUSIONS

The current research extends implementation research's understanding of coaching. More specifically, findings indicate it is feasible to use the Grasha-Riechmann framework to qualitatively identify coaching styles utilized in a facilitation-based implementation strategy. More importantly, results provide insights into how different coaching styles were utilized to implement an evidence-based practice. Further research is needed to examine how coaching styles differ by organization, impact implementation fidelity, and influence both implementation outcomes and client outcomes.

TRIAL REGISTRATION

ClinicalTrials.gov NCT02495402 . Registered on July 6, 2015.

The Life Goals Self-Management Mobile App for Bipolar Disorder: Consumer Feasibility, Usability, and Acceptability Study

Background

Life Goals is an evidence-based self-management intervention that assists individuals with bipolar disorder (BD) by aligning BD symptom coping strategies with their personal goals. The intervention can be availed via in-person and telephonic sessions, and it has been recently developed as an individualized, customizable mobile app.

Objective

We examined the feasibility, usability, and acceptability of the Life Goals self-management app among individuals diagnosed with BD who used the app for up to 6 months.

Methods

A total of 28 individuals with BD used the Life Goals app on their personal smartphone for 6 months. They completed key clinical outcome measurements of functioning, disability, and psychiatric symptoms at baseline, 3 months, and 6 months, in addition to a poststudy survey about usability and satisfaction.

Results

Participants used the app for a median of 25 times (IQR 13-65.75), and for a longer time during the first 3 months of the study. The modules on depression and anxiety were the most frequently used, accounting for 35% and 22% of total usage, respectively. Overall, the study participants found the app useful (15/25, 60%) and easy to use (18/25, 72%), and they reported that the screen displayed the material adequately (22/25, 88%). However, less than half of the participants found the app helpful in managing their health (10/25, 40%) or in making progress on their wellness goals (9/25, 36%). Clinical outcomes showed a trend for improvements in mental and physical health and mania-related well-being.

Conclusions

The Life Goals app showed feasibility of use among individuals with BD. Higher user engagement was observed in the initial 3 months with users interested more frequently in the mood modules than other wellness modules. Participants reported acceptability with the ease of app use and satisfaction with the app user interface, but the app showed low success in encouraging self-management within this small sample. The Life Goals app is a mobile health technology that can provide individuals with serious mental illness with more flexible access to evidence-based treatments.

Multi-tiered external facilitation: the role of feedback loops and tailored interventions in supporting change in a stepped-wedge implementation trial

BACKGROUND

Facilitation is a complex, relational implementation strategy that guides change processes. Facilitators engage in multiple activities and tailor efforts to local contexts. How this work is coordinated and shared among multiple, external actors and the contextual factors that prompt and moderate facilitators to tailor activities have not been well-described.

METHODS

We conducted a mixed methods evaluation of a trial to improve the quality of transient ischemic attack care. Six sites in the Veterans Health Administration received external facilitation (EF) before and during a 1-year active implementation period. We examined how EF was employed and activated. Data analysis included prospective logs of facilitator correspondence with sites (160 site-directed episodes), stakeholder interviews (a total of 78 interviews, involving 42 unique individuals), and collaborative call debriefs (n=22) spanning implementation stages. Logs were descriptively analyzed across facilitators, sites, time periods, and activity types. Interview transcripts were coded for content related to EF and themes were identified. Debriefs were reviewed to identify instances of and utilization of EF during site critical junctures.

RESULTS

Multi-tiered EF was supported by two groups (site-facing quality improvement [QI] facilitators and the implementation support team) that were connected by feedback loops. Each site received an average of 24 episodes of site-directed EF; most of the EF was delivered by the QI nurse. For each site, site-directed EF frequently involved networking (45%), preparation and planning (44%), process monitoring (44%), and/or education (36%). EF less commonly involved audit and feedback (20%), brainstorming solutions (16%), and/or stakeholder engagement (5%). However, site-directed EF varied widely across sites and time periods in terms of these facilitation types. Site participants recognized the responsiveness of the QI nurse and valued her problem-solving, feedback, and accountability support. External facilitators used monitoring and dialogue to intervene by facilitating redirection during challenging periods of uncertainty about project direction and feasibility for sites. External facilitators, in collaboration with the implementation support team, successfully used strategies tailored to diverse local contexts, including networking, providing data, and brainstorming solutions.

CONCLUSIONS

Multi-tiered facilitation capitalizing on emergent feedback loops allowed for tailored, site-directed facilitation. Critical juncture cases illustrate the complexity of EF and the need to often try multiple strategies in combination to facilitate implementation progress.

TRIAL REGISTRATION

The Protocol-guided Rapid Evaluation of Veterans Experiencing New Transient Neurological Symptoms (PREVENT) is a registered trial ( NCT02769338 ), May 11, 2016-prospectively registered.

Comparative effectiveness of external vs blended facilitation on collaborative care model implementation in slow-implementer community practices

OBJECTIVE

To evaluate the comparative effectiveness of external facilitation (EF) vs external + internal facilitation (EF/IF), on uptake of a collaborative chronic care model (CCM) in community practices that were slower to implement under low-level implementation support.

STUDY SETTING

Primary data were collected from 43 community practices in Michigan and Colorado at baseline and for 12 months following randomization.

STUDY DESIGN

Sites that failed to meet a pre-established implementation benchmark after six months of low-level implementation support were randomized to add either EF or EF/IF support for up to 12 months. Key outcomes were change in number of patients receiving the CCM and number of patients receiving a clinically significant dose of the CCM. Moderators' analyses further examined whether comparative effectiveness was dependent on prerandomization adoption, number of providers trained or practice size. Facilitation log data were used for exploratory follow-up analyses.

DATA COLLECTION

Sites reported monthly on number of patients that had received the CCM. Facilitation logs were completed by study EF and site IFs and shared with the study team.

PRINCIPAL FINDINGS

N = 21 sites were randomized to EF and 22 to EF/IF. Overall, EF/IF practices saw more uptake than EF sites after 12 months (Δ_EF/IF-EF  = 4.4 patients, 95% CI = 1.87-6.87). Moderators' analyses, however, revealed that it was only sites with no prerandomization uptake of the CCM (nonadopter sites) that saw significantly more benefit from EF/IF (Δ_EF/IF-EF  = 9.2 patients, 95% CI: 5.72, 12.63). For sites with prerandomization uptake (adopter sites), EF/IF offered no additional benefit (Δ_EF/IF-EF  = -0.9; 95% CI: -4.40, 2.60). Number of providers trained and practice size were not significant moderators.

CONCLUSIONS

Although stepping up to the more intensive EF/IF did outperform EF overall, its benefit was limited to sites that failed to deliver any CCM under the low-level strategy. Once one or more providers were delivering the CCM, additional on-site personnel did not appear to add value to the implementation effort.