Adapting Coordinated Anxiety Learning and Management for Veterans Affairs Community-Based Outpatient Clinics: Iterative Approach

Evidence-Based Intervention Adaptations Within the Veterans Health Administration: a Scoping Review

BACKGROUND

Veterans receiving care within the Veterans Health Administration (VA) are a unique population with distinctive cultural traits and healthcare needs compared to the civilian population. Modifications to evidence-based interventions (EBIs) developed outside of the VA may be useful to adapt care to the VA healthcare system context or to specific cultural norms among veterans. We sought to understand how EBIs have been modified for veterans and whether adaptations were feasible and acceptable to veteran populations.

METHODS

We conducted a scoping review of EBI adaptations occurring within the VA at any time prior to June 2021. Eligible articles were those where study populations included veterans in VA care, EBIs were clearly defined, and there was a comprehensive description of the EBI adaptation from its original context. Data was summarized by the components of the Framework for Reporting Adaptations and Modifications to Evidence-based interventions (FRAME).

FINDINGS

We retrieved 922 abstracts based on our search terms. Following review of titles and abstracts, 49 articles remained for full-text review; eleven of these articles (22%) met all inclusion criteria. EBIs were adapted for mental health (n = 4), access to care and/or care delivery (n = 3), diabetes prevention (n = 2), substance use (n = 2), weight management (n = 1), care specific to cancer survivors (n = 1), and/or to reduce criminal recidivism among veterans (n = 1). All articles used qualitative feedback (e.g., interviews or focus groups) with participants to inform adaptations. The majority of studies (55%) were modified in the pre-implementation, planning, or pilot phases, and all were planned proactive adaptations to EBIs.

IMPLICATIONS FOR D&I RESEARCH

The reviewed articles used a variety of methods and frameworks to guide EBI adaptations for veterans receiving VA care. There is an opportunity to continue to expand the use of EBI adaptations to meet the specific needs of veteran populations.

Human-Centered Design Approaches in Digital Mental Health Interventions: Exploratory Mapping Review

BACKGROUND

Digital mental health interventions have a great potential to alleviate mental illness and increase access to care. However, these technologies face significant challenges, especially in terms of user engagement and adoption. It has been suggested that this issue stems from a lack of user perspective in the development process; accordingly, several human-centered design approaches have been developed over the years to consider this important aspect. Yet, few human-centered design approaches to digital solutions exist in the field of mental health, and rarely are end users involved in their development.

OBJECTIVE

The main objective of this literature review is to understand how human-centered design is considered in e-mental health intervention research.

METHODS

An exploratory mapping review was conducted of mental health journals with the explicit scope of covering e-mental health technology. The human-centered design approaches reported and the core elements of design activity (ie, object, context, design process, and actors involved) were examined among the eligible studies.

RESULTS

A total of 30 studies met the inclusion criteria, of which 22 mentioned using human-centered design approaches or specific design methods in the development of an e-mental health solution. Reported approaches were classified as participatory design (11/27, 41%), codesign (6/27, 22%), user-centered design (5/27, 19%), or a specific design method (5/27, 19%). Just over half (15/27, 56%) of the approaches mentioned were supported by references. End users were involved in each study to some extent but not necessarily in designing. About 27% (8/30) of all the included studies explicitly mentioned the presence of designers on their team.

CONCLUSIONS

Our results show that some attempts have indeed been made to integrate human-centered design approaches into digital mental health technology development. However, these attempts rely very little on designers and design research. Researchers from other domains and technology developers would be wise to learn the underpinnings of human-centered design methods before selecting one over another. Inviting designers for assistance when implementing a particular approach would also be beneficial. To further motivate interest in and use of human-centered design principles in the world of e-mental health, we make nine suggestions for better reporting of human-centered design approaches in future research.

A randomized controlled trial comparing a manual and computer version of CALM in VA community-based outpatient clinics

Background:

This study compared a computer and manual version of a tailored Coordinated Anxiety Learning and Management (VA CALM) protocol on provider fidelity to CBT and patient outcomes.

Methods:

This study was a cluster randomized controlled trial. Providers (N = 32) were randomized to deliver VA CALM by computer or manual. Veteran patients (N = 135), treated by study providers, were recruited. The primary outcome was CBT fidelity, measured by rating audiotaped sessions. Secondary outcomes were Veterans’ general (BSI-18 GSI, SF-12) and disorder-specific (GAD-7, PCL-5, PHQ-9) outcomes assessed at baseline, three and six month follow-up.

Results:

We found a large (d = 0.88) but not statistically significant difference in mean fidelity rating scores between conditions. Compared with the manual, participants with generalized anxiety disorder receiving VA CALM by computer reported lower GAD-7 scores at three (−5.88; 95% CI=−11.37, −0.39) and six month (−5.25; 95% CI=−10.29, −0.22) follow-ups (d = 0.37 to 0.55). Participants in the computer and manual conditions reported lower PHQ-9 (−3.11; 95% CI=−5.51, −0.71; −4.06; 95% CI=−7.22, −0.90, respectively) and BSI-18 GSI (0.78; 95% CI=0.68,0.90; 0.71; 95% CI=0.58, 0.87, respectively) scores from baseline to six month follow-up. We did not find statistically significant differences over time or between conditions on SF-12 or PCL-5 scores.

Limitations:

This study was underpowered to test the primary outcome. Small samples sizes in the disorder-specific subgroup analysis may limit the generalizability of findings.

Conclusions:

Neither modality proved to be superior on VA CALM fidelity. The computer version of VA CALM, compared to the manual, may provide modest benefit to Veterans with GAD.

Factors Affecting Adoption of Coordinated Anxiety Learning and Management (CALM) in Veterans' Affairs Community-Based Outpatient Clinics

PURPOSE

Many US military veterans experience anxiety, depression, and trauma-related disorders. A major goal of the Veterans Health Administration (VHA) has been to increase access to evidence-based psychotherapies (EBPs) such as cognitive-behavioral therapy to address veterans' substantial health burden. However, despite widespread implementation of EBPs throughout the VHA, smaller clinics that often serve rural veterans face barriers to delivering these interventions. The Veterans Affairs Coordinated Anxiety Learning and Management (VA CALM) program aims to empower providers in rural areas with varying levels of training and experience in delivering EBPs to provide high-quality cognitive-behavioral therapy for anxiety, depression, and trauma-related disorders. The goal of this study was to better understand, through qualitative interviews, VHA community-based outpatient clinic providers' perspectives on implementing VA CALM.

METHODS

Qualitative interviews with providers (N = 22) were conducted to understand implementation of VA CALM. Template analysis was used to organize and summarize responses.

FINDINGS

Providers noted several facilitators for implementing VA CALM in rural community clinics, including its perceived effectiveness, broad applicability, and structure. Barriers to implementation included scheduling problems and patient-related barriers.

CONCLUSIONS

Incorporating providers' perspectives on factors that affect implementing cognitive-behavioral therapy in this setting may inform future efforts to disseminate-implement EBPs in smaller, more remote VHA clinics.

From "Step Away" to "Stand Down": Tailoring a Smartphone App for Self-Management of Hazardous Drinking for Veterans

BACKGROUND

US military veterans who screen positive for hazardous drinking during primary care visits may benefit from a mobile app. Step Away is an evidence-based mobile intervention system for the self-management of hazardous drinking. However, Step Away was not designed for veterans, and differences between veterans and civilians could limit the reach and effectiveness of the app with this population.

OBJECTIVE

The primary objective of this study was to repurpose Step Away to address the needs and preferences of the veteran primary care population. The Method for Program Adaptation through Community Engagement (M-PACE) model was used to guide the adaptation process. This model can serve as a generalizable approach that other researchers and intervention developers can follow to systematically tailor mobile health tools for a new population.

METHODS

Veteran patients who screened positive for hazardous drinking during a primary care visit (n=12) and peer providers employed by the US Veterans Health Administration (n=11) were recruited to systematically review Step Away and provide feedback on its content and presentation via Web-based surveys and a semistructured interview. Participant feedback was reviewed through an iterative process by key stakeholders who adjudicated which suggested modifications to the app could enhance engagement and effectiveness with veterans while maintaining program integrity.

RESULTS

Usability ratings of the individual modules of Step Away were uniformly positive across patients and peers, as was the perceived utility of the app overall. Personalized feedback on the health consequences and costs of drinking, options for customization, and the measurement-based care capabilities of the app were viewed as facilitators of engagement. Conversely, lengthy text, small font, and a lack of interactive features were viewed as potential barriers with the older primary care population. Modifications to create a veteran version of the app (Stand Down: Think Before You Drink) included altering the appearance of the app to incorporate more veteran-centric content, adding links and options for resources and activities for veterans, and reducing the amount of text and adding veteran-specific references and common concerns and triggers for drinking in this population.

CONCLUSIONS

The M-PACE model provided a systematic approach to repurpose Step Away to fit the needs and preferences of veteran primary care patients who engage in hazardous drinking. Stand Down may serve as an innovative, low-cost means of expanding access to care for veterans who engage in hazardous drinking.

An Evidence-Based Model for Disseminating-Implementing Coordinated Anxiety Learning and Management in Department of Veterans Affairs' Community-Based Outpatient Clinics

PURPOSE

To explore the feasibility and utility of using a workshop, and supervision-consultation plus external facilitation to disseminate and implement cognitive-behavioral therapy in Veterans Affairs (VA) community-based outpatient clinics (CBOCs).

METHODS

This study occurred in the context of a randomized controlled trial aimed at comparing 2 methods for implementing Coordinated Anxiety Learning Management (CALM) in VA CBOCs. A 3-phase (workshop, supervision-consultation, external facilitation) model was used to support 32 VA CBOC mental health providers in learning and adopting CALM in their clinical practice. Qualitative data describe training activities and the feasibility and utility of each training phase in addressing challenges to adopting CALM.

FINDINGS

All 3 phases of the model were feasible to use with our sample of CBOC mental health providers. Providers reported challenges learning CALM during the workshop and concerns about not having enough training post-workshop to use CALM in practice. Providers primarily utilized supervision-consultation to tailor CALM to their practice, including learning how to prioritize a target disorder, "switch" the focus of treatment to a different disorder when comorbidities were present, and modify CALM sessions to fit shorter treatment visits. Providers primarily utilized external facilitation to further tailor CALM to their practice through implementation (eg, concrete help) and support-oriented help. Key lessons for implementing CALM in CBOCs are presented and discussed.

CONCLUSIONS

Findings provide initial evidence for the feasibility and utility of using each component of a facilitation-enhanced training model to promote CBOC VA providers' implementation of a computer and manual version of CALM in their practice.