Assessing fidelity of cognitive behavioral therapy in rural VA clinics: design of a randomized implementation effectiveness (hybrid type III) trial

Supporting physical activity for mobility in older adults with mobility limitations (SuPA Mobility): study protocol for a randomized controlled trial

BACKGROUND

Limited mobility in older adults consistently predicts both morbidity and mortality. As individuals age, the rates of mobility disability increase from 1.0% in people aged 15-24 to 20.6% in adults over 65 years of age. Physical activity can effectively improve mobility in older adults, yet many older adults do not engage in sufficient physical activity. Evidence shows that increasing physical activity by 50 min of moderate intensity physical activity in sedentary older adults with mobility limitations can improve mobility and reduce the incidence of mobility disability. To maximize the healthy life span of older adults, it is necessary to find effective and efficient interventions that can be delivered widely to prevent mobility limitations, increase physical activity participation, and improve quality of life in older adults. We propose a randomized controlled trial to assess the effect of a physical activity health coaching intervention on mobility in older adults with mobility limitations.

METHODS

This randomized controlled trial among 290 (145 per group) community-dwelling older adults with mobility limitations, aged 70-89 years old, will compare the effect of a physical activity health coaching intervention versus a general healthy aging education program on mobility, as assessed with the Short Physical Performance Battery. The physical activity health coaching intervention will be delivered by exercise individuals who are trained in Brief Action Planning. The coaches will use evidence-based behavior change techniques including goal-setting, action planning, self-monitoring, and feedback to improve participation in physical activity by a known dose of 50 min per week. There will be a total of 9 health coaching or education sessions delivered over 26 weeks with a subsequent 26-week follow-up period, wherein both groups will receive the same duration and frequency of study visits and activities.

DISCUSSION

The consequences of limited mobility pose a significant burden on the quality of life of older adults. Our trial is novel in that it investigates implementing a dose of physical activity that is known to improve mobility in older adults utilizing a health coaching intervention.

TRIAL REGISTRATION

ClinicalTrials.gov Protocol Registration System: NCT05978336; registered on 28 July 2023.

Developing a method to assess fidelity to a complex vocational rehabilitation intervention in the FRESH trial: a feasibility study

BACKGROUND

Determining whether complex rehabilitation interventions are delivered with fidelity is important. Implementation fidelity can differ between sites, therapists delivering interventions and, over time, threatening trial outcomes and increasing the risk of type II and III errors. This study aimed to develop a method of assessing occupational therapists' fidelity to deliver a complex, individually tailored vocational rehabilitation (VR) intervention to people with traumatic brain injury (TBI) and assess the feasibility of its use in a randomised controlled trial.

METHODS

Using mixed methods and drawing on the intervention logic model, we developed data collection tools to measure fidelity to early specialist TBI VR (ESTVR). Fidelity was measured quantitatively using intervention case report forms (CRF), fidelity checklists and clinical records. Qualitative data from mentoring records, interviews with intervention therapists, participants with TBI, employers and NHS staff at trial sites explored moderators of implementation fidelity. The conceptual framework of implementation fidelity (CFIF) guided measurement and analysis of and factors affecting fidelity. Data were triangulated and benchmarked against an earlier cohort study.

RESULTS

Fidelity to a complex individually tailored VR intervention could be measured. Overall, OTs delivered ESTVR with fidelity. Different fidelity measures answered different questions, offering unique insights into fidelity. Fidelity was best assessed using a fidelity checklist, intervention CRFs and clinical notes. The OT clinical notes and mentoring records were best at identifying fidelity moderating factors. Interviews added little insight into fidelity moderating factors over and above mentoring or clinical records. Data triangulation offered a comprehensive assessment of fidelity, highlighting limitations of measurement methods and learning for future trials but was resource intensive. Interviews, fidelity visits and analysing clinical notes were also resource intense. Comparing fidelity data to a benchmark and using CFIF as a framework for organising the fidelity assessment helped.

CONCLUSIONS

OTs delivered the VR intervention with fidelity. A fidelity checklist and benchmark plus mentoring may offer a practical and effective way of measuring fidelity and identifying fidelity moderating factors in trials of complex individually-tailored rehabilitation interventions. Mentoring provided real-time indicators of and reasons for fidelity deviations. These methods require further evaluation.

TRIAL REGISTRATION

ISRCTN Registry, ISRCTN38581822 (Registered: 02/01/2014).

A randomized controlled trial comparing a manual and computer version of CALM in VA community-based outpatient clinics

Background:

This study compared a computer and manual version of a tailored Coordinated Anxiety Learning and Management (VA CALM) protocol on provider fidelity to CBT and patient outcomes.

Methods:

This study was a cluster randomized controlled trial. Providers (N = 32) were randomized to deliver VA CALM by computer or manual. Veteran patients (N = 135), treated by study providers, were recruited. The primary outcome was CBT fidelity, measured by rating audiotaped sessions. Secondary outcomes were Veterans’ general (BSI-18 GSI, SF-12) and disorder-specific (GAD-7, PCL-5, PHQ-9) outcomes assessed at baseline, three and six month follow-up.

Results:

We found a large (d = 0.88) but not statistically significant difference in mean fidelity rating scores between conditions. Compared with the manual, participants with generalized anxiety disorder receiving VA CALM by computer reported lower GAD-7 scores at three (−5.88; 95% CI=−11.37, −0.39) and six month (−5.25; 95% CI=−10.29, −0.22) follow-ups (d = 0.37 to 0.55). Participants in the computer and manual conditions reported lower PHQ-9 (−3.11; 95% CI=−5.51, −0.71; −4.06; 95% CI=−7.22, −0.90, respectively) and BSI-18 GSI (0.78; 95% CI=0.68,0.90; 0.71; 95% CI=0.58, 0.87, respectively) scores from baseline to six month follow-up. We did not find statistically significant differences over time or between conditions on SF-12 or PCL-5 scores.

Limitations:

This study was underpowered to test the primary outcome. Small samples sizes in the disorder-specific subgroup analysis may limit the generalizability of findings.

Conclusions:

Neither modality proved to be superior on VA CALM fidelity. The computer version of VA CALM, compared to the manual, may provide modest benefit to Veterans with GAD.

Implementation Science is Imperative to the Optimization of Obstetric Care

In an effort aimed at improving outcomes, obstetric teams have enacted comprehensive care bundles and other clinical tools. Yet, these practices have had limited degrees of success on a national scale. Implementation science aims to bridge the divide between the development of evidence-based interventions and their real-world utilization. This emerging field takes into account key stakeholders at the clinician, institution, and health policy levels. Implementation science evaluates how well an intervention is or can be delivered, to whom, in which context, and how it may be up-scaled and sustained. Other medical disciplines have embraced these concepts with success. The frameworks and theories of implementation science can and should be incorporated into both obstetric research and practice. By doing so, we can increase widespread and timely adoption of evidence and further our common goal of decreasing maternal morbidity and mortality. KEY POINTS: · Evidence-based practices have been implemented in obstetrics with variable success.. · Implementation science aims to bridge the divide between the development of evidence-based interventions and their real-world utilization.. · The methodologies of implementation science may be helpful to obstetric research and practice..

Assessing Implementation Strategy Reporting in the Mental Health Literature: A Narrative Review

Inadequate implementation strategy reporting restricts research synthesis and replicability. We explored the implementation strategy reporting quality of a sample of mental health articles using Proctor et al.'s (Implement Sci 8:139, 2013) reporting recommendations. We conducted a narrative review to generate the sample of articles and assigned a reporting quality score to each article. The mean article reporting score was 54% (range 17-100%). The most reported domains were: name (100%), action (82%), target (80%), and actor (67%). The least reported domains included definition (6%), temporality (26%), justification (34%), and outcome (37%). We discuss limitations and provide recommendations to improve reporting.

Factors affecting the delivery of complex rehabilitation interventions in research with neurologically impaired adults: a systematic review

BACKGROUND

Rehabilitation research does not always improve patient outcomes because of difficulties implementing complex health interventions. Identifying barriers and facilitators to implementation fidelity is critical. Not reporting implementation issues wastes research resources and risks erroneously attributing effectiveness when interventions are not implemented as planned, particularly progressing from single to multicentre trials. The Consolidated Framework for Implementation Research (CFIR) and Conceptual Framework for Implementation Fidelity (CFIF) facilitate identification of barriers and facilitators. This review sought to identify barriers and facilitators (determinants) affecting implementation in trials of complex rehabilitation interventions for adults with long-term neurological conditions (LTNC) and describe implementation issues.

METHODS

Implementation, complex health interventions and LTNC search terms were developed. Studies of all designs were eligible. Searches involved 11 databases, trial registries and citations. After screening titles and abstracts, two reviewers independently shortlisted studies. A third resolved discrepancies. One reviewer extracted data in two stages; 1) descriptive study data, 2) units of text describing determinants. Data were synthesised by (1) mapping determinants to CFIF and CFIR and (2) thematic analysis.

RESULTS

Forty-three studies, from 7434 records, reported implementation determinants; 41 reported both barriers and facilitators. Most implied determinants but five used implementation theory to inform recording. More barriers than facilitators were mapped onto CFIF and CFIR constructs. "Patient needs and resources", "readiness for implementation", "knowledge and beliefs about the intervention", "facilitation strategies", "participant responsiveness" were the most frequently mapped constructs. Constructs relating to the quality of intervention delivery, organisational/contextual aspects and trial-related issues were rarely tapped. Thematic analysis revealed the most frequently reported determinants related to adherence, intervention perceptions and attrition.

CONCLUSIONS

This review has described the barriers and facilitators identified in studies implementing complex interventions for people with LTNCs. Early adoption of implementation frameworks by trialists can simplify identification and reporting of factors affecting delivery of new complex rehabilitation interventions. It is vital to learn from previous experiences to prevent unnecessary repetitions of implementation failure at both trial and service provision levels. Reported facilitators can provide strategies for overcoming implementation issues. Reporting gaps may be due to the lack of standardised reporting methods, researcher ignorance and historical reporting requirements.

SYSTEMIC REVIEW REGISTRATION

PROSPERO CRD42015020423.

Factors Affecting Adoption of Coordinated Anxiety Learning and Management (CALM) in Veterans' Affairs Community-Based Outpatient Clinics

PURPOSE

Many US military veterans experience anxiety, depression, and trauma-related disorders. A major goal of the Veterans Health Administration (VHA) has been to increase access to evidence-based psychotherapies (EBPs) such as cognitive-behavioral therapy to address veterans' substantial health burden. However, despite widespread implementation of EBPs throughout the VHA, smaller clinics that often serve rural veterans face barriers to delivering these interventions. The Veterans Affairs Coordinated Anxiety Learning and Management (VA CALM) program aims to empower providers in rural areas with varying levels of training and experience in delivering EBPs to provide high-quality cognitive-behavioral therapy for anxiety, depression, and trauma-related disorders. The goal of this study was to better understand, through qualitative interviews, VHA community-based outpatient clinic providers' perspectives on implementing VA CALM.

METHODS

Qualitative interviews with providers (N = 22) were conducted to understand implementation of VA CALM. Template analysis was used to organize and summarize responses.

FINDINGS

Providers noted several facilitators for implementing VA CALM in rural community clinics, including its perceived effectiveness, broad applicability, and structure. Barriers to implementation included scheduling problems and patient-related barriers.

CONCLUSIONS

Incorporating providers' perspectives on factors that affect implementing cognitive-behavioral therapy in this setting may inform future efforts to disseminate-implement EBPs in smaller, more remote VHA clinics.

Artificial Intelligence and Primary Care Research: A Scoping Review

PURPOSE

Rapid increases in technology and data motivate the application of artificial intelligence (AI) to primary care, but no comprehensive review exists to guide these efforts. Our objective was to assess the nature and extent of the body of research on AI for primary care.

METHODS

We performed a scoping review, searching 11 published or gray literature databases with terms pertaining to AI (eg, machine learning, bayes* network) and primary care (eg, general pract*, nurse). We performed title and abstract and then full-text screening using Covidence. Studies had to involve research, include both AI and primary care, and be published in Eng-lish. We extracted data and summarized studies by 7 attributes: purpose(s); author appointment(s); primary care function(s); intended end user(s); health condition(s); geographic location of data source; and AI subfield(s).

RESULTS

Of 5,515 unique documents, 405 met eligibility criteria. The body of research focused on developing or modifying AI methods (66.7%) to support physician diagnostic or treatment recommendations (36.5% and 13.8%), for chronic conditions, using data from higher-income countries. Few studies (14.1%) had even a single author with a primary care appointment. The predominant AI subfields were supervised machine learning (40.0%) and expert systems (22.2%).

CONCLUSIONS

Research on AI for primary care is at an early stage of maturity. For the field to progress, more interdisciplinary research teams with end-user engagement and evaluation studies are needed.

Safety Planning on Crisis Lines: Feasibility, Acceptability, and Perceived Helpfulness of a Brief Intervention to Mitigate Future Suicide Risk

BACKGROUND

The role of crisis hotlines traditionally was limited to de-escalation and service linkage. However, hotlines are increasingly recruited to provide outreach and follow-up to suicidal individuals. Hotlines have the opportunity to not just defuse current crises but also provide brief interventions to mitigate future risk. The Safety Planning Intervention (SPI) is a brief intervention designed to help manage suicidal crises, but its feasibility and effectiveness on hotlines are not established.

AIMS

This study examined feasibility and perceived effectiveness of SPI, as reported by 271 crisis counselors at five centers in the National Suicide Prevention Lifeline network.

METHOD

Counselors were trained to use SPI. Self-report surveys were completed immediately after training (time 1) and at the end of the study, approximately 9 months later (time 2).

RESULTS

Counselors reported that SPI was feasible and helpful, and was used on both incoming and follow-up calls. Utilization and perceived effectiveness at time 2 were predicted by self-efficacy, feasibility, and helpfulness at time 1.

LIMITATIONS

Results are preliminary and limited to counselors' perceptions. Future RCTs should establish efficacy of SPI for crisis callers.

CONCLUSION

The Safety Planning Intervention is a promising approach to reduce crisis callers' future suicide risk that hotline counselors report is both feasible and helpful.

An Evidence-Based Model for Disseminating-Implementing Coordinated Anxiety Learning and Management in Department of Veterans Affairs' Community-Based Outpatient Clinics

PURPOSE

To explore the feasibility and utility of using a workshop, and supervision-consultation plus external facilitation to disseminate and implement cognitive-behavioral therapy in Veterans Affairs (VA) community-based outpatient clinics (CBOCs).

METHODS

This study occurred in the context of a randomized controlled trial aimed at comparing 2 methods for implementing Coordinated Anxiety Learning Management (CALM) in VA CBOCs. A 3-phase (workshop, supervision-consultation, external facilitation) model was used to support 32 VA CBOC mental health providers in learning and adopting CALM in their clinical practice. Qualitative data describe training activities and the feasibility and utility of each training phase in addressing challenges to adopting CALM.

FINDINGS

All 3 phases of the model were feasible to use with our sample of CBOC mental health providers. Providers reported challenges learning CALM during the workshop and concerns about not having enough training post-workshop to use CALM in practice. Providers primarily utilized supervision-consultation to tailor CALM to their practice, including learning how to prioritize a target disorder, "switch" the focus of treatment to a different disorder when comorbidities were present, and modify CALM sessions to fit shorter treatment visits. Providers primarily utilized external facilitation to further tailor CALM to their practice through implementation (eg, concrete help) and support-oriented help. Key lessons for implementing CALM in CBOCs are presented and discussed.

CONCLUSIONS

Findings provide initial evidence for the feasibility and utility of using each component of a facilitation-enhanced training model to promote CBOC VA providers' implementation of a computer and manual version of CALM in their practice.

Assessing Implementation Strategy Reporting in the Mental Health Literature: A Narrative Review

Inadequate implementation strategy reporting restricts research synthesis and replicability. We explored the implementation strategy reporting quality of a sample of mental health articles using Proctor et al.'s (Implement Sci 8:139, 2013) reporting recommendations. We conducted a narrative review to generate the sample of articles and assigned a reporting quality score to each article. The mean article reporting score was 54% (range 17-100%). The most reported domains were: name (100%), action (82%), target (80%), and actor (67%). The least reported domains included definition (6%), temporality (26%), justification (34%), and outcome (37%). We discuss limitations and provide recommendations to improve reporting.

Accelerating the Pace of Science: Improving Parenting Practices in Parents with Opioid Use Disorder

A public health emergency exists in the United States as a result of rising overdose deaths related to Opioid Use Disorder (OUD). With the rise of OUD has also come an increase in the number of children exposed to parents who suffer from an OUD. There is a pressing need for parenting interventions for individuals with OUD to provide safe environments for the children being reared in the face of this epidemic. Research on parenting with an OUD is sparse, but it is impractical to move linearly from basic research to program development and implementation given the urgent need for intervention - a trajectory that prior research has established takes approximately 17 years. We have created an outline of strategies that can be used to accelerate the pace of science so that parenting practices are more immediately improved for this population. First, we summarize what is already known about OUD and parenting to characterize mechanisms that existing interventions have targeted and optimal settings for the wide dissemination of implementable interventions. Next, we identify existing interventions that either specifically target parents with OUD or mechanisms specific to parents with OUD. We describe four different approaches for accelerating the pace of science to improve the lives of parents with OUD and their children. By doing so, we hope to provide a roadmap for future researchers and practitioners to deliver more timely evidence-based interventions to address the additional burden placed on families and communities due to the rise in OUD in the United States.

Implementing Video to Home to Increase Access to Evidence-Based Psychotherapy for Rural Veterans

This clinical demonstration project used facilitation to implement VA Video to Home (VTH) to deliver evidence-based psychotherapies to underserved rural Veterans, to increase access to mental health care. Participants were Veterans seeking mental health treatment at "Sonny" Montgomery Veterans Affairs Medical Center in Jackson, MS, and/or its six community-based outpatient clinics. Measures included patient encounter and demographic data, patient and provider interviews, reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) factors, measures of fidelity to manualized evidence-based psychotherapies (EBPs), and qualitative interviews. The project was deemed feasible; 93 (67 men, 26 women, including 77 rural, 16 urban) patients received weekly EBPs via VTH. Nearly half were Black (n = 46), 36 of whom (78.3%) were also rural. Fifty-three (48.4%) were Operation Enduring Freedom/Operation Iraqi Freedom Veterans. Ages varied widely, from 20 to 79 years. Primary diagnoses included posttraumatic stress disorder (41), depressive disorders (22), anxiety disorders (nine), insomnia (eight), chronic pain (eight), and substance use disorder (five). Fifteen clinicians were trained to deliver eight EBPs via VTH. Growth in number of Veterans treated by telehealth was 10.12 times and mental health visits were 7.34 times greater than the national annual average of growth for telehealth at VHA facilities. Illustrative examples and qualitative data from both patients and providers suggested overall satisfaction with VTH. This demonstrates the benefits of VTH for increasing access to mental health treatment for rural patients and advantages of an implementation facilitation strategy using an external facilitator. Continuing research should clarify whether certain patients are more likely to participate than others and whether certain EBPs are more easily delivered with VTH than others.