The RE-AIM framework for evaluating interventions: what can it tell us about approaches to chronic illness management?

Accelerating Innovation in Primary Care to Support Adolescent Health Discussions

BACKGROUND AND OBJECTIVES

Adolescent strengths and risks are not routinely captured in systematized and actionable ways in pediatric primary care. To address this problem, we developed a comprehensive adolescent health questionnaire (AHQ) integrated within the electronic health record and evaluated the AHQ's impact on collection of information on prioritized health-related domains.

METHODS

We developed and pilot tested the AHQ. We then scaled and assessed the AHQ's impact on data collection. AHQ development used innovation methods and measured feasibility and acceptability outcomes. Scaling and postscaling outcomes included Reach, Effectiveness, Adoption, Implementation, Maintenance and Sustainability measures: Reach (total questionnaires completed), Effectiveness (capture of key information across health domains pre- vs post-AHQ scaling), Adoption (proportion of practices that adopted the AHQ), Implementation (proportion of eligible adolescents who completed the AHQ), and Maintenance (monthly completion rates).

RESULTS

AHQ development led to a tool that was feasible and acceptable for use. During scaling (October 2020-December 2021), 22 147 questionnaires were completed by 20 749 unique adolescents aged 13 to 21 years at their preventive visit. Comparing pre- versus post-AHQ scaling data, use of the AHQ increased collection of information across domains, especially for strengths, gun safety, substance use, sexual activity, sexual orientation, and gender identity, from ranges of 0%-25% to 92%-95%. All 31 practices adopted the AHQ with completion at 88.7% of visits (n = 24 968). Two years postscaling, completion rates were >91% per month.

CONCLUSIONS

We successfully developed, scaled, and maintained an AHQ in a widely-used electronic health record system, a model for improving adolescent care and foundation for developing future interventions.

COMmunity-Based Nutrition RISK Screening in Older Adults Living Independently (COMRISK): Feasibility, Acceptability, and Appropriateness of Community Partnership Models in Alberta, Canada

This feasibility study of routine nutrition risk screening in community-dwelling older adults using a partnership between health care and community-based organizations (CBO) aimed to (1) evaluate the ability of community-based partnerships to provide screening for nutrition risk, and appropriately refer at-risk individuals for follow-up care and (2) determine the barriers to and facilitators of screening. Adults 65 years of age and older were screened by staff in two primary care and one CBO setting using the Seniors in the Community: Risk Evaluation for Eating and Nutrition (SCREEN)-8 nutrition risk screening tool. Screeners, organization administrators, and registered dietitians responded to surveys regarding SCREEN-8 administration, referral processes, and partnership interactions. All found the SCREEN-8 initiative feasible, acceptable, and appropriate. Sustainability requires strengthening of community resources, referral processes, and telephone assessments. The partnership added value despite limitations in communications. We conclude that broader implementation of this program using community-based partnerships has the potential to aid in the prevention of malnutrition in older adults.

A community health worker led approach to cardiovascular disease prevention in the UK-SPICES-Sussex (scaling-up packages of interventions for cardiovascular disease prevention in selected sites in Europe and Sub-saharan Africa): an implementation research project

Background

This paper describes a UK-based study, SPICES-Sussex, which aimed to co-produce and implement a community-based cardiovascular disease (CVD) risk assessment and reduction intervention to support under-served populations at moderate risk of CVD. The objectives were to enhance stakeholder engagement; to implement the intervention in four research sites and to evaluate the use of Voluntary and Community and Social Enterprises (VCSE) and Community Health Worker (CHW) partnerships in health interventions.

Methods

A type three hybrid implementation study design was used with mixed methods data. This paper represents the process evaluation of the implementation of the SPICES-Sussex Project. The evaluation was conducted using the RE-AIM framework.

Results

Reach: 381 individuals took part in the risk profiling questionnaire and forty-one women, and five men participated in the coaching intervention. Effectiveness: quantitative results from intervention participants showed significant improvements in CVD behavioural risk factors across several measures. Qualitative data indicated high acceptability, with the holistic, personalised, and person-centred approach being valued by participants. Adoption: 50% of VCSEs approached took part in the SPICES programme, The CHWs felt empowered to deliver high-quality and mutually beneficial coaching within a strong project infrastructure that made use of VCSE partnerships. Implementation: Co-design meetings resulted in local adaptations being made to the intervention. 29 (63%) of participants completed the intervention. Practical issues concerned how to embed CHWs in a health service context, how to keep engaging participants, and tensions between research integrity and the needs and expectations of those in the voluntary sector. Maintenance: Several VCSEs expressed an interest in continuing the intervention after the end of the SPICES programme.

Conclusion

Community-engagement approaches have the potential to have positively impact the health and wellbeing of certain groups. Furthermore, VCSEs and CHWs represent a significant untapped resource in the UK. However, more work needs to be done to understand how links between the sectors can be bridged to deliver evidence-based effective alternative preventative healthcare. Reaching vulnerable populations remains a challenge despite partnerships with VCSEs which are embedded in the community. By showing what went well and what did not, this project can guide future work in community engagement for health.

Can a best practice advisory improve anticoagulation prescribing to reduce stroke risk in patients with atrial fibrillation?

BACKGROUND

Atrial fibrillation (AF) is the most common cardiac rhythm disorder and a risk factor for stroke. Randomized trials have demonstrated that anticoagulation can reduce strokes in AF patients. Yet, widespread underutilization of this therapy continues. To address this practice gap, we designed a study to implement and evaluate the effectiveness of a best practice advisory (BPA) for an Atrial Fibrillation Decision Support Tool (AFDST) embedded within our electronic health record.

METHODS

Our intervention is provider-facing, focused on decision support. Clinical setting is ambulatory patients being seen by primary care physicians. We prospectively enrolled 608 patients in our health system who are currently receiving less than optimal anticoagulation therapy as determined by the AFDST and randomized them to one of two arms - 1) usual care, in which the AFDST is available for use; or 2) addition of a BPA to the AFDST notifying clinicians that their patient stands to gain significant benefit from a change in current therapy. Primary outcome was effectiveness of the BPA measured by change to "appropriate thromboprophylaxis" based on the AFDST recommendation at 3 months post-enrollment. Secondary endpoints included Reach and Adoption from the RE-AIM (Reach, Effectiveness, Adoption, Implementation, & Maintenance) framework for implementation studies.

RESULTS

Among 562 patients with a minimum follow-up of 3 months, addition of a BPA to the AFDST resulted in significant improvement in anticoagulation therapy, 5 % (12/248) versus 11 % (33/314) p = 0.02, odds ratio 2.31 (95 % CI, 1.17-4.87).

CONCLUSIONS

A BPA added to an AF decision support tool improved anticoagulation therapy among AF patients in a primary care academic health system setting.

Integrating a Community-Based Health Information System with a Patient-Centered Medical Home to improve care of patients with hypertension: a longitudinal observational study protocol

BACKGROUND

The primary healthcare system in Pakistan focuses on providing episodic, disease-based care. Health care for low-middle income communities is largely through a fee-for-service model that ignores preventive and health-promotive services. The growing burden of cardiovascular illnesses requires restructuring of the primary health care system allowing a community-to-clinic model of care to improve patient- and community-level health indicators.

METHODS

We propose a model that integrates a Patient-Centered Medical Home (PCMH) with a Community-Based Health Information System (CBHIS) using hypertension (HTN) as an example. This protocol describes the integration and evaluation of the PCMH-CBHIS infrastructure through a population-based, observational, longitudinal study in a low-middle income, urban community in Pakistan. Participants are being enrolled in CBHIS and will be followed longitudinally over two years for HTN outcomes. A mixed-methods approach is adopted to evaluate the process of integrating PCMH with CBHIS. This involves building partnerships with the community through formal and informal meetings, focus group discussions, and a household health assessment survey (HAS). Community members identified with HTN are linked to PCMH for disease management. A customized electronic medical record system links community-level data with patient-level data to track changes in disease burden. The RE-AIM evaluation framework will be used to monitor community and individual-level metrics to guide implementation assessment, the potential for generalization, and the effectiveness of the PCMH in improving HTN-related health outcomes. Ethical clearance has been obtained from the Ethics Review Committee at Aga Khan University (2022-6723-20985).

DISCUSSION

This study will evaluate the value of restructuring the primary care health system by ensuring systematic community engagement and measurement of health indicators at the patient- and community-level. While HTN is being used as a prototype to generate evidence for the effectiveness of this model, findings from this initiative will be leveraged towards strengthening the management of other acute and chronic conditions in primary care settings. If effective, the model can be used in Pakistan and other LMICs and resource-limited settings.

Diffusion of excellence: evaluating a system to identify, replicate, and spread promising innovative practices across the Veterans health administration

Introduction

The Veterans Health Administration (VHA) Diffusion of Excellence (DoE) program provides a system to identify, replicate, and spread promising practices across the largest integrated healthcare system in the United States. DoE identifies innovations that have been successfully implemented in the VHA through a Shark Tank style competition. VHA facility and regional directors bid resources needed to replicate promising practices. Winning facilities/regions receive external facilitation to aid in replication/implementation over the course of a year. DoE staff then support diffusion of successful practices across the nationwide VHA.

Methods

Organized around the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) Framework, we summarize results of an ongoing long-term mixed-methods implementation evaluation of DoE. Data sources include: Shark Tank application and bid details, tracking practice adoptions through a Diffusion Marketplace, characteristics of VHA facilities, focus groups with Shark Tank bidders, structured observations of DoE events, surveys of DoE program participants, and semi-structured interviews of national VHA program office leaders, VHA healthcare system/facility executives, practice developers, implementation teams and facilitators.

Results

In the first eight Shark Tanks (2016-2022), 3,280 Shark Tank applications were submitted; 88 were designated DoE Promising Practices (i.e., practices receive facilitated replication). DoE has effectively spread practices across the VHA, with 1,440 documented instances of adoption/replication of practices across the VHA. This includes 180 adoptions/replications in facilities located in rural areas. Leadership decisions to adopt innovations are often based on big picture considerations such as constituency support and linkage to organizational goals. DoE Promising Practices that have the greatest national spread have been successfully replicated at new sites during the facilitated replication process, have close partnerships with VHA national program offices, and tend to be less expensive to implement. Two indicators of sustainment indicate that 56 of the 88 Promising Practices are still being diffused across the VHA; 56% of facilities originally replicating the practices have sustained them, even up to 6 years after the first Shark Tank.

Conclusion

DoE has developed a sustainable process for the identification, replication, and spread of promising practices as part of a learning health system committed to providing equitable access to high quality care.

Applying the RE-AIM framework to evaluate an educational model to "close the gap" and improve health equity in uncontrolled hypertension

OBJECTIVES

To use the Reach, Effectiveness, Adoption, Implementation, Maintenance (RE-AIM) framework to evaluate an educational model addressing self-management of uncontrolled hypertension.

METHODS

We used a pre-post single cohort design to identify minoritized patients with uncontrolled hypertension (systolic > 160 mmHg and/or diastolic > 100 mmHg). Trained Ambassadors provided telephone outreach, skill-based blood pressure (BP) monitoring, and goal-setting for 4 months. Follow-up occurred at 7 months. We evaluated the initiative using the RE-AIM framework and quantitative analysis for process and outcome measures post-intervention.

RESULTS

Among Black patients (n = 345), the average age was 55.4 years (8.7), half identified as male (n = 173, 50.1 %); many were uninsured (n = 159, 46.1 %). Engagement in calls occurred for 67.8 % (n = 234) of the cohort; monitor distribution was 22.9 % (n = 79); and goal setting occurred for 64 patients. BP improved for 40 % of the cohort (mean pre: 168/98 mmHg, mean post: 150/89 mmHg; p < 0.0001) and 40 % of patients' last known BP was < 140/90.

CONCLUSIONS

RE-AIM evaluation of the Closing the Gap initiative suggests that the model is associated with BP reduction in high-risk Black patients.

PRACTICE IMPLICATIONS

An educational model for patient-centered hypertension management in low-income populations is feasible and addresses self-monitoring barriers.

Implementation of remote home care: assessment guided by the RE-AIM framework

BACKGROUND

Welfare technology interventions have become increasingly important in home-based palliative care for facilitating safe, time-efficient, and cost-effective methods to support patients living independently. However, studies evaluating the implementation of welfare technology innovations are scarce, and the empirical evidence for sustainable models using technology in home-based palliative care remains low. This study aimed to report on the use of the Reach Effectiveness Adoption Implementation Maintenance (RE-AIM) framework to assess the implementation of remote home care (RHC) a technology-mediated service for home-living patients in the palliative phase of cancer. Furthermore, it aimed to explore areas of particular importance determining the sustainability of technologies for remote palliative home-based care.

METHODS

A secondary analysis of data collected by semi-structured interviews with patients with cancer in the palliative phase, focus groups, and semi-structured interviews with healthcare professionals (HCPs) experienced with RHC was performed. A deductive reflexive thematic analysis using RE-AIM dimensions was conducted.

RESULTS

Five themes illustrating the five RE-AIM dimensions were identified: (1) Reach: protective actions in recruitment - gatekeeping, (2) Effectiveness: potential to offer person-centered care, (3) Adoption: balancing high touch with high tech, (4) Implementation: moving towards a common understanding, and (5) Maintenance: adjusting to what really matters. The RE-AIM framework highlighted that RHC implementation for patients in the palliative phase of cancer was influenced by HCP gatekeeping behavior, concerns regarding abandoning palliative care as a high-touch specialty, and a lack of competence in palliative care. Although RHC facilitated improved routines in patients' daily lives, it was perceived as a static service unable to keep pace with disease progression.

CONCLUSIONS

A person-centered approach that prioritizes individual needs and preferences is necessary for providing optimal care. Although technologies such as RHC are not a panacea, they can be integrated as support for increasingly strained health services.

State of the Science of Scale-Up of Cancer Prevention and Early Detection Interventions in Low- and Middle-Income Countries: A Scoping Review

PURPOSE

Cancer deaths in low- and middle-income countries (LMICs) will nearly double by 2040. Available evidence-based interventions (EBIs) for cancer prevention and early detection can reduce cancer-related mortality, yet there is a lack of evidence on effectively scaling these EBIs in LMIC settings.

METHODS

We conducted a scoping review to identify published literature from six databases between 2012 and 2022 that described efforts for scaling cancer prevention and early detection EBIs in LMICs. Included studies met one of two definitions of scale-up: (1) deliberate efforts to increase the impact of effective intervention to benefit more people or (2) an intervention shown to be efficacious on a small scale expanded under real-world conditions to reach a greater proportion of eligible population. Study characteristics, including EBIs, implementation strategies, and outcomes used, were summarized using frameworks from the field of implementation science.

RESULTS

This search yielded 3,076 abstracts, with 24 studies eligible for inclusion. Included studies focused on a number of cancer sites including cervical (67%), breast (13%), breast and cervical (13%), liver (4%), and colon (4%). Commonly reported scale-up strategies included developing stakeholder inter-relationships, training and education, and changing infrastructure. Barriers to scale-up were reported at individual, health facility, and community levels. Few studies reported applying conceptual frameworks to guide strategy selection and evaluation.

CONCLUSION

Although there were relatively few published reports, this scoping review offers insight into the approaches used by LMICs to scale up cancer EBIs, including common strategies and barriers. More importantly, it illustrates the urgent need to fill gaps in research to guide best practices for bringing the implementation of cancer EBIs to scale in LMICs.

Integrated Care Models for Older Adults with Depression and Physical Comorbidity: A Scoping Review

Objective

Multimorbidity is a growing challenge in the care for older people with mental illness. To address both physical and mental illnesses, integrated care management is required. The purpose of this scoping review is to identify core components of integrated care models for older adults with depression and physical comorbidity, and map reported outcomes and implementation strategies.

Methods

PubMed, EMBASE, CINAHL and Cochrane Library were searched independently by two reviewers for studies concerning integrated care interventions for older adults with depression and physical comorbidity. We used the SELFIE framework to map core components of integrated care models. Clinical and organisational outcomes were mapped.

Results

Thirty-eight studies describing thirteen care models were included. In all care models, a multidisciplinary team was involved. The following core components were mainly described: continuity, person-centredness, tailored holistic assessment, pro-activeness, treatment interaction, individualized care planning, and coordination tailored to complexity of care needs. Twenty-seven different outcomes were evaluated, with more attention given to clinical than to organisational outcomes.

Conclusion

The core components that comprise integrated care models are diverse. Future studies should focus more on implementation aspects of the intervention and describe financial parts, e.g., the cost of the intervention for the healthcare user, more transparently.

Remote Symptom Monitoring to Enhance the Delivery of Palliative Cancer Care in Low-Resource Settings: Emerging Approaches from Africa

This paper brings together researchers, clinicians, technology developers and digital innovators to outline current applications of remote symptom monitoring being developed for palliative cancer care delivery in Africa. We outline three remote symptom monitoring approaches from three countries, highlighting their models of delivery and intended outcomes, and draw on their experiences of implementation to guide further developments and evaluations of this approach for palliative cancer care in the region. Through highlighting these experiences and priority areas for future research, we hope to steer efforts to develop and optimise remote symptom monitoring for palliative cancer care in Africa.

CancelRx case study: implications for clinic and community pharmacy work systems

BACKGROUND

Medication prescribing and discontinuation processes are complex and involve the patient, numerous health care professionals, organizations, health information technology (IT). CancelRx is a health IT that automatically communicates medication discontinuations from the clinic electronic health record to the community pharmacy dispensing platform, theoretically improving communication. CancelRx was implemented across a Midwest academic health system in October 2017. The health system also operates 15 outpatient community pharmacies.

OBJECTIVE

The goal of this qualitative study was to describe how both the clinic and community pharmacy work systems change and interact over time regarding medication discontinuations, before and after CancelRx implantation.

APPROACH

Medical Assistants (n = 9), Community Pharmacists (n = 12), and Pharmacy Administrators (n = 3), employed by the health system were interviewed across 3-time periods between 2017 and 2018- 3-months prior to CancelRx implementation, 3-months after CancelRx implementation, and 9-months after CancelRx implementation. Interviews were audio recorded, transcribed, and conducted a hybrid analysis with deductive content analysis following the Systems Engineering Initiative for Patient Safety (SEIPS) framework and inductive analysis to capture additional codes and themes.

KEY RESULTS

CancelRx changed the medication discontinuation process at both clinics and community pharmacies. In the clinics, the workflows and medication discontinuation tasks changed over time while MA roles and clinic staff communication practices remained variable. In the pharmacy, CancelRx automated and streamlined how medication discontinuation messages were received and processed, but also increased workload for the pharmacists and introduced new errors.

CONCLUSIONS

This study utilizes a systems approach to assess disparate systems within a patient network. Future studies may consider health IT implications for systems that are not in the same health system as well as assessing the role of implementation decisions on health IT use and dissemination.

Operationalizing Primary Outcomes to Achieve Reach, Effectiveness, and Equity in Multilevel Interventions

When intervention scientists plan a clinical trial of an intervention, they select an outcome metric that operationalizes their definition of intervention success. The outcome metric that is selected has important implications for which interventions are eventually supported for implementation at scale and, therefore, what health benefits (including how much benefit and for whom) are experienced in a population. Particularly when an intervention is to be implemented in a population that experiences a health disparity, the outcome metric that is selected can also have implications for equity. Some outcome metrics risk exacerbating an existing health disparity, while others may decrease disparities for some but have less effect for the larger population. In this study, we use a computer to simulate implementation of a hypothetical multilevel, multicomponent intervention to highlight the tradeoffs that can occur between outcome metrics that reflect different operationalizations of intervention success. In particular, we highlight tradeoffs between overall mean population benefit and the distribution of health benefits in the population, which has direct implications for equity. We suggest that simulations like the one we present can be useful in the planning of a clinical trial for a multilevel and/or multicomponent intervention, since simulated implementation at scale can illustrate potential consequences of candidate operationalization of intervention success, such that unintended consequences for equity can be avoided.

Feasibility of implementing patient-reported outcome measures into routine breast cancer care delivery using a novel collection and reporting platform

Objectives

imPROVE is a new Health Information Technology platform that enables systematic patient-reported outcome measure (PROM) collection through a mobile phone application. The purpose of this study is to describe our initial experience and approach to implementing imPROVE among breast cancer patients treated in breast and plastic surgery clinics.

Materials and Methods

We describe our initial implementation in 4 phases between June 2021 and February 2022: preimplementation, followed by 3 consecutive implementation periods (P1, P2, P3). The Standards for Reporting Implementation Studies statement guided this study. Iterative Plan-Do-Study-Act (PDSA) cycles supported implementation, and success was evaluated using the Reach, Effectiveness, Adoption, Implementation, and Maintenance framework.

Results

Qualitative interviews conducted during the preimplementation phase elicited 4 perceived implementation barriers. Further feedback collected during each phase of implementation resulted in the development of brochures, posters in clinic spaces, and scripts for clinic staff to streamline discussions with patients, and the resolution of technical issues concerning patient login capabilities, such as compatibility with cell phone software and barriers to downloading imPROVE. Feedback also generated ideas for facilitating provider interpretation of PROM results. By the end of P3, 2961 patients were eligible, 1375 (46.4%) downloaded imPROVE, and 1070 (36.1% of those eligible, 78% of those who downloaded) completed at least 1 PROM.

Discussion and Conclusion

Implementation efforts across 2 surgical departments at 2 academic teaching hospitals enabled collaboration across clinical specialties and longitudinal PROM reporting for patients receiving breast cancer care; the implementation effort also highlighted patient difficulties with mobile app-based PROM collection, particularly around initial engagement.

Using multiple approaches to develop a physician-pharmacist collaborative care intervention to facilitate appropriate prescribing for older adults with multimorbidity

BACKGROUND AND OBJECTIVES

This article discusses the development process of an intervention to facilitate appropriate prescribing for older adults with multimorbidity at geriatric medicine outpatient clinics. Both effectiveness and implementability were key aims, which were achieved by a systematic combination of different approaches guided by published guidance.

METHODS

Various frameworks and tools were used to guide the intervention development. They include The Medical Research Council Framework for complex health interventions as the overarching framework, supplemented by the Framework of Actions for Intervention Development and a taxonomy of intervention development approaches.

RESULTS

A combination of theory and evidence-based-, implementation-based and partnership approaches were used to develop the intervention. The Behaviour Change Wheel and Theoretical Domains Framework were used for intervention design. Three scoping reviews and two modified Delphi studies were conducted to build an evidence base on prescribing-related barriers and existing interventions. The findings were synthesised, assessed for implementability, and culminated in a co-creation exercise with physicians and pharmacists. The final intervention aims to facilitate collaboration between physicians and pharmacists and to improve communication and documentation of prescribing decisions.

CONCLUSIONS

Multiple approaches may be required when developing interventions that are effective and implementable. The study team's experiences in using published guidance, integrating different approaches, and co-creating the intervention with healthcare professionals provide a useful case study with lessons and insights for developers of complex interventions. Furthermore, systematic reporting of such research-based efforts would contribute to advancement of intervention development in healthcare and reducing research waste.

Community-Based Nutrition Risk Screening in Older Adults (COMRISK): An Exploration of the Experience of Being Screened and Prevalence of Nutrition Risk in Alberta, Canada

The objectives of this feasibility study were to measure the prevalence of nutrition risk in community-dwelling older adults (CDOA, ages ≥ 65 years) and explore the perspectives of CDOA of the acceptability, value, and effectiveness of nutrition risk screening in primary care and community settings. Using the Seniors in the Community: Risk Evaluation for Eating and Nutrition (SCREEN)© eight-item tool (n = 276), results indicated that moderate and high nutrition risks affected 50 per cent and 8 per cent, respectively, of those screened. Interviewees (n = 16) agreed that screening is acceptable, important, and valuable (Theme One). Effectiveness was unclear, as only 3 of 16 respondents recalled being told their nutrition risk status. When articulating nutrition-related issues, a food security theme, expressed in the third person, was prominent (Theme Two). Screening for nutrition risk and receiving nutrition information in community-based settings are acceptable to CDOA and medically necessary, as evidenced by the high proportion of CDOA at moderate-high nutrition risk.

Strengthening integrated depression services within routine primary health care using the RE-AIM framework in South Africa

Integration of mental health into routine primary health care (PHC) services in low-and middle-income countries is globally accepted to improve health outcomes of other conditions and narrow the mental health treatment gap. Yet implementation remains a challenge. The aim of this study was to identify implementation strategies that improve implementation outcomes of an evidence-based depression care collaborative implementation model integrated with routine PHC clinic services in South Africa. An iterative, quasi-experimental, observational implementation research design, incorporating the Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) framework, was applied to evaluate implementation outcomes of a strengthened package of implementation strategies (stage two) compared with an initial evaluation of the model (stage one). The first stage package was implemented and evaluated in 10 PHC clinics and the second stage strengthened package in 19 PHC clinics (inclusive of the initial 10 clinics) in one resource-scarce district in the province of KwaZulu-Natal, South Africa. Diagnosed service users were more likely to be referred for counselling treatment in the second stage compared with stage one (OR 23.15, SE = 18.03, z = 4.04, 95%CI [5.03-106.49], p < .001). Training in and use of a validated, mandated mental health screening tool, including on-site educational outreach and technical support visits, was an important promoter of nurse-level diagnosis rates (OR 3.75, 95% CI [1.19, 11.80], p = 0.02). Nurses who perceived the integrated care model as acceptable were also more likely to successfully diagnose patients (OR 2.57, 95% CI [1.03-6.40], p = 0.043). Consistent availability of a clinic counsellor was associated with a greater probability of referral (OR 5.9, 95%CI [1.29-27.75], p = 0.022). Treatment uptake among referred service users remained a concern across both stages, with inconsistent co-located counselling services associated with poor uptake. The importance of implementation research for strengthening implementation strategies along the cascade of care for integrating depression care within routine PHC services is highlighted.

RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) Evaluation of the Use of Activity Trackers in the Clinical Care of Adults Diagnosed With a Chronic Disease: Integrative Systematic Review

BACKGROUND

Chronic diseases are a leading cause of adult mortality, accounting for 41 million deaths globally each year. Low levels of physical activity and sedentary behavior are major risk factors for adults to develop a chronic disease. Physical activity interventions can help support patients in clinical care to be more active. Commercial activity trackers that can measure daily steps, physical activity intensity, sedentary behavior, and distance moved are being more frequently used within health-related interventions. The RE-AIM (Reach, Effectiveness, Adoption, Implementation, and Maintenance) framework is a planning and evaluation approach to explore the reach, effectiveness, adoption, implementation, and maintenance of interventions.

OBJECTIVE

The objective of this study is to conduct an integrative systematic review and report the 5 main RE-AIM dimensions in interventions that used activity trackers in clinical care to improve physical activity or reduce sedentary behavior in adults diagnosed with chronic diseases.

METHODS

A search strategy and study protocol were developed and registered on the PROSPERO platform. Inclusion criteria included adults (18 years and older) diagnosed with a chronic disease and have used an activity tracker within their clinical care. Searches of 10 databases and gray literature were conducted, and qualitative, quantitative, and mixed methods studies were included. Screening was undertaken by more than 1 researcher to reduce the risk of bias. After screening, the final studies were analyzed using a RE-AIM framework data extraction evaluation tool. This tool assisted in identifying the 28 RE-AIM indicators within the studies and linked them to the 5 main RE-AIM dimensions.

RESULTS

The initial search identified 4585 potential studies. After a title and abstract review followed by full-text screening, 15 studies were identified for data extraction. The analysis of the extracted data found that the RE-AIM dimensions of adoption (n=1, 7% of studies) and maintenance (n=2, 13% of studies) were underreported. The use of qualitative thematic analysis to understand the individual RE-AIM dimensions was also underreported and only used in 3 of the studies. Two studies used qualitative analysis to explore the effectiveness of the project, while 1 study used thematic analysis to understand the implementation of an intervention.

CONCLUSIONS

Further research is required in the use of activity trackers to support patients to lead a more active lifestyle. Such studies should consider using the RE-AIM framework at the planning stage with a greater focus on the dimensions of adoption and maintenance and using qualitative methods to understand the main RE-AIM dimensions within their design. These results should form the basis for establishing long-term interventions in clinical care.

TRIAL REGISTRATION

PROSPERO CRD42022319635; https://www.crd.york.ac.uk/prospero/display_record.php?RecordID=319635.

Built to last? Barriers and facilitators of healthcare program sustainability: a systematic integrative review

OBJECTIVE

To identify barriers and facilitators associated with the sustainability of implemented and evaluated improvement programs in healthcare delivery systems.

DATA SOURCES AND STUDY SETTING

Six academic databases were searched to identify relevant peer-reviewed journal articles published in English between July 2011 and June 2022. Studies were included if they reported on healthcare program sustainability and explicitly identified barriers to, and facilitators of, sustainability.

STUDY DESIGN

A systematic integrative review guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) statement. Study quality was appraised using Hawker's Quality Assessment Tool.

DATA COLLECTION/EXTRACTION METHODS

A team of reviewers screened eligible studies against the inclusion criteria and extracted the data independently using a purpose-designed Excel spreadsheet. Barriers and facilitators were extracted and mapped to the Integrated Sustainability Framework (ISF). Frequency counts of reported barriers/facilitators were performed across the included studies.

RESULTS

Of the 124 studies included in this review, almost half utilised qualitative designs (n = 52; 41.9%) and roughly one third were conducted in the USA (n = 43; 34.7%). Few studies (n = 29; 23.4%) reported on program sustainability beyond 5 years of program implementation and only 16 of them (55.2%) defined sustainability. Factors related to the ISF categories of inner setting (n = 99; 79.8%), process (n = 99; 79.8%) and intervention characteristics (n = 72; 58.1%) were most frequently reported. Leadership/support (n = 61; 49.2%), training/support/supervision (n = 54; 43.5%) and staffing/turnover (n = 50; 40.3%) were commonly identified barriers or facilitators of sustainability across included studies. Forty-six (37.1%) studies reported on the outer setting category: funding (n = 26; 56.5%), external leadership by stakeholders (n = 16; 34.8%), and socio-political context (n = 14; 30.4%). Eight studies (6.5%) reported on discontinued programs, with factors including funding and resourcing, poor fit, limited planning, and intervention complexity contributing to discontinuation.

CONCLUSIONS

This review highlights the importance of taking into consideration the inner setting, processes, intervention characteristics and outer setting factors when sustaining healthcare programs, and the need for long-term program evaluations. There is a need to apply consistent definitions and implementation frameworks across studies to strengthen evidence in this area.

TRIAL REGISTRATION

https://bmjopen.bmj.com/content/7/11/e018568 .

Using the RE-AIM framework to assess national teledermatology expansion

Background

Teledermatology has been utilized in the United States Department of Veterans Affairs (VA) for decades but continues to have incomplete penetration. VA has funded an initiative to enhance access to dermatology services since 2017 to support asynchronous teledermatology for Veterans living in rural areas. As part of an ongoing evaluation of this program, we assessed the teledermatology activity between the fiscal years 2020 and 2022. We focused on the second cohort of the initiative, comprising six VA facilities and their 54 referral clinics.

Methods

We studied teledermatology programs at cohort facilities using the reach, effectiveness, adoption, implementation, and maintenance framework. We used a mixed-methods design including annual online reports completed by participating facilities and VA administrative data. When possible, we compared the data from the 3 years of teledermatology funding with the baseline year prior to the start of funding.

Findings

Reach: Compared with the baseline year, there was a 100% increase in encounters and a 62% increase in patients seen at the funded facilities. Over 500 clinicians and support staff members were trained. Effectiveness: In FY 2022, primary or specialty care clinics affiliated with the funded facilities had more dermatology programs than primary or specialty care clinics across the VA (83% vs. 71% of sites). Adoption: By the end of the funding period, teledermatology constituted 16% of dermatology encounters at the funded facilities compared with 12% nationally. This reflected an increase from 9.2% at the funded facilities and 10.3% nationally prior to the funding period. Implementation: The continued funding for staff and equipment facilitated the expansion to rural areas. Maintenance: By the end of the funding period, all facilities indicated that they had fully implemented their program for patients of targeted primary care providers. The Program Sustainability Index scores generally increased during the funding period.

Conclusions

Targeted funding to support asynchronous teledermatology implementation for rural Veterans increased its reach, adoption, and implementation, ultimately improving access. Providing program guidance with staffing and training resources can increase the impact of these programs. Ongoing efforts to maintain and increase communication between primary care and dermatology will be needed to sustain success.

Promoting alcohol treatment engagement post-hospitalization with brief intervention, medications and CBT4CBT: protocol for a randomized clinical trial in a diverse patient population

BACKGROUND

Alcohol use disorder (AUD) commonly causes hospitalization, particularly for individuals disproportionately impacted by structural racism and other forms of marginalization. The optimal approach for engaging hospitalized patients with AUD in treatment post-hospital discharge is unknown. We describe the rationale, aims, and protocol for Project ENHANCE (ENhancing Hospital-initiated Alcohol TreatmeNt to InCrease Engagement), a clinical trial testing increasingly intensive approaches using a hybrid type 1 effectiveness-implementation approach.

METHODS

We are randomizing English and/or Spanish-speaking individuals with untreated AUD (n = 450) from a large, urban, academic hospital in New Haven, CT to: (1) Brief Negotiation Interview (with referral and telephone booster) alone (BNI), (2) BNI plus facilitated initiation of medications for alcohol use disorder (BNI + MAUD), or (3) BNI + MAUD + initiation of computer-based training for cognitive behavioral therapy (CBT4CBT, BNI + MAUD + CBT4CBT). Interventions are delivered by Health Promotion Advocates. The primary outcome is AUD treatment engagement 34 days post-hospital discharge. Secondary outcomes include AUD treatment engagement 90 days post-discharge and changes in self-reported alcohol use and phosphatidylethanol. Exploratory outcomes include health care utilization. We will explore whether the effectiveness of the interventions on AUD treatment engagement and alcohol use outcomes differ across and within racialized and ethnic groups, consistent with disproportionate impacts of AUD. Lastly, we will conduct an implementation-focused process evaluation, including individual-level collection and statistical comparisons between the three conditions of costs to providers and to patients, cost-effectiveness indices (effectiveness/cost ratios), and cost-benefit indices (benefit/cost ratios, net benefit [benefits minus costs). Graphs of individual- and group-level effectiveness x cost, and benefits x costs, will portray relationships between costs and effectiveness and between costs and benefits for the three conditions, in a manner that community representatives also should be able to understand and use.

CONCLUSIONS

Project ENHANCE is expected to generate novel findings to inform future hospital-based efforts to promote AUD treatment engagement among diverse patient populations, including those most impacted by AUD.

CLINICAL TRIAL REGISTRATION

Clinicaltrials.gov identifier: NCT05338151.

Process evaluation of Dulce Digital-Me: an adaptive mobile health (mHealth) intervention for underserved Hispanics with diabetes

Type 2 diabetes disproportionately impacts ethnic minorities and individuals from low socioeconomic status. Diabetes self-management education and support has been shown to improve clinical outcomes in these populations, and mobile health (mHealth) interventions can reduce barriers to access. Dulce Digital-Me (DD-Me) was developed to integrate adaptive mHealth technologies to enhance self-management and reduce disparities in the high-risk, underserved Hispanic population. The objective of the present study was to evaluate reach, adoption, and implementation of an mHealth diabetes self-management education and support intervention in this underrepresented population. The present analysis is a multimethod process evaluation using the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework. The study was effective in reaching a sample that was representative of the intended population; only modest but significant differences were observed in sex and age. The DD-Me health coach (HC) cited several important facilitators of intervention adoption, including outreach frequency and personalization, and the automated HC report. Implementation fidelity was high, with participants receiving >90% of intended interventions. Participants who received DD-Me with support from a HC were most engaged, suggesting utility and acceptability of integrating HCs with mHealth interventions. Perceptions of implementation among study participants were positive and consistent across study arms. This evaluation revealed the target population was successfully reached and engaged in the digital health interventions, which was implemented with high fidelity. Further studies should evaluate the efficacy and maintenance of the study following the RE-AIM model to determine whether this intervention warrants expansion to additional settings and populations.

Reach and effectiveness of a centralized navigation program for patients with positive fecal immunochemical tests requiring follow-up colonoscopy

Completion rates for follow-up colonoscopies after an abnormal fecal immunochemical test (FIT) are suboptimal in federally qualified health center (FQHC) settings. We implemented a screening intervention that included mailed FIT outreach to North Carolina FQHC patients from June 2020 to September 2021 and centralized patient navigation to support patients with abnormal FITs in completing follow-up colonoscopy. We evaluated the reach and effectiveness of navigation using electronic medical record data and navigator call logs detailing interactions with patients. Reach assessments included the proportion of patients successfully contacted by phone and who agreed to participate in navigation, intensity of navigation provided (including types of barriers to colonoscopy identified and total navigation time), and differences in these measures by socio-demographic characteristics. Effectiveness outcomes included colonoscopy completion, timeliness of follow-up colonoscopy (i.e., within 9 months), and bowel prep adequacy. Among 514 patients who completed a mailed FIT, 38 patients had an abnormal result and were eligible for navigation. Of these, 26 (68%) accepted navigation, 7 (18%) declined, and 5 (13%) could not be contacted. Among navigated patients, 81% had informational needs, 38% had emotional barriers, 35% had financial barriers, 12% had transportation barriers, and 42% had multiple barriers to colonoscopy. Median navigation time was 48.5 min (range: 24-277 min). Colonoscopy completion differed across groups - 92% of those accepting navigation completed colonoscopy within 9 months, versus 43% for those declining navigation. We found that centralized navigation was widely accepted in FQHC patients with abnormal FIT, and was an effective strategy, resulting in high colonoscopy completion rates.

Research objectives and general considerations for pragmatic clinical trials of pain treatments: IMMPACT statement

ABSTRACT

Many questions regarding the clinical management of people experiencing pain and related health policy decision-making may best be answered by pragmatic controlled trials. To generate clinically relevant and widely applicable findings, such trials aim to reproduce elements of routine clinical care or are embedded within clinical workflows. In contrast with traditional efficacy trials, pragmatic trials are intended to address a broader set of external validity questions critical for stakeholders (clinicians, healthcare leaders, policymakers, insurers, and patients) in considering the adoption and use of evidence-based treatments in daily clinical care. This article summarizes methodological considerations for pragmatic trials, mainly concerning methods of fundamental importance to the internal validity of trials. The relationship between these methods and common pragmatic trials methods and goals is considered, recognizing that the resulting trial designs are highly dependent on the specific research question under investigation. The basis of this statement was an Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials (IMMPACT) systematic review of methods and a consensus meeting. The meeting was organized by the Analgesic, Anesthetic, and Addiction Clinical Trial Translations, Innovations, Opportunities, and Networks (ACTTION) public-private partnership. The consensus process was informed by expert presentations, panel and consensus discussions, and a preparatory systematic review. In the context of pragmatic trials of pain treatments, we present fundamental considerations for the planning phase of pragmatic trials, including the specification of trial objectives, the selection of adequate designs, and methods to enhance internal validity while maintaining the ability to answer pragmatic research questions.

Realist review of community coalitions and outreach interventions to increase access to primary care for vulnerable populations: a realist review

BACKGROUND

There are meaningful gaps in equitable access to Primary Health Care (PHC), especially for vulnerable populations after widespread reforms in Western countries. The Innovative Models Promoting Access-to-Care Transformation (IMPACT) research program is a Canadian-Australian collaboration that aims to improve access to PHC for vulnerable populations. Relationships were developed with stakeholders in six regions across Canada and Australia where access-related needs could be identified. The most promising interventions would be implemented and tested to address the needs identified. This realist review was conducted to understand how community coalition and outreach (e.g., mobile or pop-up) services improve access for underserved vulnerable residents.

OBJECTIVE

To inform the development and delivery of an innovative intervention to increase access to PHC for vulnerable populations.

METHODS

A realist review was conducted in collaboration with the Local Innovative Partnership (LIP) research team and the IMPACT research members who conducted the review. We performed an initial comprehensive systematic search using MEDLINE, EMBASE, PsycINFO, and the Cochrane Library up to October 19, 2015, and updated it on August 8, 2020. Studies were included if they focused on interventions to improve access to PHC using community coalition, outreach services or mobile delivery methods. We included Randomized Controlled Trials (RCTs), and systematic reviews. Studies were screened by two independent reviewers and the Reach, Effectiveness, Adoption, Implementation, and Maintenance (RE-AIM) framework was used for data extraction and framework analysis to obtain themes. The LIP research team was also allowed to suggest additional papers not included at screening.

RESULTS

We included 43 records, comprising 31 RCTs, 11 systematic reviews, and 1 case control study that was added by the LIP research team. We identified three main themes of PHC interventions to promote access for vulnerable residents, including: 1) tailoring of materials and services decreases barriers to primary health care, 2) services offered where vulnerable populations gather increases the "reach" of the interventions, 3) partnerships and collaborations lead to positive health outcomes. In addition, implementation designs and reporting elements should be considered.

CONCLUSION

Realist reviews can help guide the development of locally adapted primary health care interventions.

Effectiveness and implementation of an electronic health record-integrated digital health intervention for managing depressive symptoms in ambulatory oncology: The My Well-Being Guide study rationale and protocol

BACKGROUND

Rates of clinically elevated depressive symptoms among ambulatory oncology patients are higher than in the general population and are associated with poorer health-related quality of life. Furthermore, a reduction in depressive symptoms may be associated with improved cancer survival. Several interventions have demonstrated efficacy in reducing oncologic depressive symptoms, including cognitive-behavioral stress management (CBSM). However, more work is needed to understand how to best implement CBSM into practice, such as through stepped-care approaches and digital health interventions linked to electronic health records (EHR). This manuscript presents the protocol of the My Well-Being Guide study, a pragmatic type 1 effectiveness-implementation hybrid study. This trial will test the effectiveness of My Well-Being Guide, a seven-week structured, CBSM-based digital health intervention designed to reduce depressive symptoms. This trial will also evaluate My Well-Being Guide's implementation across two health systems.

METHODS

The final sample (N = 4561) will be oncology patients at Northwestern Medicine or University of Miami Health System who are ≥18 years of age; have a cancer diagnosis; elevated depressive symptoms on the Patient-Reported Outcomes Measurement Information System Depression; and primary language is English or Spanish. Data collection will occur at baseline, and 2-, 6-, and 12-months post baseline. Outcome domains include depressive symptoms and implementation evaluation.

DISCUSSION

This study may provide valuable data on the effectiveness of our depressive symptom management digital health intervention linked to the EHR and the scalability of digital health interventions in general.

Piloting an online telecoaching community-based exercise intervention with adults living with HIV: protocol for a mixed-methods implementation science study

INTRODUCTION

Our aim is to evaluate the implementation of an online telecoaching community-based exercise (CBE) intervention with the goal of reducing disability and enhancing physical activity and health among adults living with HIV.

METHODS AND ANALYSIS

We will conduct a prospective longitudinal mixed-methods two-phased intervention study to pilot the implementation of an online CBE intervention with ~30 adults (≥18 years) living with HIV who consider themselves safe to participate in exercise. In the intervention phase (0-6 months), participants will take part in an online CBE intervention involving thrice weekly exercise (aerobic, resistance, balance and flexibility), with supervised biweekly personal training sessions with a fitness instructor, YMCA membership providing access to online exercise classes, wireless physical activity monitor to track physical activity and monthly online educational sessions on topics related to HIV, physical activity and health. In the follow-up phase (6-12 months), participants will be encouraged to continue independent exercise thrice weekly. Quantitative assessment: Bimonthly, we will assess cardiopulmonary fitness, strength, weight, body composition and flexibility, followed by administering self-reported questionnaires to assess disability, contextual factor outcomes (mastery, engagement in care, stigma, social support), implementation factors (cost, feasibility, technology), health status and self-reported physical activity. We will conduct a segmented regression analyses to describe the change in level and trend between the intervention and follow-up phases. Qualitative assessment: We will conduct online interviews with a subsample of ~10 participants and 5 CBE stakeholders at baseline (month 0), postintervention (month 6) and end of follow-up (month 12) to explore experiences, impact and implementation factors for online CBE. Interviews will be audiorecorded and analysed using content analytical techniques.

ETHICS AND DISSEMINATION

Protocol approved by the University of Toronto Research Ethics Board (Protocol # 40410). Knowledge translation will occur in the form of presentations and publications in open-access peer-reviewed journals.

TRIAL REGISTRATION NUMBER

NCT05006391.

Facilitators and Barriers to a Hospital-Based Communication Skills Training Programme: An Interview Study

This study aimed to investigate the facilitators and barriers experienced by the department management (DMs) and communication skills trainers (trainers) during the implementation of a 3-day communication skills training (CST) programme for healthcare professionals (HCPs). Thus, we conducted semi-structured interviews with 23 DMs and 10 trainers from 11 departments concurrently implementing the CST programme. Thematic analysis was undertaken to elucidate the themes across the interviews. Five themes were developed: resource consumption; obstacles; management support; efforts and outcomes; and a lack of systematic follow-up. Although the DMs and trainers were largely in agreement, the theme of a lack of systematic follow-up was derived exclusively from the trainers, as were two of the subthemes within obstacles: (b) seniority, profession, and cultural differences, and (c) the trainers' competencies. The greatest perceived barrier was resource consumption. In addition, DMs found planning and staff resistance to be a challenge. However, the HCPs' resistance diminished or even changed to satisfaction after participating. The mandatory approach served as both a facilitator and a barrier; DMs' support was an essential facilitator. Explicit communication related to resource demands, planning, and participation is crucial, as is management support and the allocation of resources.

Effectiveness of Internet-based cognitive-behavioural therapy for obsessive-compulsive disorder (OCD-NET) and body dysmorphic disorder (BDD-NET) in the Swedish public health system using the RE-AIM implementation framework

Objectives

Therapist-guided internet-delivered cognitive behaviour therapy (ICBT) is an efficacious treatment for obsessive-compulsive disorder (OCD) and body dysmorphic disorder (BDD), but it is unclear if the results obtained in controlled trials can be reproduced in clinical settings. We evaluated the implementation of ICBT for OCD (OCD-NET) and BDD (BDD-NET) in the Swedish public health system.

Methods

Consecutive referrals to an outpatient psychiatric clinic providing ICBT, with a primary diagnosis of OCD or BDD, were included in the study. Four hundred and thirty-four participants started OCD-NET and 163 started BDD-NET. The primary outcome measures were the Yale Brown Obsessive Compulsive Scale (Y-BOCS) and the Y-BOCS for BDD (BDD-YBOCS), respectively. Participants were assessed before treatment, weekly during treatment, and after treatment. The study used the RE-AIM implementation framework, and the elements of reach, effectiveness, adoption, and implementation for the evaluation.

Results

Intention to treat analysis of the OCD-NET sample (n = 434) showed a significant decrease in OCD symptoms from pre-treatment to post-treatment (mean reduction = -8.77 [95 % CI -9.48 to -8.05] p < .001, d = 1.94 [95 % CI 1.75 to 2.13]). Forty-nine percent (95 % CI 43 % to 56 %) of the participants in OCD-NET were classified as treatment responders and 21 % (95 % CI 16 % to 27 %) were in remission. Participants in BDD-NET (n = 163) also showed a significant decrease in BDD symptoms from pre-post treatment (mean reduction = -11.37 [95 % CI -12.9 to -9.87] p < .001, d = 2.07 [95 % CI 1.74 to 2.40]) and 69 % (95 % CI 58 % to 79 %) of the participants were classified as treatment responders and 48 % (95 % CI 38 % to 58 %) were in full or partial remission. Eighty-seven percent of the participants in OCD-NET and 78 % in BDD-NET were treatment completers and participants in both treatment groups reported a high treatment satisfaction at post treatment (OCD-NET = 87 %, BDD-NET = 79 %). The most reported negative effects attributed to the treatments were transient experiences of unpleasant feelings (52 %) and anxiety (50 %). The implementation also influenced treatment delivery and dramatically decreased the mean number of patients waiting to receive face-to-face treatment at the clinic.

Conclusions

Our results indicate that OCD-NET and BDD-NET are suitable treatments for implementation in a Swedish public health service.

An Analysis of the Role of Mental Health in a Randomized Trial of a Walking Intervention for Black Veterans With Chronic Pain

Black patients and those with co-occurring mental health disorders are disproportionately affected by chronic pain, but few interventions target these populations. This is a secondary analysis of a randomized trial of a walking-focused proactive counseling intervention for Black Veterans with chronic musculoskeletal pain (ACTION). The primary aim was to examine intervention effectiveness among Veterans with an electronic health record-documented mental health diagnosis [depressive disorder, anxiety disorder, substance use disorder, post-traumatic stress disorder or serious mental illness (n = 205)] and those without a diagnosis (n = 175). About 380 Black Veterans receiving care at the Atlanta VA Health Care System were enrolled from 2016 to 2019 and randomized to the intervention or usual care (UC) (1:1). The intervention featured 6 telephone coaching sessions over 8-14 weeks to encourage walking. Participants with a mental health disorder were more likely to complete all counseling sessions (56% vs 38%) and reported improvements in global perceptions of pain and pain intensity/interference (secondary outcomes) at 3-months vs UC. Among participants without a mental health disorder, the intervention was associated with an improvement in pain-related disability at 6-months (primary outcome). Black chronic pain patients with co-occurring mental health disorders may require more intensive treatment to affect improvement in pain-related disability. PERSPECTIVE: This study examines the effectiveness of a walking intervention for chronic pain among Black Veterans with a mental health disorder. These patients were more engaged with the intervention than those without a mental health disorder. However, they did not experience reductions in pain-related disability, suggesting more intensive treatment is needed.

Key Considerations and Recommended Strategies for Conducting a School-Based Longitudinal RE-AIM Evaluation: Insights From a 28-School Cluster Randomized Trial

RE-AIM is an implementation science framework that provides a structure to promote data collection and analysis in the domains of Reach, Efficacy/Effectiveness, Adoption, Implementation, and Maintenance. The RE-AIM approach promotes more data collection and reporting than typical evaluations so potential adopters can determine the potential program fit for their setting. RE-AIM has been used to evaluate a variety of programs; however, there are few resources that provide strategies for conducting a RE-AIM evaluation in the school setting. The purpose of this article is to inform future studies by elucidating experiences conducting a large, complex, multisite, longitudinal RE-AIM evaluation in schools in partnership with the state's Departments of Education and Health, and to share strategies for overcoming obstacles. With the long-term goal of facilitating the translation of school-based intervention research into practice, we provide key considerations and recommend strategies for school-based RE-AIM evaluation success.

Designing and Implementing TeleBehavioral Health Training to Support Rapid and Enduring Transition to Virtual Care in the COVID Era

As telebehavioral health continues to advance and become part of routine care, there is a need to develop effective training methods. While a consensus on how to best train telebehavioral health has not yet been achieved, this commentary will describe how evidence-based implementation strategies were used to develop a framework to create and implement a telebehavioral health training program that is relevant and enduring for a given audience. Evidence-based implementation strategies included the PARiHS criteria which were used to organize the project. Re-AIM criteria was used to organize chosen outcome measures. Important partnerships were formed to help support infrastructure as well as regional and national reach. A series of Plan-Do-Study-Act loops were used to inform progressive training series. Since April 2020, the Behavioral Health Institute has developed and offered 6 unique telebehavioral health training series, employing both webinar and online formats, and addressing core components as well as more advanced concepts. These series have provided over 19,100 accredited continuing education hours of training through June 2022, to almost 3000 unique learners via webinar and nearly 6800 unique online learners, across 45 states. Evaluations rated these trainings as high quality, relevant, and that material would likely be implemented. Feedback from attendees was considered vital in series planning. This commentary discusses how evidence-based implementation strategies can be used to create a framework upon which to base a training program for health care providers. An example is given on how this framework was used to create successful, relevant, and enduring telebehavioral health training.

Towards more personalized digital health interventions: a clustering method of action and coping plans to promote physical activity

BACKGROUND

Despite effectiveness of action and coping planning in digital health interventions to promote physical activity (PA), attrition rates remain high. Indeed, support to make plans is often abstract and similar for each individual. Nevertheless, people are different, and context varies. Tailored support at the content level, involving suggestions of specific plans that are personalized to the individual, may reduce attrition and improve outcomes in digital health interventions. The aim of this study was to investigate whether user information relates toward specific action and coping plans using a clustering method. In doing so, we demonstrate how knowledge can be acquired in order to develop a knowledge-base, which might provide personalized suggestions in a later phase.

METHODS

To establish proof-of-concept for this approach, data of 65 healthy adults, including 222 action plans and 204 coping plans, were used and were collected as part of the digital health intervention MyPlan 2.0 to promote PA. As a first step, clusters of action plans, clusters of coping plans and clusters of combinations of action plans and barriers of coping plans were identified using hierarchical clustering. As a second step, relations with user information (i.e. gender, motivational stage, ...) were examined using anova's and chi²-tests.

RESULTS

First, three clusters of action plans, eight clusters of coping plans and eight clusters of the combination of action and coping plans were identified. Second, relating these clusters to user information was possible for action plans: 1) Users with a higher BMI related more to outdoor leisure activities (F = 13.40, P < .001), 2) Women, users that didn't perform PA regularly yet, or users with a job related more to household activities (X² = 16.92, P < .001; X² = 20.34, P < .001; X² = 10.79, P = .004; respectively), 3) Younger users related more to active transport and different sports activities (F = 14.40, P < .001). However, relating clusters to user information proved difficult for the coping plans and combination of action and coping plans.

CONCLUSIONS

The approach used in this study might be a feasible approach to acquire input for a knowledge-base, however more data (i.e. contextual and dynamic user information) from possible end users should be acquired in future research. This might result in a first type of context-aware personalized suggestions on the content level.

TRIAL REGISTRATION

The digital health intervention MyPlan 2.0 was preregistered as a clinical trial (ID:NCT03274271). Release date: 6-September-2017.

Disseminating education to solid organ transplant recipients to promote engagement in physical activity

Objective

To evaluate the dissemination of education through a workshop to promote engagement in physical activity (PA) among solid organ transplant (SOT) recipients.

Methods

The in-person workshop consisted of expert-led lectures on topics related to physical activity (day 1) and sports and fitness training with volunteer coaches (day 2). There were separate streams for children/adolescents and adults. RE-AIM (Reach, Efficacy, Adoption, Implementation, and Maintenance) framework was used to evaluate the impact of the workshop. Presenters and participants completed evaluations of the workshop using a 5-point Likert scale. A subgroup of adults completed a self-reported PA questionnaire at baseline and 4-weeks after the workshop.

Results

103 individuals (71 SOT recipients, 32 caregivers) attended the workshop (ages 4 to 71+ years). Sessions were highly rated (median = 5) for both quality and content on both days. There was no significant change (p = 0.16) in PA. However, 56% of SOT recipients reported changing their level of PA.

Conclusion

An educational-workshop with hands-on training was an efficient and well-received method for disseminating awareness about the benefits of PA in SOT recipients.

Innovation

Dissemination of evidence-based knowledge through a novel educational-workshop in a real-world setting has the potential to inform the decisions about PA behavior among SOT recipients.

Developing criteria for research translation decision-making in community settings: a systematic review and thematic analysis informed by the Knowledge to Action Framework and community input

Background

There is a pressing need to translate empirically supported interventions, products, and policies into practice to prevent and control prevalent chronic diseases. According to the Knowledge to Action (K2A) Framework, only those interventions deemed “ready” for translation are likely to be disseminated, adopted, implemented, and ultimately institutionalized. Yet, this pivotal step has not received adequate study. The purpose of this paper was to create a list of criteria that can be used by researchers, in collaboration with community partners, to help evaluate intervention readiness for translation into community and/or organizational settings.

Methods

The identification and selection of criteria involved reviewing the K2A Framework questions from the “decision to translate” stage, conducting a systematic review to identify characteristics important for research translation in community settings, using thematic analysis to select unique research translation decision criteria, and incorporating researcher and community advisory board feedback.

Results

The review identified 46 published articles that described potential criteria to decide if an intervention appears ready for translation into community settings. In total, 17 unique research translation decision criteria were identified. Of the 8 themes from the K2A Framework that were used to inform the thematic analysis, all 8 were included in the final criteria list after research supported their importance for research translation decision-making. Overall, the criteria identified through our review highlighted the importance of an intervention’s public health, cultural, and community relevance. Not only are intervention characteristics (e.g., evidence base, comparative effectiveness, acceptability, adaptability, sustainability, cost) necessary to consider when contemplating introducing an intervention to the “real world,” it is also important to consider characteristics of the target setting and/or population (e.g., presence of supporting structure, support or buy-in, changing sociopolitical landscape).

Conclusions

Our research translation decision criteria provide a holistic list for identifying important barriers and facilitators for research translation that should be considered before introducing an empirically supported intervention into community settings. These criteria can be used for research translation decision-making on the individual and organizational level to ensure resources are not wasted on interventions that cannot be effectively translated in community settings to yield desired outcomes.

Impact of the COVID-19 Pandemic on Exercise Physiology Services in Australia: A Retrospective Audit

Introduction

The COVID-19 pandemic has led to a shift in healthcare towards telehealth delivery, which presents challenges for exercise physiology services. We aimed to examine the impact of the COVID-19 pandemic on the reach, efficacy, adoption and implementation of telehealth delivery for exercise physiology services by comparing Australian practises before (prior to 25 January 2020) and during the COVID-19 pandemic (after 25 January 2020).

Methods

This retrospective audit included 80 accredited exercise physiology clinicians. We examined relevant dimensions of the RE-AIM framework (reach, effectiveness, adoption and implementation) from the clinician perspective.

Results

During the COVID-19 pandemic, 91% (n = 73/80) of surveyed clinicians offered telehealth delivery service, compared to 25% (n = 20/80) prior. Mean (SD) telehealth delivery per week doubled from 5 (7) to 10 (8) hours. In-person delivery decreased from 23 (11) to 15 (11) hours per week. Typical reasons for not offering telehealth delivery were client physical/cognitive incapacity (n = 33/80, 41%) and safety (n = 24/80, 30%). Clinician-reported reasons for typical clients not adopting telehealth delivery were personal preference (n = 57/71, 80%), physical capacity (n = 35/71, 49%) and access to reliable delivery platforms (n = 27/71, 38%). Zoom (n = 54/71, 76%) and telephone (n = 53/71, 75%) were the most commonly used platforms. Of the reasons contributing to incomplete treatment, lack of confidence in delivery mode was sevenfold higher for telehealth compared to in-person delivery. No serious treatment-related adverse events were reported.

Conclusions

During the COVID-19 pandemic, telehealth delivery of exercise physiology services increased and in-person delivery decreased, which suggests the profession was adaptable and agile. However, further research determining comparative efficacy and cost-effectiveness is warranted.

Supplementary Information

The online version contains supplementary material available at 10.1186/s40798-022-00483-2.

Implementation of a Coaching Program by a National Surgical Association

OBJECTIVE

Using the reach, effectiveness, adoption, implementation and maintenance (RE-AIM) framework for implementation science, we describe the implementation and impact of a virtual coaching program designed and conducted through a national surgical organization.

DESIGN

The Association of Women Surgeons recruited and trained surgical faculty as coaches with no prior training in positive psychology to coach surgical residents. Coaching pairs completed three coaching sessions center on strength recognition, personal and professional fulfillment, and work life integration.

SETTING

The initial coaching training was in person at a national conference, while subsequent training sessions and all coaching sessions were held remotely.

PARTICIPANTS

A total of 75 coaches were trained and 121 surgical residents participated in the program.

RESULTS

Coachees noted improvement in goal setting, self-confidence, and working relationships. Coaches noted improvement in communication skills both during and outside of the coaching experience. Eighty-six percent of coaches recommended implementing a coaching program at their home institution. This program has served as model for additional programs through other associations and institutions.

CONCLUSIONS

The Coaching Project demonstrates the feasibility implementing a coaching project for coaching surgical residents, teaching new communication skills to coaches, while providing wellness benefits to coachees.

A family carer decision support intervention for people with advanced dementia residing in a nursing home: a study protocol for an international advance care planning intervention (mySupport study)

Background

Where it has been determined that a resident in a nursing home living with dementia loses decisional capacity, nursing home staff must deliver care that is in the person's best interests. Ideally, decisions should be made involving those close to the person, typically a family carer and health and social care providers. The aim of the Family Carer Decisional Support intervention is to inform family carers on end-of-life care options for a person living with advanced dementia and enable them to contribute to advance care planning. This implementation study proposes to; 1) adopt and apply the intervention internationally; and, 2) train nursing home staff to deliver the family carer decision support intervention.

Methods

This study will employ a multiple case study design to allow an understanding of the implementation process and to identify the factors which determine how well the intervention will work as intended. We will enrol nursing homes from each country (Canada n = 2 Republic of Ireland = 2, three regions in the UK n = 2 each, The Netherlands n = 2, Italy n = 2 and the Czech Republic n = 2) to reflect the range of characteristics in each national and local context. The RE-AIM (reach, effectiveness, adoption, implementation, maintenance) framework will guide the evaluation of implementation of the training and information resources. Our mixed methods study design has three phases to (1) establish knowledge about the context of implementation, (2) participant baseline information and measures and (3) follow up evaluation.

Discussion

The use of a multiple case study design will enable evaluation of the intervention in different national, regional, cultural, clinical, social and organisational contexts, and we anticipate collecting rich and in-depth data. While it is hoped that the intervention resources will impact on policy and practice in the nursing homes that are recruited to the study, the development of implementation guidelines will ensure impact on wider national policy and practice. It is our aim that the resources will be sustainable beyond the duration of the study and this will enable the resources to have a longstanding relevance for future advance care planning practice for staff, family carers and residents with advanced dementia.

Inner and outer setting factors that influence the implementation of the National Diabetes Prevention Program (National DPP) using the Consolidated Framework for Implementation Research (CFIR): a qualitative study

BACKGROUND

Scaling evidence-based interventions are key to impacting population health. The National DPP lifestyle change program is one such intervention that has been scaled across the USA over the past 20 years; however, enrollment is an ongoing challenge. Furthermore, little is known about which organizations are most successful with program delivery, enrollment, and scaling. This study aims to understand more about the internal and external organization factors that impact program implementation and reach.

METHODS

Between August 2020 and January 2021, data were collected through semi-structured key informant interviews with 30 National DPP delivery organization implementers. This study uses a qualitative cross-case construct rating methodology to assess which Consolidated Framework for Implementation Research (CFIR) inner and outer setting constructs contributed (both in valence and magnitude) to the organization's current level of implementation reach (measured by average participant enrollment per year). A construct by case matrix was created with ratings for each CFIR construct by interviewee and grouped by implementation reach level.

RESULTS

Across the 16 inner and outer setting constructs and subconstructs, the interviewees with greater enrollment per year provided stronger and more positive examples related to implementation and enrollment of the program, while the lower reach groups reported stronger and more negative examples across rated constructs. Four inner setting constructs/subconstructs (structural characteristics, compatibility, goals and feedback, and leadership engagement) were identified as "distinguishing" between enrollment reach levels based on the difference between groups by average rating, the examination of the number of extreme ratings within levels, and the thematic analysis of the content discussed. Within these constructs, factors such as organization size and administrative processes; program fit with existing organization services and programs; the presence of enrollment goals; and active leadership involvement in implementation were identified as influencing program reach.

CONCLUSIONS

Our study identified a number of influential CFIR constructs and their impact on National DPP implementation reach. These findings can be leveraged to improve efforts in recruiting and assisting delivery organizations to increase the reach and scale of the National DPP as well as other evidence-based interventions.

Improved active participation among patients with severe acquired brain injury in early rehabilitation: Implementation of a professional competence development intervention

BACKGROUND: In 2019, an educational programme was implemented in a sub-acute in-hospital neurorehabilitation clinic for patients with severe acquired brain injury (sABI). The programme was initiated to enhance staff competencies related to identifying and improving active participation among patients with sABI. OBJECTIVE: The purpose was to evaluate the implementation effectiveness of the educational programme. METHODS: Mixed methods were chosen to assess implementation effectiveness as perceived by staff and patients. RESULTS: A survey of the professional’s experience showed an increase in perceived competence after each completed seminar and from before the first seminar to after the last completed seminar. These results were confirmed and elaborated through staff focus group interviews. The proportion of patients achieving active participation increased from 45% before to 75% after implementation (six of eight patients). CONCLUSION: Exploring the implementation effectiveness of the educational programme seemed clinically valuable and showed a promising and probable effect of an implementation process.

Integrating community engagement with implementation science to advance the measurement of translational science

This special communication provides an approach for applying implementation science frameworks to a Clinical and Translational Science Institutes (CTSIs) community engagement (CE) program that measures the use of implementation strategies and outcomes that promote the uptake of CE in research. Using an iterative multi-disciplinary group process, we executed a four-phased approach to developing an evaluation plan: 1) creating an evaluation model adapted from Proctor's conceptual model of implementation research; 2) mapping implementation strategies to CTSI CE program interventions that support change in research practice; 3) identifying and operationalizing measures for each strategy; and 4) conducting an evaluation. Phase 2 employed 73 implementation strategies across 9 domains generated by the Expert Recommendations for Implementing Change project. The nine domains were used to classify each CE program implementation strategy. In Phase 3, the group used the Reach, Effectiveness, Adoption, Implementation and Maintenance (RE-AIM) framework to define measures for each individual strategy. Phase 4 demonstrates the application of this framework and measures Year 1 outcomes for the strategy providing interactive assistance, which we implemented using a centralized consultation model. This approach can support the CTSA program in operationalizing CE program measurement to demonstrate which activities and strategies may lead to benefits derived by the program, institution, and community.

An asthma collaboration to reduce childhood asthma disparities on the Navajo Nation: Trial protocol for the Community Asthma Program

Navajo children disproportionately experience poor asthma outcomes. Following a one-year community engagement period with key stakeholders from the Navajo Nation, the Community Asthma Program (CAP) was created using evidenced based programs with the goal of reducing asthma disparities among Navajo children. CAP is being evaluated with a six-year, multi-site step-wedge design in three Navajo communities: Tuba City, Chinle and Fort Defiance, Arizona. The primary outcome is asthma exacerbations defined as use of systemic oral corticosteroids, asthma hospitalizations, asthma related ED visits, and ICU admissions. Asthma exacerbations will be measured using data from the electronic medical records of the three community health care centers. Secondary outcomes include will changes in asthma-related events and asthma control. The RE-AIM ( R each and representativeness, 2) E ffectiveness, 3) A doption, 4) I mplementation, and 5) M aintenance) framework is being used to guide the implementation evaluation which includes iterative collection and analysis of process data to identify facilitators and barriers, describe relevant organizational contexts, and inform strategies for dissemination. The CAP intervention requires community engagement and participation, building community capacity, incorporating evidenced-based guidelines and practices while ensuring program strategies actively involve Navajo community members during all steps of the intervention. The outcome of this trial will allow us to determine the effectiveness of a multi-component, community-focused intervention to improve asthma in a tribal community.

Short‐ and long‐term strategies for navigating research‐ambivalent organizational cultures besetting embedded researchers

Many health systems may host embedded researchers (ERs) and provide fiscal resources to encourage health service research. However, ERs may remain challenged to initiate research in these settings. This discussion examines how health system culture may impede research initiation, thereby exposing a paradox for embedded researchers immersed in research-ambivalent health systems. The discussion ultimately describes potential short-term and long-term strategies embedded researchers may employ to initiate scholarly inquiry in research-ambivalent health systems.

Using Implementation Science to Promote Integration and Sustainability of Community Health Workers in the HIV Workforce

BACKGROUND

Community health worker (CHW) interventions are an evidence-based practice adopted by health care settings to increase retention in care and viral suppression for people living with HIV (PLWH) from racial/ethnic minority communities. However, disparate funding, unclear roles vis a vis other care team members, limited training and promotion opportunities, and a lack of standards for wages and tasks limit the ability to effectively use CHWs as part of the health care team. Guided by the Exploration, Preparation, Implementation, and Sustainment and Reach, Effectiveness, Adoption, Implementation, and Maintenance frameworks, this study describes the key determinants for CHW integration and sustainability at 3 agencies in Shelby County, TN, to improve viral suppression and reduce disparities among rural and urban people living with HIV.

SETTING

Memphis Transitional Grant Area (TGA) which includes 8 rural and urban counties in west Tennessee, Arkansas, and Mississippi.

METHODS

Seventeen key informants were identified using purposeful and snowball sampling techniques, including community and agency leadership staff, frontline staff, and faith leaders.

RESULTS

Key determinants of CHW integration include establishing clear and standardized CHW roles within and across organizations, facilitating interorganizational networks, and leveraging funds for livable CHW wages and sustainable positions. Training strategies that strengthen the CHW workforce include content related to trauma-informed care, managing stress, and cultural humility.

CONCLUSION

Several inner and outer settings and innovation and bridging factors affect CHW positions. Data collected will inform the implementation and sustainment of future policies and interventions intended to improve HIV care continuum outcomes and reduce disparities for PLWH.

Protocol paper: Multi-site, cluster-randomized clinical trial for optimizing functional outcomes of older cancer survivors after chemotherapy

BACKGROUND

Cancer survivors over the age of 65 have unique needs due to the higher prevalence of functional and cognitive impairment, comorbidities, geriatric syndromes, and greater need for social support after chemotherapy. In this study, we will evaluate whether a Geriatric Evaluation and Management-Survivorship (GEMS) intervention improves functional outcomes important to older cancer survivors following chemotherapy.

METHODS

A cluster-randomized trial will be conducted in approximately 30 community oncology practices affiliated with the University of Rochester Cancer Center (URCC) National Cancer Institute Community Oncology Research Program (NCORP) Research Base. Participating sites will be randomized to the GEMS intervention, which includes Advanced Practice Practitioner (APP)-directed geriatric evaluation and management (GEM), and Survivorship Health Education (SHE) that is combined with Exercise for Cancer Patients (EXCAP©®), or usual care. Cancer survivors will be recruited from community oncology practices (of participating oncology physicians and APPs) after the enrolled clinicians have consented and completed a baseline survey. We will enroll 780 cancer survivors aged 65 years and older who have completed curative-intent chemotherapy for a solid tumor malignancy within four weeks of study enrollment. Cancer survivors will be asked to choose one caregiver to also participate for a total up to 780 caregivers. The primary aim is to compare the effectiveness of GEMS for improving patient-reported physical function at six months. The secondary aim is to compare effectiveness of GEMS for improving patient-reported cognitive function at six months. Tertiary aims include comparing the effectiveness of GEMS for improving: 1) Patient-reported physical function at twelve months; 2) objectively assessed physical function at six and twelve months; and 3) patient-reported cognitive function at twelve months and objectively assessed cognitive function at six and twelve months. Exploratory health care aims include: 1) Survivor satisfaction with care, 2) APP communication with primary care physicians (PCPs), 3) completion of referral appointments, and 4) hospitalizations at six and twelve months. Exploratory caregiver aims include: 1) Caregiver distress; 2) caregiver quality of life; 3) caregiver burden; and 4) satisfaction with patient care at six and twelve months.

DISCUSSION

If successful, GEMS would be an option for a standardized APP-led survivorship care intervention.

TRIAL REGISTRATION

ClinicalTrials.govNCT05006482, registered on August 9, 2021.

Deploying a telemedicine collaborative care intervention for posttraumatic stress disorder in the U.S. Department of Veterans Affairs: A stepped wedge evaluation of an adaptive implementation strategy

OBJECTIVE

To address barriers to trauma-focused psychotherapy for veterans with posttraumatic stress disorder (PTSD), we compared two implementation strategies to promote the deployment of telemedicine collaborative care.

METHOD

We conducted a Hybrid Type III Effectiveness Implementation trial at six VA medical centers and their 12 affiliated Community Based Outpatient Clinics. The trial used a stepped wedge design and an adaptive implementation strategy that started with standard implementation, followed by enhanced implementation for VA medical centers that did not achieve the performance benchmark. Implementation outcomes for the 544 veterans sampled from the larger population targeted by the intervention were assessed from chart review (care management enrollment and receipt of trauma-focused psychotherapy) and telephone survey (perceived access and PTSD symptoms) after each implementation phase. The primary outcome was enrollment in care management.

RESULTS

There was no significant difference between standard implementation and enhanced implementation on any of the implementation outcomes. 41.6% of sampled veterans had a care manager encounter, but only 6.0% engaged in trauma-focused psychotherapy.

CONCLUSIONS

While telemedicine collaborative care was shown to be effective at engaging veterans in trauma-focused psychotherapy in a randomized controlled trial, neither standard nor enhanced implementation strategies were sufficient to support successful deployment into routine care.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT02737098.

Electronic health record-embedded decision support to reduce stroke risk in patients with atrial fibrillation - Study protocol

BACKGROUND

Atrial fibrillation (AF) is the most common significant cardiac rhythm disorder and is a powerful common risk factor for stroke. Randomized trials have demonstrated that anticoagulation can reduce the risk of stroke in patients with AF. Yet, there continues to be widespread underutilization of this therapy. To address this practice gap locally and improve efforts to reduce the risk of stroke for patients with AF in our health system, we have designed a study to implement and evaluate the effectiveness of an Atrial Fibrillation Decision Support Tool (AFDST) embedded within our electronic health record.

METHODS

Our intervention is provider-facing and focused on decision support. The clinical setting is ambulatory patients being seen by primary care physicians. Patients include those with both incident and prevalent AF. This randomized, prospective trial will enroll 800 patients in our University of Cincinnati Health System who are currently receiving less than optimal anticoagulation therapy as determined by the AFDST. Patients will be randomized to one of two arms - 1) usual care, in which the AFDST is available for use; 2) addition of a best practice advisory (BPA) to the AFDST notifying the clinician that their patient stands to gain a significant benefit from a change in their current thromboprophylactic therapy.

RESULTS

The primary outcome is effectiveness of the BPA measured by change to "appropriate thromboprophylaxis" based on the AFDST recommendation at 3 months post randomization. Secondary endpoints include Reach and Adoption, from the RE-AIM framework for implementation studies. Sample size is based upon an improvement from inappropriate to appropriate anticoagulation therapy estimated at 4% in the usual care arm and ≥10% in the experimental arm.

CONCLUSION

Our goal is to examine whether addition of a BPA to an AFDST focused on primary care physicians in an ambulatory care setting will improve "appropriate thromboprophylaxis" compared with usual care. Results will be examined at 3 months post randomization and at the end of the study to evaluate durability of changes. We expect to complete patient enrollment by the end of June 2022.

TRIAL REGISTRATION

Clinicaltrials.gov NCT04099485.

Effectiveness of social giving on the engagement of pharmacy professionals with a computer-based education platform: a pilot randomized controlled trial

BACKGROUND

Computer-based education is gaining popularity in healthcare professional development education due to ease of distribution and flexibility. However, there are concerns regarding user engagement. This pilot study aims to: 1) assess the feasibility and acceptability of a social reward and the corresponding study design; and 2) to provide preliminary data on the impact of social reward on user engagement.

METHODS

A mixed method study combing a four-month pilot randomized controlled trial (RCT), surveys and interviews. The RCT was conducted using a computer-based education platform. Participants in the intervention group had access to a social reward feature, where they earned one meal for donation when completing a quiz with a passing score. Participants in the control group did not have access to this feature. Feasibility and acceptability of the social reward were assessed using surveys and telephone interviews. Feasibility of the RCT was assessed by participant recruitment and retention. User engagement was assessed by number of quizzes and modules completed.

RESULTS

A total of 30 pharmacy professionals were recruited with 15 users in each arm. Participants reported high acceptability of the intervention. The total number of quizzes completed by the intervention group was significantly higher compared to the control group (n = 267 quizzes Vs. n = 97 quizzes; p-value 0.023).

CONCLUSION

The study demonstrates the feasibility and acceptability of a web-based trial with pharmacy professionals and the social reward intervention. It also shows that the social reward can improve user engagement. A future definitive RCT will explore the sustainability of the intervention.

Evaluation of a systems ergonomics-based incident reporting system

INTRODUCTION

Incident reporting and learning systems are a fundamental component of safety management. The purpose of this study was to evaluate a novel incident reporting system specific to the Australian Led Outdoor Activity (LOA) sector. The Understanding and Preventing Led Outdoor Accidents Data System (UPLOADS), is a recently introduced systems thinking-based incident reporting and learning system that utilises contemporary safety theory and methods.

METHOD

The implementation of UPLOADS was evaluated using the RE-AIM framework based on the following dimensions: Reach, Efficacy, Adoption, Implementation, and Maintenance. A pragmatic evaluation approach was used in which evaluation data were collected through the triangulation of multiple sources including different LOA stakeholders from both the individual organisational level (LOA providers) and LOA sector governance level (LOA industry representatives), incident data collected through the UPLOADS National Incident Dataset, and the online and physical presence of UPLOADS.

RESULTS

The findings show that a key strength of UPLOADS is its effectiveness as incident reporting tool for improving safety in the LOA sector. However, a weakness of UPLOADS is that it is not being implemented appropriately by the LOA providers.

CONCLUSION

Overall, the current findings suggest that UPLOADS incident reporting tool is perceived by SMEs as an effective tool for improving safety in LOA. However, further work is required for UPLOADS to have a greater impact on the LOA sector. Specifically, Implementation of the UPLOADS system requires improvement, as well as additional training and education may be required to upskill and empower LOA providers to improve reporting and enhance the value placed on safety by LOA stakeholders. The RE-AIM framework was an appropriate evaluation framework for understanding the effectiveness of UPLOADS as a LOA sector specific incident reporting and learning system.

PRACTICAL APPLICATIONS

The current findings have practical implications for ergonomics researchers applying evaluation frameworks in the real world, and LOA providers for implementing safety interventions. Lastly, contemporary systems-based incident reporting and learning systems have the capability to enhance the safety practices of the LOA sector.