Implementation fidelity of a clinical medication review intervention: process evaluation

Structured medication reviews in Parkinson's disease: pharmacists' views, experiences and needs - a qualitative study

Background

Executing structured medication reviews (SMRs) in primary care to optimize drug treatment is considered standard care of community pharmacists in the Netherlands. Patients with Parkinson's disease (PD) often face complex drug regimens for their symptomatic treatment and might, therefore, benefit from an SMR. However, previously, no effect of an SMR on quality of life in PD was found. In trying to improve the case management of PD, it is interesting to understand if and to what extent SMRs in PD patients are of added value in the pharmacist's opinion and what are assumed facilitating and hindering factors.

Objectives

To analyse the process of executing SMRs in PD patients from a community pharmacist's point of view.

Design

A cross-sectional, qualitative study was performed, consisting of face-to-face semi-structured in-depth interviews.

Methods

The interviews were conducted with community pharmacists who executed at least one SMR in PD, till data saturation was reached. Interviews were transcribed verbatim, coded and analysed thematically using an iterative approach.

Results

Thirteen pharmacists were interviewed. SMRs in PD were considered of added value, especially regarding patient contact and bonding, individualized care and its possible effect in the future, although PD treatment is found already well monitored in secondary care. Major constraints were time, logistics and collaboration with medical specialists.

Conclusion

Although community pharmacist-led SMRs are time-consuming and sometimes logistically challenging, they are of added value in primary care in general, and also in PD, of which treatment occurs mainly in secondary care. It emphasizes the pharmacist's role in PD treatment and might tackle future drug-related issues. Improvements concern multidisciplinary collaboration for optimized SMR execution and results.

Assessing implementation fidelity of an on-site pharmacist intervention within Australian residential aged care facilities: A mixed methods study

BACKGROUND

An on-site pharmacist (OSP) intervention was implemented which sought to improve medication management within residential aged care facilities (RACFs) in the Australian Capital Territory, Australia. The objectives of this mixed methods study were to evaluate the implementation fidelity of the OSP intervention and to determine the moderating factors which influenced delivery of this intervention.

METHODS

This convergent parallel mixed methods study was underpinned by Hasson's conceptual framework for implementation fidelity. Implementation fidelity for seven intervention RACFs was quantitatively assessed using three quantitative data sets: (1) range of OSP intervention activities delivered; (2) random sample of 10% of medication reviews assessed for quality; (3) proportion of residents who received at least one medication review. Semi-structured interviews (n = 14) with managers and OSPs across the intervention RACFs were conducted to identify moderating factors which may have influenced OSP intervention delivery.

RESULTS

The OSP intervention was generally delivered as intended with overall medium levels of implementation fidelity. This delivery was supported by a range of facilitation strategies with most participants perceiving that the intervention was delivered to a high standard. RACF managers and OSPs were mostly well engaged and responsive. A number of potential barriers (including the part-time OSP role, COVID-19 pandemic, RACFs spread out over a large area with significant distance between resident dwellings) and facilitators (including the pharmacist support meetings, OSPs who took time to establish relationships, RACF managers who actively supported OSPs and worked with them) for OSP intervention delivery were identified which have potential implications for the roll out of OSPs within Australian RACFs.

CONCLUSION

In this study, the implementation fidelity of OSP intervention delivery was assessed with overall medium levels of fidelity found across the intervention RACFs. This suggested that the OSP intervention can generally be delivered as intended in real world RACFs. OSP intervention delivery was influenced by a range of moderating factors, some of which posed barriers and others which facilitated the OSP intervention being delivered as intended.

Protocol for the process evaluation of a counselling intervention designed to educate cancer patients on complementary and integrative health care and promote interprofessional collaboration in this area (the CCC-Integrativ study)

Background

Conducting a process evaluation is essential to understand how health interventions work in different healthcare settings. Particularly in the case of complex interventions, it is important to find out whether the intervention could be carried out as planned and which factors had a beneficial or hindering effect on its implementation. The aim of this study is to present the detailed protocol of the process evaluation embedded in the controlled implementation study CCC-Integrativ aiming to implement an interprofessional counselling program for cancer patients on complementary and integrative health care (CIH).

Methods

This mixed methods study will draw upon the “Consolidated Framework for Implementation Research” (CFIR) combined with the concept of “intervention fidelity” to evaluate the quality of the interprofessional counselling sessions, to explore the perspective of the directly and indirectly involved healthcare staff, as well as to analyze the perceptions and experiences of the patients. The qualitative evaluation phase consists of analyzing audio-recorded counselling sessions, as well as individual and group interviews with the involved persons. The quantitative evaluation phase applies questionnaires which are distributed before (T0), at the beginning (T1), in the middle (T2) and at the end (T3) of the intervention delivery.

Discussion

This protocol provides an example of how a process evaluation can be conducted parallel to a main study investigating and implementing a complex intervention. The results of this mixed methods research will make it possible to identify strengths and weaknesses of the team-based intervention, and to target more specifically the key factors and structures required to implement healthcare structures to meet patients’ unmet needs in the context of CIH. To our knowledge, this study is the first applying the CFIR framework in the context of interprofessional CIH counselling, and its results are expected to provide comprehensive and multidisciplinary management of cancer patients with complex supportive healthcare needs.

Measuring implementation fidelity in a cluster-randomized pragmatic trial: development and use of a quantitative multi-component approach

BACKGROUND

In pragmatic trials, on-site partners, rather than researchers, lead intervention delivery, which may result in implementation variation. There is a need to quantitatively measure this variation. Applying the Framework for Implementation Fidelity (FIF), we develop an approach for measuring variability in site-level implementation fidelity. This approach is then applied to measure site-level fidelity in a cluster-randomized pragmatic trial of Music & MemorySM (M&M), a personalized music intervention targeting agitated behaviors in residents living with dementia, in US nursing homes (NHs).

METHODS

Intervention NHs (N = 27) implemented M&M using a standardized manual, utilizing provided staff trainings and iPods for participating residents. Quantitative implementation data, including iPod metadata (i.e., song title, duration, number of plays), were collected during baseline, 4-month, and 8-month site visits. Three researchers developed four FIF adherence dimension scores. For Details of Content, we independently reviewed the implementation manual and reached consensus on six core M&M components. Coverage was the total number of residents exposed to the music at each NH. Frequency was the percent of participating residents in each NH exposed to M&M at least weekly. Duration was the median minutes of music received per resident day exposed. Data elements were scaled and summed to generate dimension-level NH scores, which were then summed to create a Composite adherence score. NHs were grouped by tercile (low-, medium-, high-fidelity).

RESULTS

The 27 NHs differed in size, resident composition, and publicly reported quality rating. The Composite score demonstrated significant variation across NHs, ranging from 4.0 to 12.0 [8.0, standard deviation (SD) 2.1]. Scaled dimension scores were significantly correlated with the Composite score. However, dimension scores were not highly correlated with each other; for example, the correlation of the Details of Content score with Coverage was τb = 0.11 (p = 0.59) and with Duration was τb = - 0.05 (p = 0.78). The Composite score correlated with CMS quality star rating and presence of an Alzheimer's unit, suggesting face validity.

CONCLUSIONS

Guided by the FIF, we developed and used an approach to quantitatively measure overall site-level fidelity in a multi-site pragmatic trial. Future pragmatic trials, particularly in the long-term care environment, may benefit from this approach.

TRIAL REGISTRATION

Clinicaltrials.gov NCT03821844. Registered on 30 January 2019, https://clinicaltrials.gov/ct2/show/NCT03821844 .

Development of a primary care pharmacy outcomes framework: An umbrella literature review

BACKGROUND

An aging population and rising multi-morbidity has shifted healthcare provision from secondary to primary care. Pharmacy-led services have been introduced to support this. The development of an outcomes framework for these services would facilitate conclusions to be drawn on their effectiveness.

OBJECTIVES

To identify outcomes used to evaluate pharmacy-led medication therapy and disease management services within primary care settings to develop an outcomes framework for future studies.

METHODS

An umbrella literature review was conducted. MEDLINE, EMBASE, The Cochrane Library and PsycINFO were searched in June 2020 to identify relevant articles. Eligible reviews were those including studies published from 2010 onwards which reported on the outcomes of pharmacy-led medication therapy and disease management services within primary care, excluding community pharmacy settings. Data were extracted and a content analysis, guided by the ECHO model, stratified the outcomes into four areas: economic, clinical, humanistic and service.

RESULTS

Twenty-four reviews covering 52 unique studies were identified. Pharmacy-led services included: medication reviews (n=24, 46.2%), disease and therapy management (n=17, 32.7%), educational services (n=6, 11.5%), medicines reconciliation (n=3, 5.8%), and medication compliance support (n=1, 1.9%). Services were commonly targeted towards endocrine (n=23, 44.2%) or cardiovascular diseases (n=20, 38.5%). Outcomes most commonly explored were clinical (n=38, 73.1%) and service outcomes (n=37, 71.2%), followed by humanistic (n=23, 44.2%) and economic outcomes (n=13, 25.0%). Overall, 17 sub-categories of outcomes were identified; common sub-categories were: disease indicators [clinical]; medication use and healthcare utilisation [service]; adherence to medicines [humanistic]; and healthcare costs [economic].

CONCLUSIONS

The findings informed the development of an outcomes framework to guide the evaluation of medication therapy and disease management services, and facilitate international standardised outcome measures within primary care pharmacy to be developed. This could help offer vital evidence on the effectiveness of these services to ensure the pharmacy workforce is working optimally to support primary care.

Fall prevention interventions in primary care to reduce fractures and falls in people aged 70 years and over: the PreFIT three-arm cluster RCT

BACKGROUND

Falls and fractures are a major problem.

OBJECTIVES

To investigate the clinical effectiveness and cost-effectiveness of alternative falls prevention interventions.

DESIGN

Three-arm, pragmatic, cluster randomised controlled trial with parallel economic analysis. The unit of randomisation was the general practice.

SETTING

Primary care.

PARTICIPANTS

People aged ≥ 70 years.

INTERVENTIONS

All practices posted an advice leaflet to each participant. Practices randomised to active intervention arms (exercise and multifactorial falls prevention) screened participants for falls risk using a postal questionnaire. Active treatments were delivered to participants at higher risk of falling.

MAIN OUTCOME MEASURES

The primary outcome was fracture rate over 18 months, captured from Hospital Episode Statistics, general practice records and self-report. Secondary outcomes were falls rate, health-related quality of life, mortality, frailty and health service resource use. Economic evaluation was expressed in terms of incremental cost per quality-adjusted life-year and incremental net monetary benefit.

RESULTS

Between 2011 and 2014, we randomised 63 general practices (9803 participants): 21 practices (3223 participants) to advice only, 21 practices (3279 participants) to exercise and 21 practices (3301 participants) to multifactorial falls prevention. In the active intervention arms, 5779 out of 6580 (87.8%) participants responded to the postal fall risk screener, of whom 2153 (37.3%) were classed as being at higher risk of falling and invited for treatment. The rate of intervention uptake was 65% (697 out of 1079) in the exercise arm and 71% (762 out of 1074) in the multifactorial falls prevention arm. Overall, 379 out of 9803 (3.9%) participants sustained a fracture. There was no difference in the fracture rate between the advice and exercise arms (rate ratio 1.20, 95% confidence interval 0.91 to 1.59) or between the advice and multifactorial falls prevention arms (rate ratio 1.30, 95% confidence interval 0.99 to 1.71). There was no difference in falls rate over 18 months (exercise arm: rate ratio 0.99, 95% confidence interval 0.86 to 1.14; multifactorial falls prevention arm: rate ratio 1.13, 95% confidence interval 0.98 to 1.30). A lower rate of falls was observed in the exercise arm at 8 months (rate ratio 0.78, 95% confidence interval 0.64 to 0.96), but not at other time points. There were 289 (2.9%) deaths, with no differences by treatment arm. There was no evidence of effects in prespecified subgroup comparisons, nor in nested intention-to-treat analyses that considered only those at higher risk of falling. Exercise provided the highest expected quality-adjusted life-years (1.120), followed by advice and multifactorial falls prevention, with 1.106 and 1.114 quality-adjusted life-years, respectively. NHS costs associated with exercise (£3720) were lower than the costs of advice (£3737) or of multifactorial falls prevention (£3941). Although incremental differences between treatment arms were small, exercise dominated advice, which in turn dominated multifactorial falls prevention. The incremental net monetary benefit of exercise relative to treatment valued at £30,000 per quality-adjusted life-year is modest, at £191, and for multifactorial falls prevention is £613. Exercise is the most cost-effective treatment. No serious adverse events were reported.

LIMITATIONS

The rate of fractures was lower than anticipated.

CONCLUSIONS

Screen-and-treat falls prevention strategies in primary care did not reduce fractures. Exercise resulted in a short-term reduction in falls and was cost-effective.

FUTURE WORK

Exercise is the most promising intervention for primary care. Work is needed to ensure adequate uptake and sustained effects.

TRIAL REGISTRATION

Current Controlled Trials ISRCTN71002650.

FUNDING

This project was funded by the National Institute for Health Research (NIHR) Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol. 25, No. 34. See the NIHR Journals Library website for further project information.

Implementation of the milestones communication approach for patients with limited prognosis: evaluation of intervention fidelity

Background

Despite improvements in diagnostics and therapy, the majority of lung tumours are diagnosed at advanced stage IV with a poor prognosis. Due to the nature of an incurable disease, patients need to engage in shared decision making on advance care planning. To implement this in clinical practice, effective communication between patients, caregivers and healthcare professionals is essential. The Heidelberg Milestones Communication Approach (MCA) is delivered by a specifically trained interprofessional tandem and consists of four milestone conversations (MCs) at pivotal times in the disease trajectory. MC 1 (Diagnosis): i.e. prognosis; MC 2 (Stable disease): i.e. prognostic awareness; MC 3 (Progression): i.e. reassessment; MC 4 (Best supportive care): i.e. end of treatment. In between MCs, follow-up calls are carried out to sustain communication. This study aimed to assess to what extent the MCA was implemented as planned and consolidated in specialized oncology practice.

Methods

A prospective observational process evaluation study was conducted, which focused on the implementation fidelity of the MCA. All MCs during two assessment periods were included. We analysed all written records of the conversations, which are part of the routine documentation during MCs and follow-up calls. Adherence to key aspects of the manual was documented on structured checklists at the beginning of the implementation of the MCA and after 6 months. The analysis was descriptive. Differences between the two assessment periods are analysed with chi-square tests.

Results

A total of 133 MCs and 54 follow-up-calls (t1) and of 172 MCs and 92 follow-up calls (t2) were analysed. MC 2 were the most frequently completed conversations (n = 51 and n = 47). Advance care planning was discussed in 26 and 13% of MC 2 in the respective assessment periods; in 31 and 47% of MC 2, prognostic awareness was recorded. The most frequently documented topic in the follow-up calls was the physical condition in patients (82 and 83%).

Conclusion

The implementation of a trajectory-specific communication concept was largely successful. Additional studies are needed to understand how fidelity could be further improved.

Trial registration

DRKS00013469 / Date of registration: 22.12.2017.